Don't miss out on new Internet Tips and Tools. Sign up for the seabreezecomputers.com Internet Tips and Tools newsletter:
A message from Sea Breeze Computers
We apologize for the interruption. However, seabreezecomputers.com has been offering free tools
and downloads for many years. Unfortunately, server expenses are now starting to exceed revenue earned.
If you appreciate the free tools and downloads at seabreezcomputers.com please consider making a donation.
Speech Recognition Anywhere Browser Extension - Windows Add-On
Speech Recognition Anywhere is a browser extension for Google Chrome and Microsoft Edge that allows
you to use your voice to control the Internet and it allows you to type emails and documents with your
voice. Now there is a Windows Add-On for Speech Recognition Anywhere that allows you to use your voice
to control Microsoft Windows and Windows applications.
Video Tutorial
You may receive the following message from Windows Security:
Windows protected your PC
Windows Defender SmartScreen prevented an unrecognized app from starting.
Running this app might put your PC at risk.
If you receive the above message when trying to run the setup file then click on "More info".
Then click on "Run anyway".
Speech Recognition Anywhere is an accessibility application that allows users to control their
computer using their voice. The application can type key presses, move the mouse and click on buttons
at the direction of the user. Therefore, it is easy for anti virus software to have a false positive
and detect that it is potentially malicious.
Your Operating System is detected as:
Instructions
Close Speech Recognition Anywhere in the browser before installing the Windows Add-On.
Start Speech Recognition Anywhere in the browser and click on "Settings".
Then enable the following settings:
☑ Start in the background
☑ Click extension icon a second time to close the extension
☑ Allow speech recognition in Microsoft Windows and Windows Applications
Go to chrome://extensions/shortcuts in the browser and look for "Speech Recognition Anywhere".
There is a new keyboard shortcut that will work globally in Windows. It is labeled "Start/Stop".
Click on the pencil icon ✎ next to "Start/Stop" and type a keyboard shortcut. It
must be in combination with the Alt or Ctrl key. (NOTE: Chrome needs to be
running for the shortcut key to work.)
You may need to close and then restart Speech Recognition Anywhere in the browser. If that doesn't
work then try restarting your computer.
Click on an element.
name should be the AccessibleName
property of an element in a Windows application. To narrow down the element (in case some elements have the same
name) the controlType and className of the element can also be specified.
option can be specified as single, double or right.
(Requires Speech Recognition Anywhere Windows Add-On)
click_keyword(keyword)
click_keyword(option, keyword)
Click on a button or a control.
keyword should be the name of the button or control to click.
Example: click_keyword(ok) will left click on the "ok" button.
You can also specify to double click an element.
Example: click_keyword(double, ok) will double click on the "ok" button.
You can also specify to right click an element.
Example: click_keyword(right, document) will right click on the document.
Using the option "double" or "right" always moves the mouse pointer (arrow) to make the click. If the option
is not specified then the mouse pointer is not moved and the command tries to invoke or toggle the pattern
associated with the automation element. If you want to move the mouse pointer and do a single mouse click using an
actual mouse click then the option of "single" can be specified.
Example: click_keyword(single, File) will move the mouse pointer to "File" element and do a mouse click.
(Requires Speech Recognition Anywhere Windows Add-On)
move_mouse(direction, n)
move_mouse(direction, n, direction, n)
move_mouse(drag, direction, n)
move_mouse(x, y)
move_mouse(drag, x, y)
Move the mouse arrow.
direction can be left|up|right|down.
n is the amount of pixels to move the mouse in the direction.
Example: move_mouse(up, 100) will move the mouse up 100 pixels.
You can also specify two directions in one command:
Example: move_mouse(up, 100, left, 200) will move the mouse up 100 pixels and left 200 pixels.
If you want to drag the mouse (or move the mouse while the left button is being held down) then add drag.
Example: move_mouse(drag, up, 100, left, 200)
You can also specify a specific x and y pixel location on the screen with move_mouse(x, y);
Example: move_mouse(500, 250) Example: move_mouse(drag, 700, 500) (Requires Speech Recognition Anywhere Windows Add-On)
Windows 10: Opens shell:appsFolder to explore installed Windows programs.
Windows 7: Opens %PROGRAMDATA%\Microsoft\Windows\Start Menu\Programs folder to explore installed Windows programs.
The user can also specify a folder to browse:
Example: show_programs(%UserProfile%\Documents) (Requires Speech Recognition Anywhere Windows Add-On)
Read or speak out loud the contents of an element using speech synthesis or text-to-speech.
name should be the AccessibleName
property of an element in a Windows application. To narrow down the element (in case some elements have the same
name) the controlType and className of the element can also be specified.
(Requires Speech Recognition Anywhere Windows Add-On)
option can be the title of a window or the process name of a window. In that case it will
switch to and focus on that Window in Windows.
option can also be close|next|previous|minimize|maximize|restore.
(Requires Speech Recognition Anywhere Windows Add-On)
FAQ
Windows protected your PC message
You may receive the following message from Windows Security:
Windows protected your PC
Windows Defender SmartScreen prevented an unrecognized app from starting.
Running this app might put your PC at risk.
If you receive the above message when trying to run the setup file then click on "More info".
Then click on "Run anyway".
Speech Recognition Anywhere is an accessibility application that allows users to control their
computer using their voice. The application can type key presses, move the mouse and click on buttons
at the direction of the user. Therefore, it is easy for anti virus software to have a false positive
and detect that it is potentially malicious.
Threat or virus detected
Microsoft Windows Defender Windows 10 sometimes incorrectly detects the application as containing
Trojan:Script/Wacatac.B!ml. Speech Recognition Anywhere is an accessibility application that allows users to control their
computer using their voice. The application can type key presses, move the mouse and click on buttons
at the direction of the user. Therefore, it is easy for anti virus software to have a false positive
and detect that it is potentially malicious.
Virustotal.com scans files with over 50 different anti virus engines including AVG, ESET, Malwarebytes,
Avast, BitDefender, McAfee, Symantec.
Virustotal.com scan of speech.exe : 1 security vendor and no sandboxes flagged this file as malicious.
Security vendor analysis "Bkav Pro" detected W32.AIDetectMalware.CS in speech.exe
All the other virus vendors' analysis were clean. Bkav Pro is notorious for false positives of
downloadable files. 1 out of over 50 virus scanners means it is a false positive and not really infected with
malware.
https://www.virustotal.com/gui/file/87a68c9017e9cca71e64846dd27e90222e7d5343d32783f2de3b8892a36e2032
Speech Recognition does not work with programs that start with:
"User Account Control
Do you want to allow this app to make changes to your device?"
Speech Recognition will not work with programs that require Admin privileges
because User Account Control (UAC) on Windows starts the program with elevated
privileges and then it can't be accessed by other programs. There are a few methods
that you can try to make the program run without Administrator privileges that
may or may not work:
You can try to start the program with Speech Recognition Anywhere by saying:
"Start program <title of program>. Speech Recognition Anywhere will attempt
to start the program without Admin privileges.
You can disable User Account Control (UAC) on Windows. To do so click on
"⊞ Start", type in UAC. Select "Change User Account Control Settings".
Use the slider to go down to "Never Notify". Click on "OK".
This may disable Admin privileges for all programs. This method is not recommended
because it can open Windows up to hackers if users of the computer are not careful
using the Internet.
"Show Numbers" doesn't display labels on the Windows Start Menu
Windows 10 and above has protected system UI elements (such as the Windows Start Menu) or
processes that might be running at a higher privilege level. These Windows cannot be written
on top of with labels because of User Account Control (UAC) for Windows. To show labels on
these processes UAC would need to prompt for access which needs be done with a mouse or keyboard.
If you need to have "Show numbers" for the Start Menu programs then you can try saying, "Show all programs"
and then wait for the folder with path C:\ProgramData\Microsoft\Windows\Start Menu\Programs to display.
Then say "Show numbers".
Speech Recognition is not working with some Windows Applications
Sadly, some Windows applications were not programmed with accessibility in mind.
If you are trying to use speech recognition in a text box then it may not work correctly
if the programmers did not create the text box using the proper ControlType of "Document" or "Edit"
with a "TextPattern". Speech Recognition Anywhere has a built-in "test_window" that can help you see
the UIAutomation properties of an element. On the Windows Taskbar click on the Speech Recognition
Anywhere application so that the window can be viewed. Then type the ~ on the keyboard and the
test_window will appear. Now go to any Windows application window and hover the mouse over elements.
The test_window will show the properties of the element including the "Name" and the "ControlType" or
"LocalizedControlType" in the "HOVERED ELEMENT" section.
If you are trying to click on an element then you can see if the programmers added
a proper accessibility name to the elements by saying: "Show labels". If the programmers
added AutomationProperties.Name or the Control.AccessibleName property to the element then the
label should appear next to the element. If the programmers didn't add the proper Name property
then you still might be able to click on the element by saying: "Show Numbers". Then if the
controlType is a proper Button element or other clickable element then you might be able to click
on it by saying: "Click on [number]". For some elements you might need to say, "Double Click [number]"
to properly activate it. If that still doesn't work then if you know the shortcut key for an element
then you might be able to activate it by saying: "Type [key]". For example, you can try saying: "Type Control B".
Some applications may have data that is too large to do accessibility UI Automation.
For instance, if Windows Media Player has hundreds of songs then if you try commands like "Click on [button]"
or "Show numbers" then it may not work and may freeze Speech recognition anywhere and Windows media player
for several seconds.
If you are trying to use text to speech to read a text box using speech synthesis then it may
not work properly if the programmers did not create the text box using the proper ControlType of "Document"
or "Edit" with a "TextPattern" or "ValuePattern". For example, if they just used a ControlType of "Pane" then
there isn't any visible text available to accessibility programs. If that is the case then you can try
saying: "Select All" or select text manually with the mouse and then say: "Read selection."
The Windows Add-On freezes (Not Responding) after some commands
Please keep in mind that the Windows Add-On is in beta and there will be some bugs. Also, please
keep in mind that Windows accessibility UIAutomation in some applications is not made correctly and will cause
freezing with certain commands.
If the Windows Add-On is frozen or not responding after a certain command is spoken then you may choose
to wait for the Windows Add-On. This may take several seconds or possibly a few minutes. When it starts
responding again then you can click on the Windows Add-On icon in the Windows Taskbar to view the window
and then click on "Copy to Clipboard" to copy the diagnostic information. Then you may paste the diagnostic
information in an email to Speech Recognition Anywhere support. Hopefully a fix will be found in the future
after analyzing the diagnostic data. In the meantime, you may need to refrain from using that command (at
least in that particular program).
If you are in the middle of a project and don't have time to wait when the Windows Add-On freezes
then you may try to end the Windows Add-On process using Windows Task Manager.
Type Ctrl+Alt+Del and then click on "Start Task Manager". (Sometimes
starting Task Manager with Ctrl+Shift+Esc will also work.) In Task Manager
click on the "Processes" tab. Type "S" on the keyboard to scroll to the processes that start with "S" and then
click on speech.exe. Then click on "End Task". You may then need to close and restart "Speech recognition
anywhere" extension in the browser.
Version History
Version 0.9.0.3 - 6/4/2024
+ Bug fix: If dictation started with comma (,) then previously it was putting a space in front of the comma.
+ Skype now has proper spacing and capitalization.
+ Facebook app message box now capitalizes first letter.
Version 0.9.0.2 - 5/18/2024
+ Bug fix where some text boxes in browsers like Firefox and Brave Chromium were sometimes not doing the correct
capitalization and spacing.
+ Bug fix where "Clear text" and "select all" was not working in some text boxes in browsers like Firefox and
Brave Chromium.
+ Bug fix where "Move cursor to the top/bottom" was not working in some text boxes in Firefox and Brave Chromium.
Version 0.9.0.1 - 3/23/2024
Bug fix in keypress() command. "System.IndexOutOfRangeException: Index was outside the bounds of the array."
error was displayed if all 5 parameters were not used previously. Ex: keypress(key, ctrl, alt, shift, win_key)
Version 0.9.0.0 - 02/03/2024
First Beta Release
Last updated on June 22, 2024
Created on December 1, 2023