Meego Wiki
Views

In-vehicle/IVIHome Guide

From MeeGo wiki
(Difference between revisions)
Jump to: navigation, search
m (moved IVIHome Guide to In-vehicle/IVIHome Guide: make a subpage of In-vehicle)
(categorise, wikify table formatting, add <code>)
Line 29: Line 29:
*When you navigate the scroll menu list, it will use Festival to say the current menu item, you should hear “Navigation, Communication”, etc as you browse through the menu.
*When you navigate the scroll menu list, it will use Festival to say the current menu item, you should hear “Navigation, Communication”, etc as you browse through the menu.
*Text to speech is turned on by default, however, if you use TTS with speech recognition on a system with a mic too close to the speakers, they might interfere.
*Text to speech is turned on by default, however, if you use TTS with speech recognition on a system with a mic too close to the speakers, they might interfere.
-
*You can turn TTS on/off by editing the configuration file in /usr/share/ivihome/settings.xml and change <texttospeech>on<texttospeech> to off, then restart ivihome by executing “pkill ivihome”  
+
*You can turn TTS on/off by editing the configuration file in <code>/usr/share/ivihome/settings.xml</code> and change <texttospeech>on<texttospeech> to off, then restart ivihome by executing “pkill ivihome”  
<b>Speech recognition (IVIHome menu voice commands)</b>
<b>Speech recognition (IVIHome menu voice commands)</b>
*Speech recognition is supported by IVIHome. Speech recognition in applications needs to be added.
*Speech recognition is supported by IVIHome. Speech recognition in applications needs to be added.
*IVIHome speech recognition does not support continuous speech, it only recognizes voice commands for the IVIhome menu as shown below
*IVIHome speech recognition does not support continuous speech, it only recognizes voice commands for the IVIhome menu as shown below
*To turn on speech recognition, click on the microphone icon on the taskbar, to turn it off, click again.
*To turn on speech recognition, click on the microphone icon on the taskbar, to turn it off, click again.
-
*The following tables list the supported voice commands  (you can also look in /usr/share/ivihome/data/ivihome.jsgf):
+
*The following tables list the supported voice commands  (you can also look in <code>/usr/share/ivihome/data/ivihome.jsgf</code>):
-
<b>Menu Navigation Commands</b>
+
-
{| border="1"
+
-
!Voice Command
+
-
!Resulting action
+
-
|-
+
-
|"Home"
+
-
|Opens the home menu if the menu is closed, or returns to the home menu, same as the clicking HOME button on ShuttleXpress
+
-
|-
+
-
|"Back"
+
-
|goes back to the last menu, same as clicking the BACK button on ShuttleXpress
+
-
|-
+
-
|"Cancel"
+
-
|closes the menu completely
+
-
|-
+
-
|"Next"
+
-
|moves to the next menu item in the list, same as turning the knob to the RIGHT on the ShuttleXpress
+
-
|-
+
-
|"Previous"
+
-
|moves to the last menu item in the list, same as turning the knob to the LEFT on the ShuttleXpress
+
-
|-
+
-
|"Next Window"
+
-
|switches to the next opened application window on the taskbar
+
-
|-
+
-
|"Previous Window"
+
-
|switches to the previous opened application window on the taskbar
+
-
|-
+
-
|"Close Window"
+
-
|closes the current application window, exiting the app
+
-
|}
+
-
<b>Named Category and Application Commands</b>
+
{| class="wikitable"
 +
|+ Menu Navigation Commands
 +
|-
 +
!Voice Command
 +
!Resulting action
 +
|-
 +
|"Home"
 +
|Opens the home menu if the menu is closed, or returns to the home menu, same as the clicking HOME button on ShuttleXpress
 +
|-
 +
|"Back"
 +
|goes back to the last menu, same as clicking the BACK button on ShuttleXpress
 +
|-
 +
|"Cancel"
 +
|closes the menu completely
 +
|-
 +
|"Next"
 +
|moves to the next menu item in the list, same as turning the knob to the RIGHT on the ShuttleXpress
 +
|-
 +
|"Previous"
 +
|moves to the last menu item in the list, same as turning the knob to the LEFT on the ShuttleXpress
 +
|-
 +
|"Next Window"
 +
|switches to the next opened application window on the taskbar
 +
|-
 +
|"Previous Window"
 +
|switches to the previous opened application window on the taskbar
 +
|-
 +
|"Close Window"
 +
|closes the current application window, exiting the app
 +
|}
You can directly name any Catagory listed in the Root Menu or specific applications shown in each Catagory Menu.
You can directly name any Catagory listed in the Root Menu or specific applications shown in each Catagory Menu.
-
{| border="1"
 
-
!Catagory Command
 
-
!Recognized Application Commands
 
-
|-
 
-
|"Navigation"
 
-
|
 
-
|-
 
-
|"Driver Assistance"
 
-
|
 
-
|-
 
-
|"Communication"
 
-
|"Web", "Phone", "Connect"
 
-
|-
 
-
|"Media"
 
-
|"Photos", "Video", "Music"
 
-
|-
 
-
|"Other"
 
-
|"Activities", "Tools", "More Apps"
 
-
|}
 
-
<b>Application commands</b>
+
{| class="wikitable"
 +
|+ Named Category and Application Commands
 +
|-
 +
!Catagory Command
 +
!Recognized Application Commands
 +
|-
 +
|"Navigation"
 +
|
 +
|-
 +
|"Driver Assistance"
 +
|
 +
|-
 +
|"Communication"
 +
|"Web", "Phone", "Connect"
 +
|-
 +
|"Media"
 +
|"Photos", "Video", "Music"
 +
|-
 +
|"Other"
 +
|"Activities", "Tools", "More Apps"
 +
|}
Voice commands may be used to skip menu navigation and go directly to specific applications
Voice commands may be used to skip menu navigation and go directly to specific applications
-
{| border="1"
+
{| class="wikitable"
-
!Voice Command
+
|+ Application commands
-
!Resulting action
+
|-
-
|-  
+
!Voice Command
-
|"Open Navigation"
+
!Resulting action
-
|opens the Navit application
+
|-  
-
|-  
+
|"Open Navigation"
-
|"Open Dialer"
+
|opens the Navit application
-
|opens the handsfree dialer application
+
|-  
-
|-
+
|"Open Dialer"
-
|"Open Contacts"
+
|opens the handsfree dialer application
-
|opens the MeeGo contacts application
+
|-
-
|-
+
|"Open Contacts"
-
|"Open Web"
+
|opens the MeeGo contacts application
-
|opens the Fennec browser
+
|-
-
|-  
+
|"Open Web"
-
|"Open Browser"
+
|opens the Fennec browser
-
|opens the Fennec browser
+
|-  
-
|-
+
|"Open Browser"
-
|"Open Photo"
+
|opens the Fennec browser
-
|opens the the MeeGo photo application
+
|-
-
|-
+
|"Open Photo"
-
|"Open Music"
+
|opens the the MeeGo photo application
-
|opens the MeeGo music application
+
|-
-
|-  
+
|"Open Music"
-
|"Open Video"
+
|opens the MeeGo music application
-
|opens the MeeGo video application
+
|-  
-
|-
+
|"Open Video"
-
|"Open Setting"
+
|opens the MeeGo video application
-
|opens the the MeeGo control panel application
+
|-
-
|}
+
|"Open Setting"
 +
|opens the the MeeGo control panel application
 +
|}
The list of applications for each of the above application commands are defined in the <code>/usr/share/ivihome/settings.xml</code> file. You can edit this file to change the application that is launched by the voice commands. You cannot change the vocabulary list directly, it needs to be re-generated.  If you want to add more voice commands, you’ll have to add the command in the dictionary and re-generate the language model (grammar) and dictionary and implement the logic in the application.
The list of applications for each of the above application commands are defined in the <code>/usr/share/ivihome/settings.xml</code> file. You can edit this file to change the application that is launched by the voice commands. You cannot change the vocabulary list directly, it needs to be re-generated.  If you want to add more voice commands, you’ll have to add the command in the dictionary and re-generate the language model (grammar) and dictionary and implement the logic in the application.
 +
 +
[[Category:IVI]]

Revision as of 10:11, 27 April 2011

MeeGo IVI provides a "IVIHome" application that is the default MeeGo IVI homescreen when the system boots. This section provides information about the design and use of the MeeGo "IVIHome" screen and taskbar.

IVIHome Design Objectives

The primary objectives in designing the IVI Home Screen were:

  1. Provide a sample taskbar that utilizes a scrollwheel, Text to Speech and Speech Recognition so that it can be operated without distracting driver by requiring them to look at the display or a keyboard. During system development the IVIHome and taskbar application may still be operated via touchscreen or mouse.
  2. Provide an "automotive" look and feel with a rounded taskbar to reflect the scrollwheel use and the ability to switch the taskbar from left side to right side of the display, presuming the display is in the automotive center console and the steering wheel could be on the left or right.

IVIHome Use

Navigating the IVIHome taskbar may be done via touchscreen, scrollwheel, and Speech Recognition of voice commands with the help of Text to Speech (TTS).

Touchscreen support

  • IVIHome has full touchscreen support for platforms with working touchscreen hardware and drivers
  • IVIHome can also be navigated using a mouse and the user can use the mouse wheel to scroll through the menu.

Scrollwheel Support

  • Currently only the Contour ShuttleXpress is supported since the key mapping is hard-coded.
  • Currently only the IVIHome screen and taskbar support the ShuttleXpress. The application support has not been implemented yet.
  • The ShuttleXpress controller has 5 dedicated mouse buttons and knob that turns left/right, all of these buttons simulate key presses on a hardware button in a car and currently only works when you are at the IVIHome screen, they are not yet supported in any of the applications.
  • Just plug in the ShuttleXpress and it will recognize the device automatically (may have to reboot the system or restart by “pkill ivihome”)
  • The buttons are mapped to the following functions:
    • Button1 – BACK, this takes you back to the previous menu or closes the menu completely.
    • Button2 – HOME, this will always open up the navigation menu if the menu is closed, or return you back to the home menu if you are in a sub menu.
    • Button3 – SELECT/OPEN, this will open the highlighted menu or application, it is the same as clicking on the application.
    • Knob Left – UP, use this to navigate through the menu in UP direction.
    • Knob Right – DOWN, use this to navigate through the menu in DOWN direction.

Text-to-Speech(TTS)

  • Supported by IVIHome menu navigation
  • When you navigate the scroll menu list, it will use Festival to say the current menu item, you should hear “Navigation, Communication”, etc as you browse through the menu.
  • Text to speech is turned on by default, however, if you use TTS with speech recognition on a system with a mic too close to the speakers, they might interfere.
  • You can turn TTS on/off by editing the configuration file in /usr/share/ivihome/settings.xml and change <texttospeech>on<texttospeech> to off, then restart ivihome by executing “pkill ivihome”

Speech recognition (IVIHome menu voice commands)

  • Speech recognition is supported by IVIHome. Speech recognition in applications needs to be added.
  • IVIHome speech recognition does not support continuous speech, it only recognizes voice commands for the IVIhome menu as shown below
  • To turn on speech recognition, click on the microphone icon on the taskbar, to turn it off, click again.
  • The following tables list the supported voice commands (you can also look in /usr/share/ivihome/data/ivihome.jsgf):
Menu Navigation Commands
Voice Command Resulting action
"Home" Opens the home menu if the menu is closed, or returns to the home menu, same as the clicking HOME button on ShuttleXpress
"Back" goes back to the last menu, same as clicking the BACK button on ShuttleXpress
"Cancel" closes the menu completely
"Next" moves to the next menu item in the list, same as turning the knob to the RIGHT on the ShuttleXpress
"Previous" moves to the last menu item in the list, same as turning the knob to the LEFT on the ShuttleXpress
"Next Window" switches to the next opened application window on the taskbar
"Previous Window" switches to the previous opened application window on the taskbar
"Close Window" closes the current application window, exiting the app

You can directly name any Catagory listed in the Root Menu or specific applications shown in each Catagory Menu.

Named Category and Application Commands
Catagory Command Recognized Application Commands
"Navigation"
"Driver Assistance"
"Communication" "Web", "Phone", "Connect"
"Media" "Photos", "Video", "Music"
"Other" "Activities", "Tools", "More Apps"

Voice commands may be used to skip menu navigation and go directly to specific applications

Application commands
Voice Command Resulting action
"Open Navigation" opens the Navit application
"Open Dialer" opens the handsfree dialer application
"Open Contacts" opens the MeeGo contacts application
"Open Web" opens the Fennec browser
"Open Browser" opens the Fennec browser
"Open Photo" opens the the MeeGo photo application
"Open Music" opens the MeeGo music application
"Open Video" opens the MeeGo video application
"Open Setting" opens the the MeeGo control panel application

The list of applications for each of the above application commands are defined in the /usr/share/ivihome/settings.xml file. You can edit this file to change the application that is launched by the voice commands. You cannot change the vocabulary list directly, it needs to be re-generated. If you want to add more voice commands, you’ll have to add the command in the dictionary and re-generate the language model (grammar) and dictionary and implement the logic in the application.

Retrieved from "http://wiki.meego.com/In-vehicle/IVIHome_Guide"
Personal tools