Meego Wiki
Views

In-vehicle/IVIHome Guide

From MeeGo wiki
< In-vehicle(Difference between revisions)
Jump to: navigation, search
(→IVIHome Guide)
 
(3 intermediate revisions not shown)
Line 1: Line 1:
-
=== IVIHome Guide ===
+
The new QML-based MeeGo IVI UX replaces the existing "IVIHome" application and now is the default MeeGo IVI homescreen when the system boots.  A lot of the functionalities and features of the existing home screen are ported over to the new UX. This section provides information about the design and use of the new MeeGo IVI Home Screen.
-
MeeGo IVI provides a "IVIHome" application that is the default MeeGo IVI homescreen when the system boots. This section provides information about the design and use of the MeeGo "IVIHome" screen and taskbar.
+
-
<u>''' IVIHome Design Objectives'''</u>
+
== MeeGo IVI Home Screen Design Objectives ==
The primary objectives in designing the IVI Home Screen were:
The primary objectives in designing the IVI Home Screen were:
-
# Provide a sample taskbar that utilizes a scrollwheel, Text to Speech and Speech Recognition so that it can be operated without distracting driver by requiring them to look at the display or a keyboard. During system development the IVIHome and taskbar application may still be operated via touchscreen or mouse.  
+
# Provide a sample UX that utilizes a scrollwheel, Text to Speech and Speech Recognition so that it can be operated without distracting driver by requiring them to look at the display or a keyboard. During system development the home screen application may still be operated via touchscreen or mouse.  
-
# Provide an "automotive" look and feel with a rounded taskbar to reflect the scrollwheel use and the ability to switch the taskbar from left side to right side of the display, presuming the display is in the automotive center console and the steering wheel could be on the left or right.
+
# Provide an "automotive" look and feel with a scrollable menu that reflects the scrollwheel use and the ability to easily customized the UX with the new QML-based and javascript language, which provides cutting edge UIs with unified user experience interating with other MeeGo applications.
-
<u>''' IVIHome Use'''</u>
+
== IVI Home Screen Use ==
-
Navigating the IVIHome taskbar may be done via touchscreen, scrollwheel, and Speech Recognition of voice commands with the help of Text to Speech (TTS).
+
Navigating the IVI home screen may be done via touchscreen, scrollwheel, and Speech Recognition of voice commands with the help of Text to Speech (TTS).
<b>Touchscreen support</b>
<b>Touchscreen support</b>
-
* IVIHome has full touchscreen support for platforms with working touchscreen hardware and drivers
+
* IVI home screen has full touchscreen support for platforms with working touchscreen hardware and drivers
-
* IVIHome can also be navigated using a mouse and the user can use the mouse wheel to scroll through the menu.
+
* IVI home screen can also be navigated using a mouse and the user can use the mouse wheel to scroll through the menu.
<b>Scrollwheel Support</b>
<b>Scrollwheel Support</b>
*Currently only the Contour ShuttleXpress is supported since the key mapping is hard-coded.
*Currently only the Contour ShuttleXpress is supported since the key mapping is hard-coded.
-
*Currently only the IVIHome screen and taskbar support the ShuttleXpress. The application support has not been implemented yet.
+
*Currently only the IVI home screen supports the ShuttleXpress. The application support has not been implemented yet.
-
*The ShuttleXpress controller has 5 dedicated mouse buttons and knob that turns left/right, all of these buttons simulate key presses on a hardware button in a car and currently only works when you are at the IVIHome screen, they are not yet supported in any of the applications.
+
*The ShuttleXpress controller has 5 dedicated mouse buttons and knob that turns left/right, all of these buttons simulate key presses on a hardware button in a car and currently only works when you are at the IVI home screen, they are not yet supported in any of the applications.
-
*Just plug in the ShuttleXpress and it will recognize the device automatically (may have to reboot the system or restart by “pkill ivihome”)
+
*Just plug in the ShuttleXpress and it will recognize the device automatically.
* The buttons are mapped to the following functions:
* The buttons are mapped to the following functions:
-
**<b>Button1</b> – BACK, this takes you back to the previous menu or closes the menu completely.
+
**<b>Button1</b> – BACK, at the home screen, this takes you back to the previous menu or closes the menu completely.  It will take you back to the home screen if you are within any other applications.
**<b>Button2</b> – HOME, this will always open up the navigation menu if the menu is closed, or return you back to the home menu if you are in a sub menu.
**<b>Button2</b> – HOME, this will always open up the navigation menu if the menu is closed, or return you back to the home menu if you are in a sub menu.
**<b>Button3</b> – SELECT/OPEN, this will open the highlighted menu or application, it is the same as clicking on the application.
**<b>Button3</b> – SELECT/OPEN, this will open the highlighted menu or application, it is the same as clicking on the application.
-
**<b>Knob Left</b> – UP, use this to navigate through the menu in UP direction.
+
**<b>Knob Left</b> – At the desktop, this makes the desktop icons rotate counter-clockwise.  When the menu is opened, use this to navigate through the menu in UP direction.
-
**<b>Knob Right</b> – DOWN, use this to navigate through the menu in DOWN direction.
+
**<b>Knob Right</b> – At the desktop, this makes the desktop icons rotate clockwise.  When the menu is opened, use this to navigate through the menu in DOWN direction.
<b>Text-to-Speech(TTS)</b>
<b>Text-to-Speech(TTS)</b>
-
*Supported by IVIHome menu navigation
+
*Supported by home screen and menu navigation
-
*When you navigate the scroll menu list, it will use Festival to say the current menu item, you should hear “Navigation, Communication”, etc as you browse through the menu.
+
*When you navigate the desktop icon list or the scroll menu list, it will use Festival to say the current menu item, you should hear “Navigation, Communication”, etc as you browse through the menu.
*Text to speech is turned on by default, however, if you use TTS with speech recognition on a system with a mic too close to the speakers, they might interfere.
*Text to speech is turned on by default, however, if you use TTS with speech recognition on a system with a mic too close to the speakers, they might interfere.
-
*You can turn TTS on/off by editing the configuration file in /usr/share/ivihome/settings.xml and change <texttospeech>on<texttospeech> to off, then restart ivihome by executing “pkill ivihome”
+
*You can turn TTS on/off by clicking on the toggle button in the top menu of the home screen.
-
<b>Speech recognition (IVIHome menu voice commands)</b>
+
<b>Speech recognition (IVI home screen voice commands)</b>
-
*Speech recognition is supported by IVIHome. Speech recognition in applications needs to be added.
+
*Speech recognition is supported by IVI Home Screen only. Speech recognition in applications needs to be added.
-
*IVIHome speech recognition does not support continuous speech, it only recognizes voice commands for the IVIhome menu as shown below
+
*Speech recognition does not support continuous speech, it only recognizes voice commands for the IVI home menu as shown below
-
*To turn on speech recognition, click on the microphone icon on the taskbar, to turn it off, click again.
+
*Speech recognition is turned off by default.  To turn on speech recognition, click on the microphone toggle button in the top menu of the home screen.
-
*The following tables list the supported voice commands  (you can also look in /usr/share/ivihome/data/ivihome.jsgf):
+
*The following tables list the supported voice commands  (you can also look in <code>/usr/share/meego-ux-ivi/voicerecognition/meego-ux-ivi.jsgf</code>):
-
<b>Menu Navigation Commands</b>
+
-
{| border="1"
+
-
!Voice Command
+
-
!Resulting action
+
-
|-
+
-
|"Home"
+
-
|Opens the home menu if the menu is closed, or returns to the home menu, same as the clicking HOME button on ShuttleXpress
+
-
|-
+
-
|"Back"
+
-
|goes back to the last menu, same as clicking the BACK button on ShuttleXpress
+
-
|-
+
-
|"Cancel"
+
-
|closes the menu completely
+
-
|-
+
-
|"Next"
+
-
|moves to the next menu item in the list, same as turning the knob to the RIGHT on the ShuttleXpress
+
-
|-
+
-
|"Previous"
+
-
|moves to the last menu item in the list, same as turning the knob to the LEFT on the ShuttleXpress
+
-
|-
+
-
|"Next Window"
+
-
|switches to the next opened application window on the taskbar
+
-
|-
+
-
|"Previous Window"
+
-
|switches to the previous opened application window on the taskbar
+
-
|-
+
-
|"Close Window"
+
-
|closes the current application window, exiting the app
+
-
|}
+
-
<b>Named Category and Application Commands</b>
+
{| class="wikitable"
 +
|+ Menu Navigation Commands
 +
|-
 +
!Voice Command
 +
!Resulting action
 +
|-
 +
|"Home"
 +
|Goes back to the home screen if you are within any application.  If you are at the home screen, it opens the home menu if the menu is closed, or returns to the home menu, same as the clicking HOME button on ShuttleXpress
 +
|-
 +
|"Back"
 +
|goes back to the last menu, same as clicking the BACK button on ShuttleXpress
 +
|-
 +
|"Cancel"
 +
|Same as the "Back" command
 +
|-
 +
|"Next"
 +
|moves to the next application on the desktop or next item on the scroll menu, same as turning the knob to the RIGHT on the ShuttleXpress
 +
|-
 +
|"Previous"
 +
|moves to the previous application on the desktop or the previous item on the scroll menu, same as turning the knob to the LEFT on the ShuttleXpress
 +
|-
 +
|"Open"
 +
|launches the selected application on the desktop or the selected application on the scroll menu.
 +
|-
 +
|"Close"
 +
|Closes the current applicatoin and return to the IVI home screen
 +
|-
 +
|"Tasks"
 +
|Shows the task switcher with a list of running applications
 +
|}
-
You can directly name any Catagory listed in the Root Menu or specific applications shown in each Catagory Menu.
+
If you are in the desktop with the scroll menu closed, you can directly speak the name of any of the 5 application shown in the desktop menu. It will automatically highlight the recognized application.
-
{| border="1"
+
-
!Catagory Command
+
-
!Recognized Application Commands
+
-
|-
+
-
|"Navigation"
+
-
|
+
-
|-
+
-
|"Driver Assistance"
+
-
|
+
-
|-
+
-
|"Communication"
+
-
|"Web", "Phone", "Connect"
+
-
|-
+
-
|"Media"
+
-
|"Photos", "Video", "Music"
+
-
|-
+
-
|"Other"
+
-
|"Activities", "Tools", "More Apps"
+
-
|}
+
-
<b>Application commands</b>
+
{| class="wikitable"
 +
|+ Shortcut Application Commands
 +
|-
 +
!Voice Commands
 +
|-
 +
|"Navigation"
 +
|-
 +
|"Settings"
 +
|-
 +
|"Dialer"
 +
|-
 +
|"Web"
 +
|-
 +
|"Panels"
 +
|}
Voice commands may be used to skip menu navigation and go directly to specific applications
Voice commands may be used to skip menu navigation and go directly to specific applications
-
{| border="1"
+
{| class="wikitable"
-
!Voice Command
+
|+ Application commands
-
!Resulting action
+
|-
-
|-  
+
!Voice Command
-
|"Open Navigation"
+
!Resulting action
-
|opens the Navit application
+
|-  
-
|-  
+
|"Open Navigation"
-
|"Open Dialer"
+
|opens the Navit application
-
|opens the handsfree dialer application
+
|-  
-
|-
+
|"Open Dialer"
-
|"Open Contacts"
+
|opens the Dialer application with BT-HFP
-
|opens the MeeGo contacts application
+
|-
-
|-
+
|"Open Contacts"
-
|"Open Web"
+
|opens the MeeGo contacts application
-
|opens the Fennec browser
+
|-
-
|-  
+
|"Open Web"
-
|"Open Browser"
+
|opens the MeeGo browser application
-
|opens the Fennec browser
+
|-  
-
|-
+
|"Open Browser"
-
|"Open Photo"
+
|opens the MeeGo browser application
-
|opens the the MeeGo photo application
+
|-
-
|-
+
|"Open Photos"
-
|"Open Music"
+
|opens the the MeeGo photo application
-
|opens the MeeGo music application
+
|-
-
|-  
+
|"Open Music"
-
|"Open Video"
+
|opens the MeeGo music application
-
|opens the MeeGo video application
+
|-  
-
|-
+
|"Open Videos"
-
|"Open Setting"
+
|opens the MeeGo video application
-
|opens the the MeeGo control panel application
+
|-
-
|}
+
|"Open Settings"
 +
|opens the the MeeGo control panel application
 +
|-
 +
|"Open Panels"
 +
|opens the the MeeGo panels
 +
|}
-
The list of applications for each of the above application commands are defined in the /usr/share/ivihome/settings.xml. You can edit this file to change the application that is launched by the voice commands. You cannot change the vocabulary list directly, it needs to be re-generated.  If you want to add more voice commands, you’ll have to add the command in the dictionary and re-generate the language model (grammar) and dictionary and implement the logic in the application.
+
The list of applications for each of the above application commands are defined in the <code>/usr/share/meego-ux-ivi/home.js</code> javascript file. You can edit this file to change the application that is launched by the voice commands. You cannot change the vocabulary list directly, it needs to be re-generated.  If you want to add more voice commands, you’ll have to add the command in the dictionary and re-generate the language model (grammar) and dictionary and implement the logic in the application.
 +
 
 +
[[Category:IVI]]

Latest revision as of 08:53, 15 May 2011

The new QML-based MeeGo IVI UX replaces the existing "IVIHome" application and now is the default MeeGo IVI homescreen when the system boots. A lot of the functionalities and features of the existing home screen are ported over to the new UX. This section provides information about the design and use of the new MeeGo IVI Home Screen.

MeeGo IVI Home Screen Design Objectives

The primary objectives in designing the IVI Home Screen were:

  1. Provide a sample UX that utilizes a scrollwheel, Text to Speech and Speech Recognition so that it can be operated without distracting driver by requiring them to look at the display or a keyboard. During system development the home screen application may still be operated via touchscreen or mouse.
  2. Provide an "automotive" look and feel with a scrollable menu that reflects the scrollwheel use and the ability to easily customized the UX with the new QML-based and javascript language, which provides cutting edge UIs with unified user experience interating with other MeeGo applications.

IVI Home Screen Use

Navigating the IVI home screen may be done via touchscreen, scrollwheel, and Speech Recognition of voice commands with the help of Text to Speech (TTS).

Touchscreen support

  • IVI home screen has full touchscreen support for platforms with working touchscreen hardware and drivers
  • IVI home screen can also be navigated using a mouse and the user can use the mouse wheel to scroll through the menu.

Scrollwheel Support

  • Currently only the Contour ShuttleXpress is supported since the key mapping is hard-coded.
  • Currently only the IVI home screen supports the ShuttleXpress. The application support has not been implemented yet.
  • The ShuttleXpress controller has 5 dedicated mouse buttons and knob that turns left/right, all of these buttons simulate key presses on a hardware button in a car and currently only works when you are at the IVI home screen, they are not yet supported in any of the applications.
  • Just plug in the ShuttleXpress and it will recognize the device automatically.
  • The buttons are mapped to the following functions:
    • Button1 – BACK, at the home screen, this takes you back to the previous menu or closes the menu completely. It will take you back to the home screen if you are within any other applications.
    • Button2 – HOME, this will always open up the navigation menu if the menu is closed, or return you back to the home menu if you are in a sub menu.
    • Button3 – SELECT/OPEN, this will open the highlighted menu or application, it is the same as clicking on the application.
    • Knob Left – At the desktop, this makes the desktop icons rotate counter-clockwise. When the menu is opened, use this to navigate through the menu in UP direction.
    • Knob Right – At the desktop, this makes the desktop icons rotate clockwise. When the menu is opened, use this to navigate through the menu in DOWN direction.

Text-to-Speech(TTS)

  • Supported by home screen and menu navigation
  • When you navigate the desktop icon list or the scroll menu list, it will use Festival to say the current menu item, you should hear “Navigation, Communication”, etc as you browse through the menu.
  • Text to speech is turned on by default, however, if you use TTS with speech recognition on a system with a mic too close to the speakers, they might interfere.
  • You can turn TTS on/off by clicking on the toggle button in the top menu of the home screen.

Speech recognition (IVI home screen voice commands)

  • Speech recognition is supported by IVI Home Screen only. Speech recognition in applications needs to be added.
  • Speech recognition does not support continuous speech, it only recognizes voice commands for the IVI home menu as shown below
  • Speech recognition is turned off by default. To turn on speech recognition, click on the microphone toggle button in the top menu of the home screen.
  • The following tables list the supported voice commands (you can also look in /usr/share/meego-ux-ivi/voicerecognition/meego-ux-ivi.jsgf):
Menu Navigation Commands
Voice Command Resulting action
"Home" Goes back to the home screen if you are within any application. If you are at the home screen, it opens the home menu if the menu is closed, or returns to the home menu, same as the clicking HOME button on ShuttleXpress
"Back" goes back to the last menu, same as clicking the BACK button on ShuttleXpress
"Cancel" Same as the "Back" command
"Next" moves to the next application on the desktop or next item on the scroll menu, same as turning the knob to the RIGHT on the ShuttleXpress
"Previous" moves to the previous application on the desktop or the previous item on the scroll menu, same as turning the knob to the LEFT on the ShuttleXpress
"Open" launches the selected application on the desktop or the selected application on the scroll menu.
"Close" Closes the current applicatoin and return to the IVI home screen
"Tasks" Shows the task switcher with a list of running applications

If you are in the desktop with the scroll menu closed, you can directly speak the name of any of the 5 application shown in the desktop menu. It will automatically highlight the recognized application.

Shortcut Application Commands
Voice Commands
"Navigation"
"Settings"
"Dialer"
"Web"
"Panels"

Voice commands may be used to skip menu navigation and go directly to specific applications

Application commands
Voice Command Resulting action
"Open Navigation" opens the Navit application
"Open Dialer" opens the Dialer application with BT-HFP
"Open Contacts" opens the MeeGo contacts application
"Open Web" opens the MeeGo browser application
"Open Browser" opens the MeeGo browser application
"Open Photos" opens the the MeeGo photo application
"Open Music" opens the MeeGo music application
"Open Videos" opens the MeeGo video application
"Open Settings" opens the the MeeGo control panel application
"Open Panels" opens the the MeeGo panels

The list of applications for each of the above application commands are defined in the /usr/share/meego-ux-ivi/home.js javascript file. You can edit this file to change the application that is launched by the voice commands. You cannot change the vocabulary list directly, it needs to be re-generated. If you want to add more voice commands, you’ll have to add the command in the dictionary and re-generate the language model (grammar) and dictionary and implement the logic in the application.

Retrieved from "http://wiki.meego.com/In-vehicle/IVIHome_Guide"
Personal tools