Meego Wiki
Views

Quality/Plans/Meego1.2 media test plan

From MeeGo wiki
< Quality | Plans
Revision as of 07:24, 3 December 2010 by Jessicaji (Talk | contribs)
Jump to: navigation, search

Contents

Media Application Test Plan for MeeGo HandSet 1.2

Component Summary

Media subsystem plays an important role in Handset vertical. The media software stack in MeeGo is divided into 3 layers briefly. Upper level applications include Music/Photo/Video/camera application. Middleware libraries include audio server(Pulseaudio), audio library(ALSA), audio/video decoder library (Gstreamer), Gstreamer plugin, QT-mobility, QML,Tracker etc. Low level includes kernel modules or drivers such as Intel SST audio driver, V4l2 etc.

Our testing for handset 1.2 releases focus on upper layer application. And take advantage of shell command or script to validate the middleware or driver status just for bug root cause purpose.

The relevant media format & codecs tested is focusing on the free license file format & codecs. For example: ogg format, theora video, vorbis audio, bmp, jpg, png, gif, wav etc.

Feature to be Tested

The features listed here are all from MeeGo handset 1.2 media components feature zilla, media test will cove all these features with required priority, at the same time, the test will also cover other features which are not listed in this table, such as tool bar, i18/l10n etc.

Feature Name Feature Description Vertical Priority Comments
Audio Player *Audio playback
*Audio play control
*Artist/Album/Song Navigation & Playback
*Alphabetic scrolling
*Playlist generation
*Play Queue generation
*Audio search
*Shuffle and repeat
*Usability testing
*Stability testing
*Negative testing
*I18N
Handset P1 The design input: feature sets: Audio_Feature
Photo Viewer *Basic photo viewer functionality
*Photo album organization
*Photo search
*Photo mainipulation via popup menu
*Photo Orientation
*Thumbnail
*Stability testing
*Negative testing
*I18N
Handset P1 The design input: feature sets: Photo_Features
Video Player *Basic video playback
*Video play control
*Alphabetic scrolling
*Video file mainipulation via popup menu
*Video files filtering & search
*Switch between different category
*Stability testing
*Negative testing
*I18N
Handset P1 The design input: feature sets: Video_Features
Camera *Basic operation with Camera
*Shutter Key
*Mode select
*Capture or stop capture
*Pre-capture & Post-capture
*Auto focus
*Flash
*Zoom
*Erase image and store image
*Stability testing
*Negative testing
*I18N
Handset P1 The design input: feature sets: Camera_Features

Features not to be tested

Low level drivers will be not tested unless we need to perform the bug isolation. middleware level like media framework(gstreamer) or tracker, qt-mobility,v4l2, pulseaudio testing will not cover in this test plan.

Dependency and Risks

  • Pulseaudio is buggy right now. Probably it will blocks the audio/video testing.
  • only support public codec list, we don't release any license codec.

Test Strategy and Approach

  • UI testing

We will cover the media features via Music/Photo/Video/Camera application testing. Most of media usage models will be covered by this type of testing.

  • User experience testing

Make sure user have comfortable usage experience like there no stuttering and no frame drop during video playback, no scratchy when playback audio and etc. There is no dedicate cases designed for it specially, it will be covered by normal usage testing.

  • Negative testing

We will test boundary, negative input value and error input. Also some negative scenarios will be covered, such as playback non-media files or un-supported media file.

  • Stability testing

Media is one type of resource intensive application (memory, cpu load) and user may put long time on one application like watch movie. So we test media apps' stability under long time run to make sure there is no crash etc.

  • I18N/L10n testing

Test focus is for I18N mechanism in media application. Generally, we set another language environment (ex. Chinese Simplified) instead of default English environment and check the change of media application. Notes: only Chinese Simplified Translation will be covered by QA, for other languages, they will be covered by other teams.

  • Performance testing

Performance testing will be covered by performance test separately.

  • Others

For some low level testing such as pulseaudio, we may use pulseaudio compatible sample applications to cover the police config setting for typical usage models.

  • Test case leverage

more design is same with tablet vertical. we will leverage to use more test cases to avoid overlap.

Test Design

Audio

Feature Set Test Point
Audio Playback control
  • Audio play/pause
  • Audio mute/unmute
  • Back to previous song
  • Skip to next song
  • Repeat playback
  • Shuffle playback
artist/album/song Navigation$Playback
  • Select given artist and browse the all albums within it
  • Select given album and browse the all songs within it
  • Playback all songs within one artist
  • Playback all songs within one album
  • Playback one song
Alphabetic scrolling
  • Scrolling to a given character head in My Music view
  • Scrolling to a givne character head in playlist view
Playlist manipulation
  • Create one new playlist
  • Delete one playlist
  • Add all songs within one artist to a given playlist
  • Add all songs wihtin one Album to a given playlist
  • Add one song to a given playlist
  • Playback a given playlist
Audio Search
  • Search Artists/Albums/Songs by a given string
  • All results/Artists/Albums/Songs tab view switch
  • Playback the selected item from search result
  • Add the selected item from search result into a given playlist
Play Queue manipulation
  • Switch to PlayQueue view
  • Add a given song/album/artist to PlayQueue
  • Check PlayQueue status display like show current song title in bottom bar
gesture
  • Flick action on lists causes the list to be scrolled up/down.
  • Tapping on a letter name causes the artist list to jump to artist name starting with selected letter
Notifications
  • Song title/album art and artist name are visible in notification area
  • Pause and mute button are also visible in notification
Volume control
  • Audio play in foreground with volume control
  • Audio play in background with volume control
Usability testing
  • navigate the photos and listening music
  • navigate the browsers and listening music
  • audio volume control in foreground and background
stress testing
  • Playback the audio for a long time
  • Browse great number of audio files
  • Change the playback state randomly
Negative testing
  • Playback non-audio files
  • Playback un-supported files
I18N/L10n testing
  • Switch language between Simplified Chinese and English

Photo

Feature Set Test Point
View Function
  • Photo thumbnail
  • View a given photo
  • Photo slide show
  • Photo navigation (Previous, Next)
Format
  • JPEG
  • BMP
  • PNG
  • GIF
Album Generation
  • Organize photo album taken in similar time
  • Organize photo album taken in similar place
Search
  • Search a photo by a given string
  • Search an album by a given string
  • Search result view switch between photo and album
Contextual Menu
  • Slide show
  • Tag
  • Copy
  • Rotate CW
  • Rotate CCW
  • Delete
Orientation
  • Portrait
  • Landscape
Operation
  • save
  • delete
  • rotate
  • set as wallpaper
  • set as avatar
Info
  • review image detail with metadata
Sharing
  • share with sms
  • share with email
  • share with bluetooth
  • share with flickr
  • share with facebook
  • share with picasa
Resize
  • Photo panning and scrolling
  • Photo zoom
Stress
  • Slide show the photo files for a long time
  • Browse great number of photo files
  • view large photo file
Negative
  • View non-picture files
  • View un-supported picture files
I18N/L10N
  • Switch language between Simplified Chinese and English

Video

In MeeGo 1.2 release, video player test points includes:

Feature Set Test Point
Play Control
  • play
  • pause
  • seek
  • fastforward
  • backforward
Info
  • total time line
  • reserved time line
Alphabetic scrolling
  • sort
  • gesture
contextual menu
  • play
  • delete
  • favorite
Search
  • by name
  • by words
  • by artist
Streaming
  • by SDP file with domain name
  • by SDP file with ip address
  • by rtsp session
Stress
  • Playback a long video file
  • Browse great number of video files
  • Change the playback state randomly
Negative
  • Playback non-video files
  • Playback un-supported video files
I18N/L10N
    • Switch language between Simplified Chinese and English

Camera

Feature Set Test Point
Capture
  • Start camera via app menu/lens cover/shutter key
  • Close camera via app menu/lens cover
Mode select
    • capture photo
    • capture video
Pre-capture & Post-capture
  • pre-capture
  • post-capture
Autofocus
  • Autofocus indicator
  • Autofocus performance
Flash
  • Flash on
  • Flash off
  • Flash auto
zoom
  • zoom in
  • zoom out
file operation
  • Erase image
  • store image
self timer
  • Self timer
  • burst mode
Stress
  • Capture a long video file
  • Capture one high definition video file
  • Capture one high definition photo file
  • burst mode capture for long time
  • Change the capture mode randomly
Negative
  • no power while capture
  • under sun light environment while capture
  • far away with target while capture
I18N/L10N
  • Switch language between Simplified Chinese and English

Collaboration

Mainly for the conditions that the application will meet, mainly introduced by platform characteristic. For example, devices may in different wireless environment, users may use different input methods to write, etc.

Item ID Name Details Comments
1 Virtual Keyboard
  • Input strings via virtual keyboard
  • Short cut key to operate browser
.
2 Device management file privisioning or device sync .
3 Web browser
  • try to progressive download one video or audio file
  • try to launch video or audio player from web browser
.
4 telephony how to handle audio/video playback while one phone is comming .
5 Location
  • all media applications need to support landscape and portrait mode
  • photo exif data will have location info. and group with place
.
6 webservice
  • through SMS share some video/photo/audio with others
  • through email share
  • through bluetooth share
  • through popular website share
.
7 Notification
  • handle notification while playing music
  • handle notification while playing video
  • handle notification while playing photo
  • handle notification while capture picture by camera application
.
8 Instant Message
  • browser with one photo, set with avatar
.

Condition

Mainly for the conditions that the application will meet, maily introduced by platform characteristic. For example, devices may in different wireless environment, users may use different input methods to write, etc.

Item ID Name Details Comments
1 Touch framework supported devices Test devices need support touch framework .
2 Wired network

Connects to wired network:

  • Using proxy
  • Without proxy
.
3 Wireless network

Connects to wireless network:

  • Using proxy
  • Without proxy
.
4 Landscape and portrait views

Change screen orientation to get different views:

  • Landscape view with proper window size
  • Portrait view with proper windows size
.
5 Power state

The state may include:

  • idle
  • sleep
  • resume
.
6 Touch and gesture
  • MeeGo Touch Framework gestures
  • Additional gestures support in media applications:
    • Pinch to zoom in and out, scaling the whole page.
    • Flick back and forward to go back and forward with previous/next track;
    • Scroll to page up and down
    • Finger scrolling to move up and down
    • Long press to trigger context menu
    • Double tap to switch zoom level
    • Two-fingers long press to select text
.
7 Other Devices
  • speaker
  • headset
  • bluetooth headset
.
8 Virtual Keyboard
  • Virtual keyboard interaction
  • hardware keyboard interaction
.

Test Environment

Hardware Platforms

  • NCDK and ICDK

Network

  • Internal network uses proxy to access internet
  • Access internet directly without any proxy
  • wireless

Tools

  • gst-launch
  • paplay
  • aplay

QA Contact

Jessica Ji

Developers

References

  • Application Test Design Method ---TBD
  • MeeGo UI design wireframes
Personal tools