MeeGo 1.2.0 IVI Software Update Test Plan
Test Objective
MeeGo 1.2.0 IVI Software update testing is to validate the functionality of entire MeeGo 1.2.0 system updated distribution, to assure that
- the health of distribution built based on 1.2.0 release repo and update repo(1.2.0 update release build)
- the health of 1.2.0 release distribution after system update
- validate whether relative bugs are fixed by update patch
- explore regression issues when system is with updated software
Feature to be Tested
- MeeGo 1.2.0 IVI update release(XFCE desktop, BAT drivers/middleware)
- MeeGo 1.2.0 IVI final release can be successfully upgraded to update release
- New features or bug fixings introduced by updated packages
- Functionality and reliability in resulting upgraded system function
- Performance of MeeGo 1.2.0 update release
Test Strategy and Approach
Test Approach
- Install/Update system in various ways as below:
- Install 1.2.0 update release build directly to get latest software stuff
- system Upgrade from 1.2.0 final release
- Validate the system with below criteria:
- Software update can be previewed and easily completed via command line (zypper, pkcon).
- New functions of latest build works
- Unchanged functions are not broken
- No regression on performance and reliability of whole system
Test Cycle
- Sanity Testing
- Generally, update repo will be delivered each 1-2 weeks based on bug fix progress;
- QA will do sanity testing when new update repo/build is ready and cover:
- XFCE sanity testing
- Middleware components sanity testing
- IVI drivers sanity testing
- Bug verification and regression testing
- System Function Testing
- QA will conduct one round of system function testing to evaluate whole update system quality for update release final repo
Test Design
Sanity Test Checkpoints
| Checkpoints
| Details
|
| Installation
|
- Installer/Installer-shell launch and launch time
- Installation in text mode and system startup(installer removal)
- Installation in GUI mode and system startup(installer removal)
|
| System startup & shutdown
|
- Boot from local disk(X and console)
- Cold boot time and shutdown time
- Startx from console
|
| Powertop Log
|
- Powertop log analysis, Cn state, avg resident, Wakeup times
|
| Stability
|
- Shutdown and Reboot system 10 times without failure or crash
- Use multiple applications
|
| XFCE desktop
|
- Desktop render
- X/console switch
- XFCE menu view
- app launch/close/switch
|
| Connectivity -- Multi-tabs websites surfing and flash plugin check
|
- Ethernet connection/disconnection/file transfer(proxy)
- Wifi scan/connection/disconnection
- Bluetooth pairing/connection(A2DP, HFP)
|
| Multimedia
|
- aplay/arecord
- paplay/parec
- gstreamer play audio/video
|
| Peripheral devices
|
- Touch Screen
- USB keyboard/mouse
- USB stick/SD
|
| Basic linux command such as Zypper install/ debuginfo-install
|
- Zypper install/update/debuginfo-install/source-install default repo configuration
- pkcon install/update
|
Test Environment
Hardware
- Crossville/Lapis
- CRB = Brookville + ICM(Intel® Atom™ CPU E6XX Series + LAPIS ML7213 IOH)
- BIOS: AMI 4.6.3.7/0ABXJ 0.03
- Display: 7’’ LVDS
- Hard drive: SATA SSD 8G
- Crown Bay
- Crown Bay CRB = Shell Bay Fab2(Intel® EG20T IOH) + Little Bay REV D(Intel® Atom™ CPU E6XX Series)
- BIOS: AMI 4.6.3.7, Project 0ABTN 0.20
- Display = 13’’ LVDS
- Hard drive: SATA HD 160G
- wifi card: Intel wifi link 5100
Test Repos
- MeeGo 1.2.0 Release Repo
- MeeGo 1.2.0 Update Repo
QA Contact
Test Report
- Sanity Test Report
- System Use Test Report
Referrences