Meego Wiki
Views

Quality/1.2.0 IVI Update Test Plan

From MeeGo wiki
(Difference between revisions)
Jump to: navigation, search
(Created page with "= MeeGo 1.2.0 IVI Software Update Test Plan = == Test Objective == MeeGo 1.2.0 IVI Software update testing is to validate the functionality of entire MeeGo 1.2.0 system updated ...")
(→Hardware)
Line 99: Line 99:
=== Hardware ===
=== Hardware ===
* Crossville/Lapis
* Crossville/Lapis
 +
** CRB = Brookville + ICM(Intel® Atom™ CPU E6XX Series + LAPIS ML7213 IOH)
 +
** BIOS: AMI 4.6.3.7/0ABXJ 0.03
 +
** Display: 7’’ LVDS
 +
** Hard drive: SATA SSD 8G
* Crown Bay
* Crown Bay
 +
** Crown Bay CRB = Shell Bay Fab2(Intel® EG20T IOH) + Little Bay REV D(Intel® Atom™ CPU E6XX Series)
 +
** BIOS: AMI 4.6.3.7, Project 0ABTN 0.20
 +
** Display = 13’’ LVDS
 +
** Hard drive: SATA HD 160G
 +
** wifi card: Intel wifi link 5100
=== Test Repos ===
=== Test Repos ===

Revision as of 02:44, 19 October 2011

Contents

MeeGo 1.2.0 IVI Software Update Test Plan

Test Objective

MeeGo 1.2.0 IVI Software update testing is to validate the functionality of entire MeeGo 1.2.0 system updated distribution, to assure that

  • the health of distribution built based on 1.2.0 release repo and update repo(1.2.0 update release build)
  • the health of 1.2.0 release distribution after system update
  • validate whether relative bugs are fixed by update patch
  • explore regression issues when system is with updated software

Feature to be Tested

  • MeeGo 1.2.0 IVI update release(XFCE desktop, BAT drivers/middleware)
  • MeeGo 1.2.0 IVI final release can be successfully upgraded to update release
  • New features or bug fixings introduced by updated packages
  • Functionality and reliability in resulting upgraded system function
  • Performance of MeeGo 1.2.0 update release

Test Strategy and Approach

Test Approach

  • Install/Update system in various ways as below:
    • Install 1.2.0 update release build directly to get latest software stuff
    • system Upgrade from 1.2.0 final release
  • Validate the system with below criteria:
    • Software update can be previewed and easily completed via command line (zypper, pkcon).
    • New functions of latest build works
    • Unchanged functions are not broken
    • No regression on performance and reliability of whole system

Test Cycle

  • Sanity Testing
    • Generally, update repo will be delivered each 1-2 weeks based on bug fix progress;
    • QA will do sanity testing when new update repo/build is ready and cover:
      • XFCE sanity testing
      • Middleware components sanity testing
      • IVI drivers sanity testing
      • Bug verification and regression testing
  • System Function Testing
    • QA will conduct one round of system function testing to evaluate whole update system quality for update release final repo

Test Design

Sanity Test Checkpoints

Checkpoints Details
Installation
  • Installer/Installer-shell launch and launch time
  • Installation in text mode and system startup(installer removal)
  • Installation in GUI mode and system startup(installer removal)
System startup & shutdown
  • Boot from local disk(X and console)
  • Cold boot time and shutdown time
  • Startx from console
Powertop Log
  • Powertop log analysis, Cn state, avg resident, Wakeup times
Stability
  • Shutdown and Reboot system 10 times without failure or crash
  • Use multiple applications
XFCE desktop
  • Desktop render
  • X/console switch
  • XFCE menu view
  • app launch/close/switch
Connectivity -- Multi-tabs websites surfing and flash plugin check
  • Ethernet connection/disconnection/file transfer(proxy)
  • Wifi scan/connection/disconnection
  • Bluetooth pairing/connection(A2DP, HFP)
Multimedia
  • aplay/arecord
  • paplay/parec
  • gstreamer play audio/video
Peripheral devices
  • Touch Screen
  • USB keyboard/mouse
  • USB stick/SD
Basic linux command such as Zypper install/ debuginfo-install
  • Zypper install/update/debuginfo-install/source-install default repo configuration
  • pkcon install/update

Test Environment

Hardware

  • Crossville/Lapis
    • CRB = Brookville + ICM(Intel® Atom™ CPU E6XX Series + LAPIS ML7213 IOH)
    • BIOS: AMI 4.6.3.7/0ABXJ 0.03
    • Display: 7’’ LVDS
    • Hard drive: SATA SSD 8G
  • Crown Bay
    • Crown Bay CRB = Shell Bay Fab2(Intel® EG20T IOH) + Little Bay REV D(Intel® Atom™ CPU E6XX Series)
    • BIOS: AMI 4.6.3.7, Project 0ABTN 0.20
    • Display = 13’’ LVDS
    • Hard drive: SATA HD 160G
    • wifi card: Intel wifi link 5100

Test Repos

QA Contact

Test Report

Referrences

Retrieved from "http://wiki.meego.com/Quality/1.2.0_IVI_Update_Test_Plan"
Personal tools