Meego Wiki
Views

Quality/daily build test

From MeeGo wiki
< Quality(Difference between revisions)
Jump to: navigation, search
(→Core sanity test check point)
 
(5 intermediate revisions not shown)
Line 1: Line 1:
== Dataflow definition ==
== Dataflow definition ==
Sanity testing for Daily build release process is to achieve the “stable daily trunk build” goal on all applicable MeeGo platforms. Daily build validation (both core and UX) is to provide comparable results for TT (Trunk:Testing) and Trunk. With that, release engineer can compare and see that changes introduced to TT are not breaking something which we have working in Trunk.
Sanity testing for Daily build release process is to achieve the “stable daily trunk build” goal on all applicable MeeGo platforms. Daily build validation (both core and UX) is to provide comparable results for TT (Trunk:Testing) and Trunk. With that, release engineer can compare and see that changes introduced to TT are not breaking something which we have working in Trunk.
-
[[File:C:\Documents and Settings\xzhan99\My Documents\My Pictures\Picture1.png]]
+
{|border="2" cellspacing="0" cellpadding="4" width="70%"
-
== Use case vs. Dataflow vs. Verification ==
+
|&nbsp;
 +
|&nbsp;
 +
|&nbsp;
 +
|'''Trunk::testing'''
 +
|'''Trunk'''
-
== Illustrative example of the Dataflow diagram ==
+
|-
 +
|bgcolor = "#333333"|<font color="#FFFFFF">'''Domain'''</font>
 +
|bgcolor = "#333333"|<font color="#FFFFFF">'''Component'''</font>
 +
|bgcolor = "#333333"|<font color="#FFFFFF">'''Checkpoints'''</font>
 +
|'''Netbook'''
 +
|'''Netbook'''
 +
 
 +
|-
 +
|rowspan = "6"|System
 +
|rowspan = "2"|Startup
 +
|system bootup and shutdown
 +
|bgcolor = "#008000"|<font color="#000000">pass</font>
 +
|bgcolor = "#008000"|<font color="#000000">pass</font>
 +
 
 +
|-
 +
|no obvious regression on boot time
 +
|bgcolor = "#008000"|<font color="#000000">pass</font>
 +
|bgcolor = "#008000"|<font color="#000000">pass</font>
 +
 
 +
|-
 +
|Sensorfw
 +
|Accelerometer
 +
|n/a
 +
|n/a
 +
 
 +
|-
 +
|rowspan = "3"|Overall
 +
|no process eats unusual CPU
 +
|bgcolor = "#008000"|<font color="#000000">pass</font>
 +
|bgcolor = "#008000"|<font color="#000000">pass</font>
 +
 
 +
|-
 +
|no process eats unusual memory
 +
|bgcolor = "#008000"|<font color="#000000">pass</font>
 +
|bgcolor = "#008000"|<font color="#000000">pass</font>
 +
 
 +
|-
 +
|usb storage can be recognized
 +
|bgcolor = "#008000"|<font color="#000000">pass</font>
 +
|bgcolor = "#008000"|<font color="#000000">pass</font>
 +
 
 +
|-
 +
|rowspan = "10"|Communication
 +
|Bluetooth
 +
|Bluetooth Scan
 +
|n/a(19659)
 +
|bgcolor = "#008000"|<font color="#000000">pass</font>
 +
 
 +
|-
 +
|rowspan = "3"|connman
 +
|3G data connection
 +
|n/a
 +
|n/a
 +
 
 +
|-
 +
|Ethernet nework
 +
|n/a(19659)
 +
|bgcolor = "#008000"|<font color="#000000">pass</font>
 +
 
 +
|-
 +
|Guest WiFi nework
 +
|n/a(19659)
 +
|bgcolor = "#008000"|<font color="#000000">pass</font>
 +
 
 +
|-
 +
|rowspan = "4"|oFono
 +
|accept an incoming call
 +
|n/a
 +
|n/a
 +
 
 +
|-
 +
|make a call successfully
 +
|n/a
 +
|n/a
 +
 
 +
|-
 +
|Receive sms
 +
|n/a
 +
|n/a
 +
 
 +
|-
 +
|Send sms
 +
|n/a
 +
|n/a
 +
 
 +
|-
 +
|rowspan = "2"|Telepathy (IM)
 +
|Send gtalk IM
 +
|n/a(19659)
 +
|bgcolor = "#008000"|<font color="#000000">pass</font>
 +
 
 +
|-
 +
|Receive gtalk IM
 +
|n/a(19659)
 +
|bgcolor = "#008000"|<font color="#000000">pass</font>
 +
 
 +
|}
 +
 
 +
== Core sanity test check point ==
 +
Core sanity test check points is to check the key functionality of the core components. Make sure the new changes won’t introduce the regression on general health of the distribution (through comparable result between TT and Trunk).
 +
{|border="2" cellspacing="0" cellpadding="4" width="45%"
 +
|rowspan = "3"|System
 +
|Startup
 +
 
 +
|-
 +
|rowspan = "1"|Sensorfw
 +
 
 +
|-
 +
|rowspan = "1"|Overall
 +
 
 +
|-
 +
|rowspan = "4"|Communication
 +
|Bluetooth
 +
 
 +
|-
 +
|connman
 +
 
 +
|-
 +
|oFono
 +
 
 +
|-
 +
|Telepathy (IM)
 +
 
 +
|-
 +
|rowspan = "3"|Graphics
 +
|OpenGL ES2
 +
 
 +
|-
 +
|X
 +
 
 +
|-
 +
|Input
 +
 
 +
|-
 +
|QT
 +
|QT paint
 +
 
 +
|-
 +
|rowspan = "4"|Multimedia
 +
|ALSA
 +
 
 +
|-
 +
|rowspan = "1"|V4L2
 +
 
 +
|-
 +
|rowspan = "1"|PulseAudio
 +
 
 +
|-
 +
|Gstreamer
 +
 
 +
|-
 +
|rowspan = "2"|PIM
 +
|PIM Service
 +
 
 +
|-
 +
|Sync
 +
 
 +
|-
 +
|Data Management
 +
|Tracker
 +
 
 +
|-
 +
|SW management
 +
|Package Management
 +
 
 +
|}

Latest revision as of 03:34, 29 June 2011

Dataflow definition

Sanity testing for Daily build release process is to achieve the “stable daily trunk build” goal on all applicable MeeGo platforms. Daily build validation (both core and UX) is to provide comparable results for TT (Trunk:Testing) and Trunk. With that, release engineer can compare and see that changes introduced to TT are not breaking something which we have working in Trunk.

      Trunk::testing Trunk
Domain Component Checkpoints Netbook Netbook
System Startup system bootup and shutdown pass pass
no obvious regression on boot time pass pass
Sensorfw Accelerometer n/a n/a
Overall no process eats unusual CPU pass pass
no process eats unusual memory pass pass
usb storage can be recognized pass pass
Communication Bluetooth Bluetooth Scan n/a(19659) pass
connman 3G data connection n/a n/a
Ethernet nework n/a(19659) pass
Guest WiFi nework n/a(19659) pass
oFono accept an incoming call n/a n/a
make a call successfully n/a n/a
Receive sms n/a n/a
Send sms n/a n/a
Telepathy (IM) Send gtalk IM n/a(19659) pass
Receive gtalk IM n/a(19659) pass

Core sanity test check point

Core sanity test check points is to check the key functionality of the core components. Make sure the new changes won’t introduce the regression on general health of the distribution (through comparable result between TT and Trunk).

System Startup
Sensorfw
Overall
Communication Bluetooth
connman
oFono
Telepathy (IM)
Graphics OpenGL ES2
X
Input
QT QT paint
Multimedia ALSA
V4L2
PulseAudio
Gstreamer
PIM PIM Service
Sync
Data Management Tracker
SW management Package Management
Retrieved from "http://wiki.meego.com/Quality/daily_build_test"
Personal tools