Meego Wiki
Views

Quality/HandsetQualityMetrics

From MeeGo wiki
(Difference between revisions)
Jump to: navigation, search
(Handset UX Quality Metrics)
(MeeGo 1.2 - Handset UX Quality Metrics)
Line 10: Line 10:
=== MeeGo 1.2 - Handset UX Quality Metrics ===
=== MeeGo 1.2 - Handset UX Quality Metrics ===
-
* Feature Progress Trends
+
* '''Feature / Status'''
-
** TBA
+
** This graph (Figure 1. Feature / Status) shows the current status of the Meego Handset 1.2 features
 +
** Numbers are presented in the Table 1.
-
* Bug Report Trends
+
''Figure 1. Feature / Status:''<br>
-
** TBA
+
[[File:feature_status.jpg]]<br>
-
* Weekly Reported Bugs Trends
+
''Table 1. Feature / Status in numbers''<br>
-
** TBA
+
{| border="1"
 +
!
 +
! Wk 43
 +
|-
 +
|NEW
 +
|3
 +
|-
 +
|INDEFINITION
 +
|30
 +
|-
 +
|ACCEPTED
 +
|141
 +
|-
 +
|WAITING
 +
|1
 +
|-
 +
|REOPENED
 +
|3
 +
|-
 +
|RESOLVED
 +
|4
 +
|-
 +
|RELEASED
 +
|58
 +
|-
 +
|VERIFIED
 +
|0
 +
|-
 +
|CLOSED
 +
|0
 +
|-
 +
|TOTAL
 +
|243
 +
|}
-
* Weekly Overall RR / PR Progress
+
* '''Bugs / status'''
-
** TBA
+
** This graph (Figure 2. Bugs / Status) shows the current status of the 1.2 related bugs
 +
** Numbers are presented in the Table 2.
 +
 
 +
''Figure 2. Bugs / Status:''<br>
 +
[[File:bugs_status_.jpg]]<br>
 +
 
 +
''Table 2. Bugs / Status in numbers''<br>
 +
{| border="1"
 +
!
 +
! Wk 43
 +
|-
 +
|NEW
 +
|296
 +
|-
 +
|NEEDINFO
 +
|19
 +
|-
 +
|INDEFINITION
 +
|3
 +
|-
 +
|ASSIGNED
 +
|128
 +
|-
 +
|WAITING FOR UPSTREAM
 +
|38
 +
|-
 +
|REOPENED
 +
|59
 +
|0
 +
|RESOLVED
 +
|53
 +
|0
 +
|RELEASED
 +
|52
 +
|0
 +
|VERIFIED
 +
|224
 +
|0
 +
|CLOSED
 +
|2
 +
|-
 +
|TOTAL
 +
|874
 +
|}
 +
 
 +
* '''Total Bugs / Architecture'''
 +
** This graph (Figure 3. Bugs / Architecture) shows the 1.2 related bugs / Architecture
 +
** Table 3. shows the change to the previous week
 +
 
 +
''(Figure 3. Bugs / Architecture:''<br>
 +
[[File:bugs_architecture.jpg]]<br>
 +
 
 +
''Table 3. Bugs / Architecture: Change to previous week''<br>
 +
 
 +
{| border="1"
 +
!
 +
! Wk 43
 +
! +/-
 +
|-
 +
|IA
 +
|257
 +
|+ 4,9
 +
|-
 +
|ARM
 +
|142
 +
|+ 9,2
 +
|-
 +
|ALL
 +
|188
 +
|+ 32,4
 +
|-
 +
|Not Defined
 +
|287
 +
|+ 3,6
 +
|-
 +
|TOTAL
 +
|874
 +
|+ 10,1
 +
|}
 +
 
 +
* '''New bugs / week'''
 +
** This graph (Figure 4. New bugs / week) shows how many 1.2 related bugs / architecture are reported / week
 +
** Table 4. shows the change to the previous week
 +
 
 +
''(Figure 4. New bugs / week:''<br>
 +
[[File:new_bugs.jpg]]<br>
 +
 
 +
''Table 4. New bugs / week: Change to previous week''<br>
 +
{| border="1"
 +
!
 +
! Wk 43
 +
! +/-
 +
|-
 +
|IA
 +
|20
 +
|+ 42,9
 +
|-
 +
|ARM
 +
|27
 +
|+ 68,8
 +
|-
 +
|ALL
 +
|20
 +
|- 39,4
 +
|-
 +
|Not Defined
 +
|11
 +
|- 63,3
 +
|-
 +
|TOTAL
 +
|78
 +
|- 16,1
 +
|}
 +
 
 +
* '''Weekly Overall RR / PR Progress'''
 +
** N900 Acceptance test results
 +
** N900 Sanity test results
 +
** N900 weekly test results
 +
*** Run Rate
 +
*** Pass Rate of Executed
 +
*** Pass Rate
 +
 
 +
''(Figure 5. Acceptance Test results:''<br>
 +
[[File:test_results_a.jpg]]<br>
 +
 
 +
''(Figure 5. sanity Test results:''<br>
 +
[[File:test_results_a.jpg]]<br>
 +
 
 +
''(Figure 5. Weekly Test results:''<br>
 +
[[File:test_results_a.jpg]]<br>

Revision as of 08:05, 5 November 2010

Handset UX Quality Metrics

List of quality metrics Handset UX QA will start to provide for weekly manner are

  • Feature progress trend (released, verified…)
  • Bug report trends
  • Weekly reported bugs for IA/ARM/ALL architectures
  • Weekly overall RR/PR progress (over whole test asset as combined one)

All feedback related to these quality metrics are appreciated.

MeeGo 1.2 - Handset UX Quality Metrics

  • Feature / Status
    • This graph (Figure 1. Feature / Status) shows the current status of the Meego Handset 1.2 features
    • Numbers are presented in the Table 1.

Figure 1. Feature / Status:
Feature status.jpg

Table 1. Feature / Status in numbers

Wk 43
NEW 3
INDEFINITION 30
ACCEPTED 141
WAITING 1
REOPENED 3
RESOLVED 4
RELEASED 58
VERIFIED 0
CLOSED 0
TOTAL 243
  • Bugs / status
    • This graph (Figure 2. Bugs / Status) shows the current status of the 1.2 related bugs
    • Numbers are presented in the Table 2.

Figure 2. Bugs / Status:
Bugs status .jpg

Table 2. Bugs / Status in numbers

Wk 43
NEW 296
NEEDINFO 19
INDEFINITION 3
ASSIGNED 128
WAITING FOR UPSTREAM 38
REOPENED 59 0 RESOLVED 53 0 RELEASED 52 0 VERIFIED 224 0 CLOSED 2
TOTAL 874
  • Total Bugs / Architecture
    • This graph (Figure 3. Bugs / Architecture) shows the 1.2 related bugs / Architecture
    • Table 3. shows the change to the previous week

(Figure 3. Bugs / Architecture:
Bugs architecture.jpg

Table 3. Bugs / Architecture: Change to previous week

Wk 43 +/-
IA 257
4,9
ARM 142
9,2
ALL 188
32,4
Not Defined 287
3,6
TOTAL 874
10,1
  • New bugs / week
    • This graph (Figure 4. New bugs / week) shows how many 1.2 related bugs / architecture are reported / week
    • Table 4. shows the change to the previous week

(Figure 4. New bugs / week:
New bugs.jpg

Table 4. New bugs / week: Change to previous week

Wk 43 +/-
IA 20
42,9
ARM 27
68,8
ALL 20
Not Defined 11
TOTAL 78
  • Weekly Overall RR / PR Progress
    • N900 Acceptance test results
    • N900 Sanity test results
    • N900 weekly test results
      • Run Rate
      • Pass Rate of Executed
      • Pass Rate

(Figure 5. Acceptance Test results:
Test results a.jpg

(Figure 5. sanity Test results:
Test results a.jpg

(Figure 5. Weekly Test results:
Test results a.jpg

Personal tools