Meego Wiki
Views

Quality/Meetings/QA leads update 1.2

From MeeGo wiki
(Difference between revisions)
Jump to: navigation, search
(Netbook Update)
(IVI Update)
Line 160: Line 160:
=== IVI Update ===
=== IVI Update ===
-
Jul 12th, 2011
+
Jul 19th, 2011
-
* 1.2.0 Update 1 is postponed one week due to rpm version issue on 1.2.0 update branch. Now it is fixed.
+
* The first update of 1.2.0 has been released on Jul 15th. IVI got 15 bugs fixed, with the whole system performs much better than 1.2.0. Major changes are: emgd-bin, automotive kernel and meego-ux-ivi. See all bug fixing status @ http://wiki.meego.com/Quality/IVI_1.2_Update. Two normal regressions are found. QA conducted full function tests on all three target platforms and archived test report @ http://qa-reports.meego.com/1.2/Ivi/Functional/Crossville-OKI/3121.  
-
* New testing repo is ready at http://repo.meego.com/MeeGo/builds/1.2.0/1.2.0.0.5.20110709.1/
+
* Kick off validation against 1.3 since this week. Image is not available, tracked in bug 21289
-
* QA has finished sanity test on all three target platforms. No New issue is found so far. Now fullfunction test on CrossvillvilleOKI is being conducted. Seems everything goes smoothly and ready to release.
+
-
* IVI got 16 bug fixed in this update.
+
* '''Top/Hot issues'''
* '''Top/Hot issues'''
{{#bugzilla:
{{#bugzilla:
   |columns=id,priority,status,resolution,summary
   |columns=id,priority,status,resolution,summary
-
   |version=1.2.0
+
   |version=1.3
-
   |group=component
+
   |severity=critical,major
   |resolution=FIXED
   |resolution=FIXED
   |cc=ivi-bugs@meego.com
   |cc=ivi-bugs@meego.com

Revision as of 03:28, 19 July 2011

Contents

Core Update

12.07.2011

  • Link to latest daily testing results: http://qa-reports.meego.com/1.2/Core/Acceptance/
  • For Ecs S10Ot3, the latest run rate is 85%, pass rate of total is 82%, pass rate of executed is 97%.
    • improvement:
    • Text mode installation is successful in T:T image, fixed bug 20468
    • USB client can work [BMC 18688]
    • Key Issues:
    • 20648 - [REG][1.2]0629 oarktrail kernel doesn't support btrfs subvolrootid
    • System: gfx installer is supposed to be removed[BMC 19249].
    • Pulseaudio: no bluez source created after connecting BT stereo headset (with mic)[BMC 19111].
    • Failed to play audio with bluetooth headset(HSP)[BMC 19247].
    • Cannot record audio with bluetooth headset(HSP)[BMC 19375].
    • VoIP:The GTalk video call connection can't be set up [BMC 18827].
    • [ECS S10OT3] Geoclue fails to locate the position. [BMC 20886]
    • 17932 - Call Trace Found:possible recursive locking detected

5.07.2011

  • Link to latest daily testing results: http://qa-reports.meego.com/1.2/Core/Acceptance/
  • For Ecs S10Ot3, the latest run rate is 78%, pass rate of total is 73%, pass rate of executed is 93%.
    • improvement:
    • Camera works normally, fixed bug 19646
    • Key Issues:
    • 20648 - [REG][1.2:Testing]0629 oarktrail kernel doesn't support btrfs subvolrootid
    • 17932 - Call Trace Found:possible recursive locking detected
    • 18815 - show_acceleration test hangs there

28.06.2011

  • Link to latest daily testing results: http://qa-reports.meego.com/1.2/Core/Acceptance/
  • For Ecs S10Ot3, the latest run rate is 78%, pass rate of total is 73%, pass rate of executed is 93%.
    • improvement:
    • System default volume is normal, fixed bug 19274
    • Recorded video playback successfully, fixed bug 19279
    • No noise sounds heard when playing, fixed bug 17852
    • Key Issues:
    • 17932 - Call Trace Found:possible recursive locking detected
    • 18815 - show_acceleration test hangs there

21.06.2011

  • Link to latest daily testing results: http://qa-reports.meego.com/1.2/Core/Acceptance/
  • For Ecs S10Ot3, the latest run rate is 87%, pass rate of total is 63%, pass rate of executed is 72%.
    • Key Issues:
    • 15948 - Fail to run ut_qtcontacts_trackerplugin
    • 17852 - noisy sound heard with music when playing
    • 17932 - Call Trace Found:possible recursive locking detected
    • System is default to mute on ECS S10OT3(19274)
    • Recorded video playback failed(19279)
    • show_acceleration test hangs there(18815)

7.06.2011

  • Link to latest daily testing results: http://qa-reports.meego.com/1.2/Core/Acceptance/
  • For Ecs S10ot3, the latest run rate is 87%, pass rate of total is 65%, pass rate of executed is 75%.
    • Key Issues:
    • 15948 - Fail to run ut_qtcontacts_trackerplugin
    • 17852 - noisy sound heard with music when playing
    • 17932 - Call Trace Found:possible recursive locking detected
  • QA conduct 1.3 daily validation on Netbook, the latest run rate is 78%, pass rate of total is 65%, pass rate of executed is 84%.
    • Key Issues:
    • 17838 - [Trunk:Testing][REG] No help information print out when execute powertop -h o powertop --help
    • 13537 - A black screen displayed when running OpenGL-Blit case
    • 17835 - [Trunk:Testing][REG]Fail to run ut_qtcontacts_trackerplugin
    • 18161 - [Trunk:Testing]Fail to scan WIFI AP list on Networks panel

31.05.2011

  • Link to latest daily testing results: http://qa-reports.meego.com/1.2/Core/Acceptance/
  • QA kicked off 1.3 daily validation on Netbook, the latest run rate is 78%, pass rate of total is 65%, pass rate of executed is 84%.
  • MeeGo 1.2.80 image can be installed and live boot, bug(17737) has been fixed
    • Key Issues:
    • 17838 - [Trunk:Testing][REG] No help information print out when execute powertop -h o powertop --help
    • 13537 - A black screen displayed when running OpenGL-Blit case
    • 17835 - [Trunk:Testing][REG]Fail to run ut_qtcontacts_trackerplugin

10.05.2011

Latest Acceptance iCDK:RR 95% PR:75; Netbook:RR:78% PR:68;IVI testing blocked by #17001

  • Some regression issues were found in this week.
    • 17001 - [IVI][REG] missing meego-ux-ivi packages in ivi images(fixed in T:T)
    • 17065 - [REG]Error initializing garage client services library
    • 17248 - [IVI][REG][1.2:Testing] tear screen showed when unlocked the screen

27.06.2011

  • CE testing(DE is nowadays CE as community edition):
  • Biggest issues
    • Package manager broken (architecture issues).
    • Sensor test broken
    • bluetooth has problems
    • mobility messaging doesn't work
  • CE summer release fix build will be expected wk26.

Handset Update

27.06.2011

  • Meego 1.3 testing discontinued from wk24 onwards.
  • Minimum support to 1.2.1. Mainly acceptance and sanity.
  • Latest results: http://qa-reports.meego.com/1.2/Handset
  • CE Status:
    • Dataflow results for summer release: http://qa-reports.meego.com/1.2/Handset/Dataflow/N900ce/3011
    • RR 100%, PR 85%
    • Key issues:
      • 19815- [CE]Call UI is not launched while making outgoing call from Device (NEW)
      • 17751- [CE] Unable to make conference call (ASSIGNED)
      • 18298- [CE] Battery indicator doesn't show battery state accurately. (FIXED)
      • 16458- [CE] Settings application crashes at wallpaper first launch. (REOPENED)
      • 19492- [CE] Cannot turn bluetooth off after enabling it. (REOPENED)
      • 16834- [CE] Settings crash when rotating Wallpaper (ASSIGNED)
    • Fix release expected during wk26.

Tablet Update

2011.07.19

  • Weekly
    • QA complete key feature testing for Oaktrail platform and sanity testing for Pinetrail (ExoPC) platform
    • Oaktrail:
      • Pass rate is 68%;
      • Improvement
        • meego-ux-panels: Tap wizard buttons on panels works fine.( BMC# 20643)
        • Browser: could choose files when sending gmail
        • Photo: could delete photos in photo app.
        • Settings-Sync: Google/Yahoo can sync completed.( BMC#20747)
        • IM: able to select status' radio button while update status (BMC#20577)
      • Lowlight
        • Email: Email welcome screen is blank in EMAIL app(BMC#20642), this blocked all email testcase.
        • Settings-General: system responds slowly(about 10 sec) after tapping on "Time and date" (BMC#20761)
        • Settings-Time and date: Sometimes miss the back button. (BMC#20829)
        • VKB: Sometimes VKB unable to automatically dismiss.( BMC#20835)
        • Gesture no response or not smoothly sometimes.
    • Pinetrail (ExoPC):
      • Pass rate is 66%;
      • Improvement
        • Basic function of most key Apps work stably ,especially it works when launch Web browser /video player /music/photo from panels screen,but Min-SD card and BT device on Pinetrail platform doesn’t work;
      • Lowlight
        • Bug 19848 - Web panel: clear history button fail to work on web panel
        • Bug 20064 - when the flash include link , browser can't display flash plugin
        • Bug 17595 - [REG] No Bluetooth firmware on EXOPC
        • Bug 9244 - Battery driver reporting incorrect/incomplete information
        • Bug 19251 - Micro SD card not getting detected after hot plug (third time onwards)

Netbook Update

2011.07.19

  • MeeGo 1.0 SW Update: No update available in this week;
  • MeeGo 1.1 SW Update: 1.1 SW update release 6 is released in July 14th. QA completed 2 round of sanity testing and 1 round of system functional testing. System functional test pass rate is 94.83%, whole quality of update system is improved (94.02% -> 94.83%) compared with update release 5. QA verified 7 bugs and no regression issue found.
  • MeeGo 1.2.0 SW Update: MeeGo Netbook 1.2.0 update release 1 is released in July 15th. QA totally completed 2 rounds of sanity testing and 1 round of system functional testing. System functional test pass rate is 90.04%, whole quality of update system is improved (86.78% -> 90.04%) compared with 1.2.0 final image. QA verified 39 bugs and 1 new regression issue (#21049) found.
  • MeeGo 1.3:
    • Daily testing: in 0715 image, UX sanity pass rate is 85%, Core sanity pass rate is 70%;
    • Key issue:
      • Error initializing garage client services library (Bug 17830)
      • The UI of Set Time & Date is missing(Bug 18397)
      • [REG]Battery icon is missing on toolbar(Bug 19246)
      • Flash plug-in is missed(Bug 17834)
      • [REG]Device panel is missing on toolbar(Bug 19198)
      • [REG]time&datae is missing on toolbar(Bug 21106)
      • [REG]Bluetooth panel is missing on toolbar(Bug 21107)
      • Unable to mount USB disk automatically(Bug 21108)

IVI Update

Jul 19th, 2011

  • The first update of 1.2.0 has been released on Jul 15th. IVI got 15 bugs fixed, with the whole system performs much better than 1.2.0. Major changes are: emgd-bin, automotive kernel and meego-ux-ivi. See all bug fixing status @ http://wiki.meego.com/Quality/IVI_1.2_Update. Two normal regressions are found. QA conducted full function tests on all three target platforms and archived test report @ http://qa-reports.meego.com/1.2/Ivi/Functional/Crossville-OKI/3121.
  • Kick off validation against 1.3 since this week. Image is not available, tracked in bug 21289
  • Top/Hot issues

BugzillaReports : Error running the sql : SELECT DISTINCT bugs.bug_id as id, alias, ccprofiles.realname as cc, quickflag.flagdate as flagdate, priority, resolution, bug_severity as severity, bug_status as status, short_desc as summary, version FROM `meego_bugzilla`.bugs INNER JOIN (SELECT bug_id,login_name,realname from `meego_bugzilla`.cc INNER JOIN `meego_bugzilla`.profiles ON cc.who=profiles.userid and profiles.login_name='ivi-bugs@meego.com') as ccprofiles on ccprofiles.bug_id=bugs.bug_id LEFT JOIN (SELECT bug_id as quickflagbugid, MAX(creation_date) as flagdate from `meego_bugzilla`.flags where status='?' group by quickflagbugid) as quickflag on quickflag.quickflagbugid=bugs.bug_id where 1=1 and ccprofiles.login_name='ivi-bugs@meego.com' and resolution='FIXED' and (bug_severity='critical' OR bug_severity='major') and bug_status<>'CLOSED' and version='1.3' order by components.name,priority,bugs.bug_id ASC; Unknown column 'components.name' in 'order clause'

SDK Update

05.06.2011

IA-target: These are the activities we were involved last week:

  • Bug verification
  • Finished the MeeGo API testing harness
  • Tried TestKit on Fedora 14 - there are still a few glitches with the tool on which we are working
  • VMM test cases for Mac and Windows OS were finished and sent for internal review

10.05.2011

ARM -target:

  • Test results for SDK : http://qa-reports.meego.com/1.2/SDK
  • Latest results from week 18 using armv7hl handset sysroot [1.1.99.6.20110503.6] and N900DE image.
    • 17201 - libcloog package is missing
    • 12853 - libattica is not installed with QtCreator
    • 13171 - Qt-creator OBS plugin gives network error
    • 14910 - Application launch on device is success but screen is distorded

QA-tools Update

2011.06.13

2011.06.07

  • testrunner-lite 1.7.0 released (closes 11 bugs)
  • corelysis (the core processing backend) packaged and available from Tools:Testing
  • package manager for the n900 DE released

2011.05.30

  • OTS version 0.8.5 released
  • corelysis open sourced
    • Core dump processing component
  • Core processing plugin for OTS
    • Included in OTS 0.8.5 release
  • Min test framework version 2011w20 released
  • test-definition version 1.3.2 released
  • Development focusing on improving test automation tool chain (OTS, testrunner-lite, etc.) and enabling automated core dump processing with OTS test runs.
Personal tools