Test Objective
It’s a weekly testing cycle for weekly released images released by distribution team to ensure MeeGo core middlewares provides stable HW and usage model independent application services and APIs for building the vertical specific user experience. Focus is to sanity test Meego OS middleware.
Sanity tests, this report, and bug reporting are in ramp up phase so expect future reports to be more comprehensive and detailed.
Build Location : N900: http://repo.meego.com/MeeGo/builds/trunk/1.0.80.16.20100820.1/core/images/meego-core-armv7l-n900/
Test Environment : Hardware: N900
Test Coverage : Test types: Sanity test
Test Result :
| Total TCs | Passed | Failed | Not testable (Blocked) | Run Rate | Pass rate of total | Pass rate of executed |
| 31 | 13 | 16 | 2 | 94% | 42% | 45% |
Quality Summary
Highlights:
Lowlights:
Coverage data not yet available for sanity tests
| Components | Test coverage | Run rate | Pass rate | Risk level | Pain level | Overall status |
| API core | 0 % | 0 % | 0 % | High | High | Intolerable
|
| Bluetooth | 0 % | 0 % | 0 % | High | High | Intolerable |
| Connman | 0 % | 0 % | 0 % | High | High | Intolerable |
| Content Framework | 0 % | 0 % | 0 % | High | High | Intolerable |
| Filesystem | 0 % | 0 % | 0 % | High | High | Intolerable |
| Media | 0 % | 0 % | 0 % | High | High | Intolerable |
| oFono | 0 % | 0 % | 0 % | High | High | Intolerable |
| OpenGL ES | 0 % | 0 % | 0 % | High | High | Intolerable |
| USB | 0 % | 0 % | 0 % | High | High | Intolerable |
| WLAN | 0 % | 0 % | 0 % | High | High | Intolerable |
| X11 | 0 % | 0 % | 0 % | High | High | Intolerable |
| Category | Check points | Result | Notes (bugs) |
|---|---|---|---|
| Bluetooth | Basic Lookup | Pass | |
| Power off and on | Pass | ||
| Change scan mode | Pass | ||
| Scan | Not run | ||
| Authentication and pairing as slave | Not run | ||
| ConnMan | Basic WLAN lookup | Pass | |
| Connect to unsecured WLAN | Pass | ||
| Found 3G device | Pass | ||
| Found BT device | Pass | ||
| Found ethernet device | Fail | ||
| Offline mode works | Pass | ||
| EnabledTechnologies property in Manager Interface is valid | Pass | ||
| Changing EnabledTechnologies property triggers signal | Pass | ||
| Found WLAN device | Pass | ||
| Content Framework | Insertion | Pass | |
| Concurrent-query | Pass | ||
| Filesystem | Write data to TMP | Pass | |
| Read data from TMP | Pass | ||
| Write data to eMMC | Not run | ||
| Read data from eMMC | Not run | ||
| Gstreamer | Local audio Playback MP3 | Fail | |
| Local video playback MPEG4 VGA AVI | Fail | ||
| Imageviewer | Show 1MB JPG image | Fail | |
| Ofono | Create voicecall | Pass | phonesim |
| Send SMS | Pass | phonesim | |
| OpenGL ES2 | Blit with blend and animated widgets with shadows | Fail | |
| Simple triangle | Fail | ||
| USB | Receive 5MB file | Pass | |
| Send 5MB file | Pass | ||
| X11 | Create simple window | Pass | |
| Xrender draw rectangle | Pass |
| Category | Component | Bugzilla component | [[../../TestPlan/MeeGo_Core_Test_Plan#Test_Coverage_Definition |Test Coverage]] | Planned # | Ready # | In Git # | Auto % | Test Asset Maintainer | QA Contacts | LE for availability in GIT |
|---|---|---|---|---|---|---|---|---|---|---|
| Comms Services | Telephony (oFono) | Telephony | Thorough | ~1000 | 385 | 112 | 29% | Elva Fu | tbd | |
| Telephony (oFono Modem API) | Modem Support | Thorough | 36 | 36 | 36 | tbd | Jussi Saavalainen | Elva Fu | Sep.10 2010
| |
| Connection Management (ConnMan) | Connection Manager | Thorough | 367 | 171 | 93 | 46% | Jeff Zheng | Aug.30 2010 | ||
| Bluetooth (BlueZ) | Bluetooth | Average | 60 | 54 | 6 | 16% | Jingke | Aug.30 2010 | ||
| VOIP, IM and Pres (Telepathy) | VoIP and IM | Light | 20 | 8 | 0 | Markku Valtonen | Lauri Pöyhönen | Sep.10.2010 | ||
| Internet Services | Layout Engine (WebKit) | Internet layout engine | Not Covered | |||||||
| Web RunTime (WebKit) | Web run time | Open | ||||||||
| Web Services (libsocialweb) | Web Services | Thorough | 50-56 | 20 | 50% | Jenny Cao | Aug.30 2010 | |||
| Location (GeoClue) | Location | Light | 30 | 26 | 26 | 100% | Qin Mu | Aug.30 2010 | ||
| Visual Services | 3D Graphics (OpenGL/GLES) | Graphics Subsystem | Average | 1075 | 1075 | 1067 | 100% | Kui Zheng | Aug.30 2010 | |
| 2D Graphics (QPainter) | Graphics Subsystem | Not Covered | ||||||||
| GTK/Clutter | Clutter | Light | 43 | 43 | 0% | Kui Zheng | Aug.30 2010 | |||
| X | Light | 33 | 33 | 6 | 100% | Kui Zheng | Aug.30 2010 | |||
| Media Services | Media Framework (GStreamer) | Media Subsystem | Light | 260 | 260 | 100% | Markku Valtonen | Juhani Taipale | Sep.10.2010 | |
| Camera (Gstreamer plug-in) | Media Subsystem | Light | 17 | 17 | 100% | Markku Valtonen | Juhani Taipale | Sep.10.2010 | ||
| Codecs (Gstreamer plug-in) | Media Subsystem | Light | Covered via Media Framework TC's | Markku Valtonen | Juhani Taipale | |||||
| Audio (PulseAudio) | PulseAudio | Light | 53 | 13 | 13 | 25% | Shuang Wan | tbd | ||
| GUPnP | Media Subsystem | Light | 14 | 0 | 0% | Daniel Tao | Sept. 6 2010 | |||
| Data Management | Content Framework (Tracker) | Content Framework | Thorough | 30 | 17 | tbd | Juhani Taipale | Juhani Taipale | ||
| Context Framework (ContextKit) | Context Framework (ContextKit) | Thorough | 15 | 5 | tbd | Juhani Taipale | Juhani Taipale | tbd | ||
| Package Manager (PackageKit) | Package Manager | Not Covered | ||||||||
| Device Services | Device Health (DSME) | Thorough | tbd | Markku Valtonen | Juhani Taipale | tbd | ||||
| Sensor Framework | Sensor Framework | Average | 25 | 5 | tbd | Markku Valtonen | Mark Halmagiu | tbd | ||
| Resource Manager (System Policy Manager) | Average | 50 | 0 | tbd | Markku Valtonen | Juhani Taipale | tbd | |||
| Backup & Restore | Backup & Restore | Open | ||||||||
| Personal Services | PIM services | PIM services | Average | 23 | 0 | tbd | Markku Valtonen | Juhani Taipale | tbd | |
| Device Sync (Buteo) | Device Sync | Thorough | WIP | Markku Valtonen | Lauri Pöyhönen | tbd | ||||
| Accts & SSO | Open | tbd | Markku Valtonen | Juhani Taipale | tbd |
Issue Summary
Key Issues:
Open high bugs for handset shown here
New issues:
5818 - Tracker missing
5820 - Gstreamer missing
Verified fixed issues:
Reopened issues: N/A
Conclusions and Recommendations From QA