Test Objective
It’s a weekly testing cycle for weekly released images released by distribution team to ensure MeeGo core middlewares provides stable HW and usage model independent application services and APIs for building the vertical specific user experience. Focus is to sanity test Meego OS middleware.
Sanity tests, this report, and bug reporting are in ramp up phase so expect future reports to be more comprehensive and detailed.
Build Location : N900: http://repo.meego.com/MeeGo/builds/trunk/1.0.80.16.20100820.1/core/images/meego-core-armv7l-n900/
Test Environment : Hardware: N900
Test Coverage : Test types: Sanity test
Test Result :
| Total TCs | Passed | Failed | Not testable (Blocked) | Run Rate | Pass rate of total | Pass rate of executed |
| 31 | 13 | 16 | 2 | 94% | 42% | 45% |
Quality Summary
Highlights:
Lowlights:
Coverage data not yet available for sanity tests
| Components | Test coverage | Run rate | Pass rate | Risk level | Pain level | Overall status |
| API core | 0 % | 0 % | 0 % | High | High | Intolerable
|
| Bluetooth | 0 % | 0 % | 0 % | High | High | Intolerable |
| Connman | 0 % | 0 % | 0 % | High | High | Intolerable |
| Content Framework | 0 % | 0 % | 0 % | High | High | Intolerable |
| Filesystem | 0 % | 0 % | 0 % | High | High | Intolerable |
| Media | 0 % | 0 % | 0 % | High | High | Intolerable |
| oFono | 0 % | 0 % | 0 % | High | High | Intolerable |
| OpenGL ES | 0 % | 0 % | 0 % | High | High | Intolerable |
| USB | 0 % | 0 % | 0 % | High | High | Intolerable |
| WLAN | 0 % | 0 % | 0 % | High | High | Intolerable |
| X11 | 0 % | 0 % | 0 % | High | High | Intolerable |
| Category | Check points | Result | Notes (bugs) |
|---|---|---|---|
| Bluetooth | Basic Lookup | Fail | |
| Power off and on | Fail | ||
| Change scan mode | Fail | ||
| Scan | Not run | ||
| Authentication and pairing as slave | Not run | ||
| ConnMan | Basic WLAN lookup | Fail | |
| Connect unsecured WLAN | Fail | ||
| Found 3G device | Fail | ||
| Found BT device | Fail | ||
| Found ethernet device | Fail | ||
| Offline mode works | Pass | ||
| EnabledTechnologies property in Manager Interface is valid | Pass | ||
| Changing EnabledTechnologies property triggers signal | Fail | ||
| Found WLAN device | Pass | ||
| Content Framework | Insertion | Pass | Tracker missing:5818 |
| Concurrent query | Pass | Tracker missing:5818 | |
| Filesystem | Write data to TMP | Pass | |
| Read data from TMP | Pass | ||
| Write data to eMMC | Pass | ||
| Read data from eMMC | Pass | ||
| Gstreamer | Local audio Playback MP3 | Fail | Gstreamer missing:5820 |
| Local video playback MPEG4 VGA AVI | Fail | Gstreamer missing:5820 | |
| Imageviewer | Open and show 1MB JPG image | Fail | |
| Ofono | Create voicecall | Fail | |
| Send SMS | Fail | ||
| OpenGL ES2 | Blit with blend and animated widgets with shadows | Fail | |
| Simple triangle | Fail | ||
| USB | Receive 5MB file | Pass | |
| Send 5MB file | Pass | ||
| X11 | Create simple window | Pass | |
| Xrender draw rectangle | Pass |
Issue Summary
Key Issues:
Open high bugs for handset shown here
New issues:
5818 - Tracker missing
5820 - Gstreamer missing
Verified fixed issues:
Reopened issues: N/A
Conclusions and Recommendations From QA