Meego Wiki
Views

Quality/TestSuite/MCTS

From MeeGo wiki
(Difference between revisions)
Jump to: navigation, search
(Undo revision 23529 by Jerry (Talk))
(Test Suite Status For Middleware (New))
Line 72: Line 72:
|-
|-
-
| rowspan = "5" | System
+
| rowspan = "4" | System
| System Control || || || || WIP || ||
| System Control || || || || WIP || ||
Line 78: Line 78:
|-
|-
| Resource Policy || Average || || || WIP || ||
| Resource Policy || Average || || || WIP || ||
-
 
-
|-
 
-
| Startup Services || || || || WIP || ||
 
|-
|-

Revision as of 06:08, 8 December 2010

Contents

MeeGo Core Test Suite (MCTS)

Overview

INTRODUCTION
SOURCE CODE AND COMPILING
TEST ENVIRONMENT
EXECUTING TESTS
TEST RESULTS
KNOWN ISSUES

MCTS Development Guideline MCTS Development Guideline

Discussion about API analysis for MCTS functional test design

Interested in contributing to MCTS ? Look at How to start contributing

Test Suite Readme

[oFono ]
[ConnMan ]
[BlueZ ]
[GeoClue ]
[3D Graphics ]
[Clutter ]
[X ]
[PulseAudio ]
[GUPnP ]

Test Package README Template

Test Suite Code & API Coverage Analysis Repositories

You can get the code here: http://gitorious.org/qa-tools/mcts
You can get the coverage analysis documents here: http://gitorious.org/qa-tools/mcts-coverage

MCTS Releases

MCTS is released typically in a biweekly cycle. The release process is described in MCTS Release Process.

You can find information about the completed and planned MCTS releases from MCTS Releases.

Test Suite Status For Middleware (New)

Domain Component Test Coverage % Ready Auto % MCTS package Maintainer Target Due
Security Accounts WIP
Single Sign-On WIP
Integrity Protection Framework WIP
Certificate Manager WIP


SW Distribution Security WIP
Access Control Framework WIP
System System Control WIP
Resource Policy Average WIP
Context Framework Through WIP
Sensor Framework Average mcts-blts-sensor-frontend mcts-blts-sensor-plugins
Location Location Framework light mcts-geoclue-tests Shaofeng Tang


PIM Calendar Engine Average WIP
Contacts Engine Average WIP
Email Engine Average WIP
Backup Framework Average WIP
Synchronization Framework Average WIP
Multimedia Gstreamer light mcts-mwts-gstreamer mcts-mwts-gcamera
PulseAudio light mcts-pulseaudio-tests mcts-blts-alsa-core Hao Chen
UPnP light mcts-gupnp-tests Daniel Tao
Communications Telephony & IM light mcts-mwts-telepathy
Cellular Framework Through mcts-ofono-tests mcts-blts-ofono Elva Fu
ConnMan Through mcts-connman-tests Jeff Zheng
Bluetooth Average mcts-bluez-tests mcts-blts-bluetooth Jingke
Qt Qt mcts-mwts-network mcts-mwts-telepathy
Qt WebKit N/A
Qt Web Runtime N/A
Qt Mobility QtM contacts WIP
QtM Location mcts-mwts-location
QtM Messaging mcts-mwts-messaging
QtM Publish & Subscribe WIP
QtM Sensors mcts-mwts-sensors
QtM Service Framework WIP
QtM Versit WIP
QtM Multimedia mcts-mwts-multimedia
QtM System Info WIP
Graphics OpenGL ES Average mcts-qtgfx-tests mcts-blts-openles2-perf Kui Zheng
Font Management N/A
X11 Light mcts-x-tests mcts-rendercheck-tests mcts-blts-fbdev Kui Zheng
Data Management Content Framework Through mcts-tracker-tests
SW Management Package Manager light mcts-packagekit-tests Huajun Li
Kernel Linux Kernel mcts-blts-usb mcts-blts-input-devices mcts-mwts-filesystem

Test Suite Status For Middleware (Obsolete)

Category Component Bugzilla component Test Coverage Planned # Ready # In Git # Auto % Test Asset Maintainer QA CCed Availability in GIT
Comms Services Telephony (oFono) Telephony Thorough ~100011211229% Elva Fu tbd
Telephony (oFono Modem API) Modem Support Thorough 363636tbd Jussi Saavalainen Elva Fu http://gitorious.org/qa-tools/mcts/trees/master/mcts-blts/blts-ofono


Connection Management (ConnMan) Connection Manager Thorough 39239239244% Jeff Zheng Aug.30 2010
Bluetooth (BlueZ) Bluetooth Average 60606016% Jingke Aug.30 2010
VOIP, IM and Pres (Telepathy) VoIP and IM Light 22 8 0 Markku Valtonen Lauri Pöyhönen Xiaolei Zhang Sep.10.2010
Internet Services Layout Engine (WebKit) Internet layout engine Not Covered Huajun Li
Web RunTime (WebKit) Web run time Open Huajun Li
Web Services (libsocialweb) Web Services Thorough 55 55 55 45% Shaofeng Tang Sept.20 2010
Location (GeoClue) Location Light 3026 26100% Shaofeng Tang Aug.30 2010
Visual Services 3D Graphics (OpenGL/GLES) Graphics Subsystem Average 106710671067100% Kui Zheng Aug.30 2010
OpenGL/GLES Performance Jussi Saavalainen http://gitorious.org/qa-tools/mcts/trees/master/mcts-blts/blts-opengles2-perf
2D Graphics (QPainter) Graphics Subsystem Not Covered Kui Zheng
GTK/Clutter Clutter Light 4343 43 0% Kui Zheng Aug.30 2010
X (x/rendercheck) Light 191919100% Kui Zheng Aug.30 2010
X11 Jussi Saavalainen http://gitorious.org/qa-tools/mcts/trees/master/mcts-blts/blts-x11
Media Services Media Framework (GStreamer) Media Subsystem Light 260 260 100% Markku Valtonen Juhani Taipale Shuang Wan Sep.10.2010
Camera (Gstreamer plug-in) Media Subsystem Light 17 17 100% Markku Valtonen Juhani Taipale Shuang Wan Sep.10.2010
Codecs (Gstreamer plug-in) Media Subsystem Light Covered via Media Framework TC's Markku Valtonen Juhani Taipale Shuang Wan
Audio (PulseAudio) PulseAudio Light 13 13 13 100% Hao Chen Sep.10.2010
GUPnP Media Subsystem Light 25 25 25 0% Daniel Tao Sept. 6 2010
Data Management Content Framework (Tracker) Content Framework Thorough 30 17 tbd Juhani Taipale Juhani Taipale Jingke Zhang
Context Framework (ContextKit) Context Framework (ContextKit) Thorough 15 5 tbd Juhani Taipale Juhani Taipale Yi Fu tbd
Package Manager (PackageKit) Package Manager Light 10 10 10 0% Huajun Li Sept. 22, 2010
Device Services Device Health (DSME) Thorough tbd Markku Valtonen Juhani Taipale Yi Fu tbd
Sensor Framework Sensor Framework Average 16 0 0% Markku Valtonen Mark Halmagiu Yi Fu tbd
Resource Manager (System Policy Manager) Average 50 0 tbd Markku Valtonen Juhani Taipale Xialei Zhang tbd
Backup & Restore Backup & Restore Open
Personal Services PIM services PIM services Average 23 0 tbd Markku Valtonen Juhani Taipale Jingke Zhang tbd
Device Sync (Buteo) Device Sync Thorough WIP Markku Valtonen Lauri Pöyhönen Jingke Zhang tbd
Accts & SSO Open tbd Markku Valtonen Juhani Taipale Yi Fu tbd

Released Middleware Test Asset Descriptions

Released Middleware Test Asset Descriptions

Test Suite Status For OS Base

Category Component Test Coverage Planned # Ready # Auto % Major Contacts Due
OS Base Audio Driver Light 31310% Jussi Saavalainentbd
Bluetooth Driver Light 23 23 0% Jussi Saavalainentbd
Camera Driver Light 12 12 0% Jussi Saavalainentbd
Functional Key Driver Open tbd tbd
GPS Driver Light Jussi Saavalainentbd
SD/MMC Driver Light 33 33 0% Jussi Saavalainen Sep.3.2010
Sensor Driver Light 8 8 0% Jussi Saavalainen tbd
Touch Screen Driver Light Juhani Taipaletbd
Touchpad Driver Open tbd tbd
USB Driver Light 35 35 0% Jussi Saavalainen tbd
Video Playback Driver Avarage 6 6 0% Kimmo Myllyvirta tbd
WIFI Driver Light 10 10 0% Jussi Saavalainen tbd
Personal tools