Meego Wiki
Views

Quality/TestSuite/MCTS

From MeeGo wiki
< Quality | TestSuite(Difference between revisions)
Jump to: navigation, search
(→MCTS Test Packages Mapping to MeeGo 1.2 Architecture)
(→Overview)
 
(22 intermediate revisions not shown)
Line 2: Line 2:
=== Overview ===
=== Overview ===
 +
* [[../MCTS_Components |MCTS Components]]
* MCTS Development Guideline [[/MCTS_Development_Guideline | MCTS Development Guideline]] <br>
* MCTS Development Guideline [[/MCTS_Development_Guideline | MCTS Development Guideline]] <br>
* Discussion about [[/MCTS_API_analysis | API analysis]] for MCTS functional test design
* Discussion about [[/MCTS_API_analysis | API analysis]] for MCTS functional test design
* Interested in contributing to MCTS ? Look at [[/MCTS_Start_Contributing | How to start contributing]]
* Interested in contributing to MCTS ? Look at [[/MCTS_Start_Contributing | How to start contributing]]
 +
* [[/Run_MCTS | How to run MCTS]]
-
=== Test Suite Code & API Coverage Analysis Repositories ===
+
=== Test Suite Code Repositories ===
-
You can get the code here: http://meego.gitorious.org/meego-quality-assurance/mcts<br>
+
Latest MCTS code is at http://meego.gitorious.org/meego-quality-assurance/mcts and package repo is at http://download.meego.com/live/devel:/quality:/tests/Trunk/<br>
-
You can get the coverage analysis documents here: http://meego.gitorious.org/meego-quality-assurance/mcts-coverage
+
There is also mcts-1.2 branch for MeeGo 1.2 at gitorious.org and the package repo is at http://download.meego.com/live/devel:/quality:/mcts1.2/Meego_1.2.0/
=== MCTS Releases ===
=== MCTS Releases ===
Line 16: Line 18:
You can find information about the completed and planned MCTS releases from [[/MCTS_Releases | MCTS Releases.]]
You can find information about the completed and planned MCTS releases from [[/MCTS_Releases | MCTS Releases.]]
-
=== MCTS Test Packages Mapping to MeeGo 1.2 Architecture ===
+
=== Known Issues ===
-
 
+
{{#bugzilla:
-
{| cellspacing="0" border="1"
+
  |columns=id,priority,status,summary
-
|-
+
  |product=MeeGo Quality Assurance
-
!| '''Domain'''
+
  |component=MeeGo Core Test Suite
-
!| '''Component'''
+
  |group=status
-
!| [http://wiki.meego.com/Quality/Plans/MeeGo_Core_Test_Plan Test Coverage]
+
  |status=NEW,ASSIGNED,NEEDINFO,REOPENED,WAITING FOR UPSTREAM,RESOLVED
-
!| '''Auto&nbsp;%'''
+
  |sort=id
-
!| [http://gitorious.org/qa-tools/mcts MCTS package]
+
  |order=desc
-
!| '''Maintainer'''
+
}}
-
!| '''Target Due'''
+
-
|-
+
-
| rowspan = "6" | Security
+
-
 
+
-
| Accounts || || || mcts-mwts-accounts|| ||
+
-
 
+
-
|-
+
-
| Single Sign-On || || || mcts-mwts-accounts|| ||
+
-
 
+
-
|-
+
-
| Integrity Protection Framework || || || WIP || ||
+
-
 
+
-
|-
+
-
| Certificate Manager || || || WIP || ||
+
-
 
+
-
 
+
-
|-
+
-
| SW Distribution Security || || || WIP || ||
+
-
 
+
-
|-
+
-
| Access Control Framework || || || WIP || ||
+
-
 
+
-
|-
+
-
| rowspan = "4" | System
+
-
 
+
-
| System Control || || || WIP || ||
+
-
 
+
-
|-
+
-
| Resource Policy ||light || ||  || ||
+
-
 
+
-
|-
+
-
| Context Framework || Through || || WIP || ||
+
-
 
+
-
|-
+
-
| Sensor Framework || Average || || mcts-blts-sensor-frontend mcts-blts-sensor-plugins || ||
+
-
 
+
-
|-
+
-
| Location
+
-
| [[../GeoClue Test Plan | Location Framework]] || light ||100% || mcts-geoclue-tests || [mailto:shaofeng.tang@intel.com Shaofeng Tang] ||
+
-
 
+
-
 
+
-
|-
+
-
| rowspan = "5" | PIM
+
-
 
+
-
| Calendar Engine || Average || || mcts-mwts-pim || ||
+
-
 
+
-
|-
+
-
| Contacts Engine || Average || || mcts-mwts-pim || ||
+
-
 
+
-
|-
+
-
| Email Engine || Average || || WIP || ||
+
-
 
+
-
|-
+
-
| Backup Framework || Average || || WIP || ||
+
-
 
+
-
|-
+
-
| Synchronization Framework || Average || || WIP || ||
+
-
 
+
-
|-
+
-
| rowspan = "3" | Multimedia
+
-
 
+
-
| Gstreamer || light || || mcts-mwts-gstreamer mcts-mwts-gcamera || ||
+
-
 
+
-
|-
+
-
| [[../PulseAudio Test Plan | PulseAudio ]]|| light ||100% || mcts-pulseaudio-tests mcts-blts-alsa-core || [mailto:hao.h.chen@intel.com Hao Chen] ||
+
-
|-
+
-
| UPnP || light ||0% || mcts-gupnp-tests || [mailto:daniel.tao@intel.com Daniel Tao] ||
+
-
 
+
-
|-
+
-
| rowspan = "4"| Communications
+
-
| Telephony & IM || light || || mcts-mwts-telepathy || ||
+
-
 
+
-
|-
+
-
| [[/OFono Test Plan |Cellular Framework]] || Through ||36% || mcts-ofono-tests mcts-blts-ofono || [mailto:elva.fu@intel.com Elva Fu]||
+
-
 
+
-
|-
+
-
| [[/ConnMan Test Plan | ConnMan]] || Through ||43% || mcts-connman-tests || [mailto:jeff.zheng@intel.com Jeff Zheng]  ||
+
-
 
+
-
|-
+
-
| [[/MeeGo Bluez Test Plan |Bluetooth]] || Average ||16% || mcts-bluez-tests mcts-blts-bluetooth || [mailto:jingke.zhang@intel.com Jingke] ||
+
-
 
+
-
|-
+
-
| rowspan = "3" | Qt
+
-
| Qt || || || mcts-mwts-network mcts-mwts-telepathy || ||
+
-
 
+
-
|-
+
-
| Qt WebKit || || || N/A || ||
+
-
 
+
-
|-
+
-
| Qt Web Runtime || || || N/A || ||
+
-
 
+
-
|-
+
-
| rowspan = "9" | Qt Mobility
+
-
| QtM contacts || || ||  mcts-mwts-pim|| ||
+
-
 
+
-
|-
+
-
| QtM Location || || || mcts-mwts-location || ||
+
-
 
+
-
|-
+
-
| QtM Messaging || || || mcts-mwts-messaging || ||
+
-
 
+
-
|-
+
-
| QtM Publish & Subscribe || || || WIP || ||
+
-
 
+
-
|-
+
-
| QtM Sensors || || || mcts-mwts-sensors || ||
+
-
 
+
-
|-
+
-
| QtM Service Framework || || || WIP || ||
+
-
 
+
-
|-
+
-
| QtM Versit || || || mcts-mwts-pim|| ||
+
-
 
+
-
|-
+
-
| QtM Multimedia || || || mcts-mwts-multimedia || ||
+
-
 
+
-
|-
+
-
| QtM System Info || || || mcts-mwts-systeminfo|| ||
+
-
 
+
-
|-
+
-
| rowspan = "3" | [[../MeeGo_Graphics_Test_Plan | Graphics]]
+
-
| OpenGL ES || Average ||13% || mcts-qtgfx-tests mcts-blts-openles2-perf mcts-openvg-tests || [mailto:wei.z.zhang@intel.com Wei Z Zhang] ||
+
-
 
+
-
|-
+
-
| Font Management || || || N/A || ||
+
-
 
+
-
|-
+
-
| X11 || Light ||100% || mcts-x-tests mcts-rendercheck-tests mcts-blts-fbdev mcts-display-tests || [mailto:wei.z.zhang@intel.com Wei Z Zhang] ||
+
-
 
+
-
|-
+
-
| Data Management || Content Framework || Through || || mcts-tracker-tests ||  ||
+
-
 
+
-
|-
+
-
| SW Management
+
-
| [[ Package_Manager | Package Management and Update]] || light || || mcts-packagekit-tests || [mailto:huajun.li@intel.com Huajun Li] || .
+
-
 
+
-
|-
+
-
| Kernel
+
-
 
+
-
| Linux Kernel || || || mcts-blts-usb mcts-blts-input-devices mcts-mwts-filesystem mcts-system-tests || ||
+
-
 
+
-
|}
+
-
 
+
-
=== Released Middleware Test Asset Descriptions ===
+
-
[[../MWTS Asset Descriptions | Released Middleware Test Asset Descriptions]]
+
-
 
+
-
=== Developed But Not Released Middleware Test Asset Descriptions ===
+
-
[[../MWTS Not Released Asset Descriptions | Developed Not Released Middleware Test Asset Descriptions]]
+
-
 
+
-
=== Test Suite Status For OS Base===
+
-
{|cellspacing="0" border="1"
+
-
!|Category
+
-
!|Component
+
-
!|Test Coverage
+
-
!|Planned #
+
-
!|Ready #
+
-
!|Auto %
+
-
!|Major Contacts
+
-
!|Due
+
-
 
+
-
|-
+
-
| rowspan = "17" | OS Base|| [[../Audio Driver Test Specification | Audio Driver]] || '''Light''' ||31||31||0% || [mailto:EXT-jussi.saavalainen@nokia.com Jussi Saavalainen]||tbd
+
-
 
+
-
|-
+
-
| [[../Bluetooth Driver Test Specification | Bluetooth Driver]] || '''Light''' || 23 || 23 || 0% ||[mailto:EXT-jussi.saavalainen@nokia.com Jussi Saavalainen]||tbd
+
-
 
+
-
|-
+
-
| [[../Camera Driver Test Specification | Camera Driver]] || '''Light''' || 12 || 12 || 0% ||[mailto:EXT-jussi.saavalainen@nokia.com Jussi Saavalainen]||tbd
+
-
 
+
-
|-
+
-
| [[../Functional Key Driver  Test Plan | Functional Key Driver]] || '''Open''' || tbd || || || || tbd
+
-
 
+
-
|-
+
-
| [[../Framebuffer Test Specification | Framebuffer Driver]] || '''Light''' || 22  || 11 || 0% || [mailto:mika.niinisto@digia.com Mika Niinistö] ||tbd
+
-
 
+
-
|-
+
-
| [[../GPS Driver Test Plan | GPS Driver]] || '''Light''' ||  ||  ||  ||Jussi Saavalainen||tbd
+
-
 
+
-
|-
+
-
| [[../Input Devices Driver Test Specification | Input Devices Driver]] || '''Light''' || 3 || 3 || 0%  ||  ||tbd
+
-
 
+
-
|-
+
-
| [[../oFono Modem API Test Specification | Modem Driver]] || '''Light''' || N/A || N/A || N/A ||  ||tbd
+
-
 
+
-
|-
+
-
| [[../SD-MMC Driver Test Plan | SD/MMC Driver]] || '''Light''' || 33 || 33 || 0% ||Jussi Saavalainen ||Sep.3.2010
+
-
 
+
-
|-
+
-
| [[../Sensor Test Front-end | Sensor Driver]] || '''N/A''' || N/A  || N/A  || N/A || Pasi Matilainen ||tbd
+
-
 
+
-
|-
+
-
| [[../Touch Screen Driver Test Plan | Touch Screen Driver]] || '''Light''' ||  ||  ||  || Juhani Taipale||tbd
+
-
 
+
-
|-
+
-
| [[../Touchpad Driver Test Plan | Touchpad Driver]] || '''Open''' || tbd ||  ||  || ||tbd
+
-
 
+
-
|-
+
-
| [[../USB Driver Test Specification | USB Driver]] || '''Light''' || 35 || 35 || 0% ||[mailto:EXT-jussi.saavalainen@nokia.com Jussi Saavalainen] ||tbd
+
-
 
+
-
|-
+
-
| [[../Video Playback Driver Test Specification | Video Playback Driver]] || '''Average''' || 6 || 6 || 0% ||[mailto:kimmo.myllyvirta@digia.com Kimmo Myllyvirta] ||tbd
+
-
 
+
-
|-
+
-
| [[../Watchdog Driver Test Specification | Watchdog Driver]] || '''Average''' || 3  || 3 || 0% || [mailto:kimmo.myllyvirta@digia.com Kimmo Myllyvirta] ||tbd
+
-
 
+
-
|-
+
-
| [[../WIFI Driver Test Specification | WIFI Driver]] || '''Light''' || 10  || 10 || 0% ||Jussi Saavalainen ||tbd
+
-
 
+
-
|-
+
-
| [[../X11 Test Specification | X11]] || '''Light''' || 11  || 11 || 0% || [mailto:kimmo.myllyvirta@digia.com Kimmo Myllyvirta] ||tbd
+
-
|}
+

Latest revision as of 03:29, 25 May 2011

Contents

MeeGo Core Test Suite (MCTS)

Overview

Test Suite Code Repositories

Latest MCTS code is at http://meego.gitorious.org/meego-quality-assurance/mcts and package repo is at http://download.meego.com/live/devel:/quality:/tests/Trunk/
There is also mcts-1.2 branch for MeeGo 1.2 at gitorious.org and the package repo is at http://download.meego.com/live/devel:/quality:/mcts1.2/Meego_1.2.0/

MCTS Releases

MCTS is released typically in a biweekly cycle. The release process is described in MCTS Release Process.

You can find information about the completed and planned MCTS releases from MCTS Releases.

Known Issues

IDPStatusSummary (32 tasks) ⇒
ASSIGNED
18224LowASSIGNEDblts-usb build problems on Linux 2.6.39
17677HighASSIGNEDWireless Download/upload cases failed in mwts-network
13061MediumASSIGNED[META] [FEA] MCTS Feature request meta bug
12608LowASSIGNED[N900] Accelerometer sensor test crashed.
10839MediumASSIGNED4 blts-wlan-core-tests cases failed
NEEDINFO
21411UndecidedNEEDINFO[MWTS-Gstreamer] No video sink found when run case 'NFT-GstStreaming-Video_AVI_MPEG4_VGA_MP3_HTTP-FPS'
16437HighNEEDINFOQA Mwts - unable to set PIN/PUK in configure file during mwts-ofono test
12848MediumNEEDINFO[FEA] test asset for "QtM Service Framework" is missing
12847MediumNEEDINFO[FEA] test asset for "QtM Publish & Subcribe" is missing
12840MediumNEEDINFO[FEA] test asset for "system control" is missing
12839MediumNEEDINFO[FEA] test asset for "resource policy" is missing
NEW
24337UndecidedNEWblts-wlan-core-tests: "Core-WLAN-Associate with WPA2-PSK AP" failed
18387MediumNEW[mcts-system-tests] memory occupation needs a benchmark
18206MediumNEW[mcts-bluez] SSH root to execute bluez cases meet dbus error
17594HighNEW[mwts-common] MwtsMonitor reports "Invalid socket descriptor" and hangs
17010MediumNEW[mwts-telepathy] The MT call is terminated by N900 immediately (MCTS_0.1.7).
12851MediumNEW[FEA] test asset for "access control framework" is missing
12850MediumNEW[FEA] test asset for "certificate manager" is missing
12849MediumNEW[FEA] test asset for "integrity protection framework" is missing
12845MediumNEW[FEA] test asset for "email engine" is missing
12843MediumNEW[FEA] test asset for "contacts engine" is missing
12841MediumNEW[FEA] test asset for "calendar engine" is missing
12838MediumNEW[FEA] test asset for "context framework (contextkit)" is missing
RESOLVED
24336UndecidedRESOLVEDblts-wlan-core-tests: "Core-WLAN-Associate with WPA2-PSK AP" failed
14241HighRESOLVEDThe mwts-sensors test cases will always fail
11991MediumRESOLVED[mwts-sensors] mwts-sensors always give failure even the sensor work fine
11702MediumRESOLVEDTap sensor doesn't work
11699?MediumRESOLVEDAmbient_light_sensor doesn't works
11651MediumRESOLVED[Mwts–messaging] SMS Messaging send fail
WAITING FOR UPSTREAM
12888MediumWAITING FOR UPSTREAMsystem boot up fail once install mwts-multimedia package
12550HighWAITING FOR UPSTREAM[mwts-pim] "Export to vcard" case failed due to "QContactTrackerEngine::compatibleContact" not implemented yet
12549MediumWAITING FOR UPSTREAM[mwts-pim] "FUTE-PIM-Import_contact_from_vcard" failed but result is PASS
Retrieved from "http://wiki.meego.com/Quality/TestSuite/MCTS"
Personal tools