Views
Quality/Test management overview
From MeeGo wiki
(Difference between revisions)
m |
m |
||
| Line 1: | Line 1: | ||
= Test management overview = | = Test management overview = | ||
| - | == Manual and | + | == Manual and semi-automated testing == |
The main phases for manual and semi-automated testing are test planning, execution and reporting. | The main phases for manual and semi-automated testing are test planning, execution and reporting. | ||
| Line 9: | Line 9: | ||
[[File:Test_management_manual_semi.png|800px]] | [[File:Test_management_manual_semi.png|800px]] | ||
| - | '''Test | + | '''Test planning''' |
* [[Quality/QA-tools/Test_plan|Test plans]] are created and edited by using [[Quality/QA-tools/Testplanner|Testplanner]] | * [[Quality/QA-tools/Test_plan|Test plans]] are created and edited by using [[Quality/QA-tools/Testplanner|Testplanner]] | ||
| Line 18: | Line 18: | ||
* The decision on which tests are to be executed is done in weekly test management meetings | * The decision on which tests are to be executed is done in weekly test management meetings | ||
| - | '''Test | + | '''Test execution''' |
* The tests can be executed by several test engineers by using different execution tools | * The tests can be executed by several test engineers by using different execution tools | ||
| Line 25: | Line 25: | ||
* [[Quality/QA-tools/Testrunner|Testrunner]] and [[Quality/QA-tools/Testrunner-lite|testrunner-lite]] are tools that can execute test plan files and produce results in specified [http://meego.gitorious.org/meego-quality-assurance/test-definition/blobs/master/src/data/testdefinition-results.xsd XML format] | * [[Quality/QA-tools/Testrunner|Testrunner]] and [[Quality/QA-tools/Testrunner-lite|testrunner-lite]] are tools that can execute test plan files and produce results in specified [http://meego.gitorious.org/meego-quality-assurance/test-definition/blobs/master/src/data/testdefinition-results.xsd XML format] | ||
| - | '''Test | + | '''Test reporting''' |
* The results can be published at [http://qa-reports.meego.com qa-reports.meego.com] either manually or automatically | * The results can be published at [http://qa-reports.meego.com qa-reports.meego.com] either manually or automatically | ||
* The report shows the results for each test case and for each feature or bug | * The report shows the results for each test case and for each feature or bug | ||
| - | == Automated | + | == Automated testing == |
[[File:Test_management_auto.png]] | [[File:Test_management_auto.png]] | ||
Revision as of 15:24, 4 January 2011
Test management overview
Manual and semi-automated testing
The main phases for manual and semi-automated testing are test planning, execution and reporting.
The figure below illustrates the process. The process is explained in more detail after the figure.
Test planning
- Test plans are created and edited by using Testplanner
- The test cases can be linked to specific bug and feature ID's
- The created test plans are avalaible at Gitorious repositories
- In addition to plain XML format, the test plans can also be viewed in more user-friendly format as presented at testplans.meego.com/
- Since Gitorious is a version control system, the plans can be used and edited by several users
- The decision on which tests are to be executed is done in weekly test management meetings
Test execution
- The tests can be executed by several test engineers by using different execution tools
- Testing can be done manually or by using automated testing environment OTS
- The testing is done by using agreed MeeGo release
- Testrunner and testrunner-lite are tools that can execute test plan files and produce results in specified XML format
Test reporting
- The results can be published at qa-reports.meego.com either manually or automatically
- The report shows the results for each test case and for each feature or bug
Automated testing
The work flow in a nut shell with fully automated testing goes like this
- BOSS creates test automation enabled images from OBS projects (This part is not working yet. Currently OTS uses self made images.)
- OTS downloads the image and installs it to a device under test
- OTS executes tests found in the image
- OTS sends results to qa-reports.meego.com
Source file of the figures: Test_Management_overview.odp