Revision as of 06:26, 7 January 2011

Basic Workflow

Planning and Executing Test Runs

Importing Test Results

In order to import new test results, you will need a user account on the MeeGo QA Reports service.

Filling in Test Details

You can input the test execution date in YYYY-MM-DD format, or click the calendar icon to choose the date from a calendar view.

Test type and hardware can be freely typed in, or you can click on the commonly used options on the right.

Uploading the Result File

If you are using a modern version of Google Chrome or Mozilla Firefox, you can drag and drop one or multiple files on the upload box. You can also click the button titled "Browse" to browse and select files from your local folders.

The QA Reports tool expects the uploaded files to be XML with the structure specified here. There is also legacy support for CSV files with a specific format (see QA Reports CSV Format).

If you upload more than one test result file, they merged into a single test report.

Publishing the Report

Clicking the button labeled "Next" below the upload form takes you to the Finalize-view, which lets you review and edit the report. At this point, the report is not yet visible on the server, and you must click the Finalize button in order to save the report and make it publicly visible.

Deleting a Test Report

If you are logged in, you can delete a test report by viewing it and clicking the Delete button next to the test report title. Deleting a report is irreversible. The report and all changes made to it are permanently removed.

Editing Test Results

Majority of the data comes from the uploaded test result file, and cannot be modified afterwards, but you can make limited adjustments to some of the data and add explanatory text sections.

In order to make any of the following changes, you need to be in edit mode. To enter the editing mode, you must be logged in and viewing a report. You can then click the button labeled "Edit" next to the test report title. The edit mode is also automatically enabled when you are finalizing a newly uploaded report.

Editing the Report Title

In edit mode, you can click the test report title in order to modify it. After making your changes, click the Save-button to commit them or Cancel to restore the original title.

Changing the Test Execution Date

If the report has an incorrect test execution date, listed in the summary box next to the table of contents, you can click it to make it editable. As in the upload form, you can either type a date by hand (in YYYY-MM-DD format) or click the calendar icon to use a visual date picker.

After correcting the date, press Save to commit your change or Cancel to undo.

Adding Attachments

You can add or remove file attachments to a test report from the attachments area under the table of contents. Just click the "Add attachment" button and browse to the local file you want to attach.

If you need to delete an attachment, click the X-icon next to the attachment when in edit mode.

Editing the Text Sections

All the text sections such as Test Objective, Test Environment and Quality Summary can be edited by clicking them. The content uses a slightly modified sub-set of the MediaWiki format for formatting text.

Headers and sub-headers can be added by using lines beginning with == and ===. E.g.

== Some Header ==
=== Some Sub-header ===

You can italicize a section of text by enclosing it in a pair of single quotes or bold it by using three single quotes. Example:

''This is italic''
'''This is bold'''

You can create bulleted lists by starting your lines with an asterisk. Example:

* Item 1
* Item 2
* Item 3

You can link to external pages by using the syntax [[url Title]], for example:

[[http://meego.com MeeGo]]

As a shorthand, you can directly link to the MeeGo bug tracker by entering the bug id, e.g.

[[11780]]

The title and current status of the bug will be automatically fetched and updated to the test report.

Changing Individul Test Results

You can change the test result (pass/fail/na) of an individual test case by clicking on the result and selecting a new one from the drop down. Any change you make is committed immediately to the server.

Editing Test Case Notes

You can edit the notes of an individual test case by clicking the note field of that test case (i.e. the rightmost column in the table). The note field supports the same formatting options as all the regular text fields, with one difference: bugzilla links do not render the full bug title, but only the bug id. The title can been seen by hovering the mouse cursor over the bug id.

Emailing and Printing Test Results

When viewing a test report, you can click the Print-button to access a simplified layout that is optimized for priting and emailing.

Additional Features

Comparing Main and Test Branches

When uploading a new test report, the report can be marked as belonging to the testing branch, by postfixing the test type field with the special marker: :testing. This enables you to view a comparison between a test type such as "Sanity" and its test branch "Sanity:testing". If the comparison view is available, a "compare"-link will appear on the front page next to the test type title.