Meego Wiki
Views

Quality/QA-tools/Testrunner

From MeeGo wiki
< Quality | QA-tools(Difference between revisions)
Jump to: navigation, search
(Testrunner UI)
(Testrunner: IRC channel changed)
 
(23 intermediate revisions not shown)
Line 1: Line 1:
-
= Testrunner UI =
+
= Testrunner =
-
[[File:Testrunner-ui-1.png|right|400px]]
+
[[File:Testrunner-ui-1.png|right|415px]]
-
Testrunner UI is a simple graphical user interface for [[Quality/QA-tools/Testrunner-lite | testrunner-lite]]. It can be used for running automatic, semi-automatic and manual test cases. It takes a [[Quality/QA-tools/Test plan | test plan file]] as input, runs the selected test cases and produces results in [http://gitorious.org/qa-tools/test-definition/blobs/master/src/data/testdefinition-results.xsd defined xml format]. Testrunner UI can also be used together with [[Quality/QA-tools/Testplanner | Testplanner]] which provides a graphical UI for creating and editing the test plan files.
+
Testrunner is a simple graphical user interface for [[Quality/QA-tools/Testrunner-lite|testrunner-lite]] and is used in test execution as presented [[Quality/Test management overview|here]]. With Testrunner, you can easily:
 +
* Run automatic, semi-automatic and manual test cases
 +
* Follow the results in real time
 +
* Run only the needed test cases
 +
* Change the execution order of test cases
 +
* Open the active file in [[Quality/QA-tools/Testplanner|Testplanner]] for editing
-
Testrunner UI is developed by [[Quality/QA-tools | QA tools team]]. You can contact us and contribute via the following channels:
+
Testrunner takes a [[Quality/QA-tools/Test plan | test plan file]] as input, runs the selected test cases and produces results in [http://meego.gitorious.org/meego-quality-assurance/test-definition/blobs/master/src/data/testdefinition-results.xsd format] that can be published at [http://qa-reports.meego.com qa-reports.meego.com].
 +
 
 +
Testrunner is developed by [[Quality/QA-tools | QA tools team]]. You can contact us and contribute via the following channels:
 +
* [http://webchat.freenode.net/?channels=meego-qa #meego-qa IRC channel on irc.freenode.net]
 +
* [http://bugs.meego.com/enter_bug.cgi?product=MeeGo%20Quality%20Assurance File new bugs or improvement ideas to Bugzilla]
 +
* [http://bugs.meego.com/buglist.cgi?bug_status=NEW&bug_status=NEEDINFO&bug_status=INDEFINITION&bug_status=ASSIGNED&bug_status=ACCEPTED&bug_status=WAITING%20FOR%20UPSTREAM&bug_status=WAITING&bug_status=REOPENED&bug_status=RESOLVED&bug_status=RELEASED&bug_status=VERIFIED&component=Testrunner&query_format=advanced&order=priority%2Cbug_severity%2Cchangeddate%2Cbug_status%2Cassigned_to%2Cbug_id&query_based_on= Leave a comment or vote the items in our backlog]
* [http://lists.meego.com/listinfo/meego-qa meego-qa@lists.meego.com mailing list]
* [http://lists.meego.com/listinfo/meego-qa meego-qa@lists.meego.com mailing list]
-
* [http://webchat.freenode.net/?channels=meego-qa-tools #meego-qa-tools IRC channel on irc.freenode.net]
+
* [http://meego.gitorious.org/meego-quality-assurance/testrunner Source codes in Gitorious]
-
* [http://bugs.meego.com/enter_bug.cgi?product=Development%20Tools File new bugs or improvement ideas to Bugzilla]
+
-
* [http://bugs.meego.com/buglist.cgi?query_format=advanced&order=Importance&bug_status=NEW&bug_status=NEEDINFO&bug_status=ASSIGNED&bug_status=WAITING%20FOR%20UPSTREAM&bug_status=REOPENED&bug_status=RESOLVED&component=testrunner%20UI&classification=MeeGo%20Platform&product=Development%20Tools Leave a comment or vote the items in our backlog]
+
-
* [http://gitorious.org/qa-tools/testrunner-ui Source codes in Gitorious]
+
In addition, you can check our demo videos at Youtube:
In addition, you can check our demo videos at Youtube:
 +
* [http://www.youtube.com/watch?v=6xUAYEfgwbI Demo of version 0.3.12]
 +
* [http://www.youtube.com/watch?v=nileVzw52xM Demo of version 0.2.5]
* [http://www.youtube.com/user/meegoqatools MeeGo QA tools Youtube channel]
* [http://www.youtube.com/user/meegoqatools MeeGo QA tools Youtube channel]
== Installation ==
== Installation ==
 +
Testrunner can be installed on MeeGo Netbook UX, Ubuntu 10.04 (and newer) and Fedora 13 by doing the following:
 +
# [[Quality/QA-tools/How to set up repositories|Set up the repository]]
 +
# Install Testrunner
 +
 +
MeeGo Netbook 1.1:
 +
 +
sudo zypper install testrunner-ui
 +
 +
Ubuntu:
 +
 +
sudo apt-get install testrunner-ui
 +
 +
Fedora 13:
 +
 +
# yum install testrunner-ui
== Basic Usage ==
== Basic Usage ==
Line 22: Line 46:
The basic workflow goes as follows:
The basic workflow goes as follows:
-
# Open a test definition.
+
# Open a test plan.
# Select the test cases for execution. By default, all cases are selected.
# Select the test cases for execution. By default, all cases are selected.
# Drag and drop test suites, sets, and cases to change the execution order.
# Drag and drop test suites, sets, and cases to change the execution order.
# Optionally enter results for manual cases and steps prior to test execution.
# Optionally enter results for manual cases and steps prior to test execution.
-
# Run selected or all tests and see execution progress online.
+
# Run selected or all tests and see execution progress in real time.
## When prompted, enter results and comments for manual cases and steps.
## When prompted, enter results and comments for manual cases and steps.
# After execution, view execution results in detail.
# After execution, view execution results in detail.
## See testrunner-lite output in a log view.
## See testrunner-lite output in a log view.
-
## See test case and step results and stdout/stderr output in a case detail view
+
## See test case and step results and stdout/stderr output in a case detail view.
-
## Modify comments of manual cases
+
## Modify comments of manual and semi-automatic cases.
# Save the results.
# Save the results.
-
 
-
== Support and Links ==
 
-
 
-
There is a video, which demonstrates the basic functionality of an early version (v0.1), see [http://www.youtube.com/watch?v=-MBOiVb-2Z4 YouTube], and another video, which shows new features in version 0.2.5, see [http://www.youtube.com/watch?v=nileVzw52xM YouTube].
 
-
 
-
Upcoming features can be tracked in [http://bugs.meego.com/buglist.cgi?classification=MeeGo%20Platform&query_format=advanced&bug_status=NEW&bug_status=NEEDINFO&bug_status=ASSIGNED&bug_status=WAITING%20FOR%20UPSTREAM&bug_status=REOPENED&component=testrunner%20UI&product=Development%20Tools MeeGo Bugzilla].
 

Latest revision as of 07:58, 24 March 2011

Testrunner

Testrunner-ui-1.png

Testrunner is a simple graphical user interface for testrunner-lite and is used in test execution as presented here. With Testrunner, you can easily:

  • Run automatic, semi-automatic and manual test cases
  • Follow the results in real time
  • Run only the needed test cases
  • Change the execution order of test cases
  • Open the active file in Testplanner for editing

Testrunner takes a test plan file as input, runs the selected test cases and produces results in format that can be published at qa-reports.meego.com.

Testrunner is developed by QA tools team. You can contact us and contribute via the following channels:

In addition, you can check our demo videos at Youtube:

Installation

Testrunner can be installed on MeeGo Netbook UX, Ubuntu 10.04 (and newer) and Fedora 13 by doing the following:

  1. Set up the repository
  2. Install Testrunner

MeeGo Netbook 1.1:

sudo zypper install testrunner-ui

Ubuntu:

sudo apt-get install testrunner-ui

Fedora 13:

# yum install testrunner-ui

Basic Usage

The basic workflow goes as follows:

  1. Open a test plan.
  2. Select the test cases for execution. By default, all cases are selected.
  3. Drag and drop test suites, sets, and cases to change the execution order.
  4. Optionally enter results for manual cases and steps prior to test execution.
  5. Run selected or all tests and see execution progress in real time.
    1. When prompted, enter results and comments for manual cases and steps.
  6. After execution, view execution results in detail.
    1. See testrunner-lite output in a log view.
    2. See test case and step results and stdout/stderr output in a case detail view.
    3. Modify comments of manual and semi-automatic cases.
  7. Save the results.
Personal tools