Meego Wiki
Views

Quality/QA-tools/Testrunner

From MeeGo wiki
< Quality | QA-tools(Difference between revisions)
Jump to: navigation, search
(Testrunner: IRC channel changed)
 
(26 intermediate revisions not shown)
Line 1: Line 1:
-
Testrunner UI is a simple graphical user interface to [[Quality/QA-tools/Testrunner-lite | testrunner-lite]].  
+
= Testrunner =
 +
 
 +
[[File:Testrunner-ui-1.png|right|415px]]
 +
 
 +
Testrunner is a simple graphical user interface for [[Quality/QA-tools/Testrunner-lite|testrunner-lite]] and is used in test execution as presented [[Quality/Test management overview|here]]. With Testrunner, you can easily:
 +
* Run automatic, semi-automatic and manual test cases
 +
* Follow the results in real time
 +
* Run only the needed test cases
 +
* Change the execution order of test cases
 +
* Open the active file in [[Quality/QA-tools/Testplanner|Testplanner]] for editing
 +
 
 +
Testrunner takes a [[Quality/QA-tools/Test plan | test plan file]] as input, runs the selected test cases and produces results in [http://meego.gitorious.org/meego-quality-assurance/test-definition/blobs/master/src/data/testdefinition-results.xsd format] that can be published at [http://qa-reports.meego.com qa-reports.meego.com].
 +
 
 +
Testrunner is developed by [[Quality/QA-tools | QA tools team]]. You can contact us and contribute via the following channels:
 +
* [http://webchat.freenode.net/?channels=meego-qa #meego-qa IRC channel on irc.freenode.net]
 +
* [http://bugs.meego.com/enter_bug.cgi?product=MeeGo%20Quality%20Assurance File new bugs or improvement ideas to Bugzilla]
 +
* [http://bugs.meego.com/buglist.cgi?bug_status=NEW&bug_status=NEEDINFO&bug_status=INDEFINITION&bug_status=ASSIGNED&bug_status=ACCEPTED&bug_status=WAITING%20FOR%20UPSTREAM&bug_status=WAITING&bug_status=REOPENED&bug_status=RESOLVED&bug_status=RELEASED&bug_status=VERIFIED&component=Testrunner&query_format=advanced&order=priority%2Cbug_severity%2Cchangeddate%2Cbug_status%2Cassigned_to%2Cbug_id&query_based_on= Leave a comment or vote the items in our backlog]
 +
* [http://lists.meego.com/listinfo/meego-qa meego-qa@lists.meego.com mailing list]
 +
* [http://meego.gitorious.org/meego-quality-assurance/testrunner Source codes in Gitorious]
 +
 
 +
In addition, you can check our demo videos at Youtube:
 +
* [http://www.youtube.com/watch?v=6xUAYEfgwbI Demo of version 0.3.12]
 +
* [http://www.youtube.com/watch?v=nileVzw52xM Demo of version 0.2.5]
 +
* [http://www.youtube.com/user/meegoqatools MeeGo QA tools Youtube channel]
 +
 
 +
== Installation ==
 +
 
 +
Testrunner can be installed on MeeGo Netbook UX, Ubuntu 10.04 (and newer) and Fedora 13 by doing the following:
 +
# [[Quality/QA-tools/How to set up repositories|Set up the repository]]
 +
# Install Testrunner
 +
 
 +
MeeGo Netbook 1.1:
 +
 
 +
sudo zypper install testrunner-ui
 +
 
 +
Ubuntu:
 +
 
 +
sudo apt-get install testrunner-ui
 +
 
 +
Fedora 13:
 +
 
 +
# yum install testrunner-ui
 +
 
 +
== Basic Usage ==
The basic workflow goes as follows:
The basic workflow goes as follows:
-
# Open a test definition.
+
# Open a test plan.
# Select the test cases for execution. By default, all cases are selected.
# Select the test cases for execution. By default, all cases are selected.
# Drag and drop test suites, sets, and cases to change the execution order.
# Drag and drop test suites, sets, and cases to change the execution order.
# Optionally enter results for manual cases and steps prior to test execution.
# Optionally enter results for manual cases and steps prior to test execution.
-
# Run selected or all tests and see execution progress online.
+
# Run selected or all tests and see execution progress in real time.
## When prompted, enter results and comments for manual cases and steps.
## When prompted, enter results and comments for manual cases and steps.
# After execution, view execution results in detail.
# After execution, view execution results in detail.
## See testrunner-lite output in a log view.
## See testrunner-lite output in a log view.
-
## See test case and step results and stdout/stderr output in a case detail view
+
## See test case and step results and stdout/stderr output in a case detail view.
-
## Modify comments of manual cases
+
## Modify comments of manual and semi-automatic cases.
# Save the results.
# Save the results.
-
 
-
There is a video, which demonstrates the basic functionality of an early version (v0.1), see [http://www.youtube.com/watch?v=-MBOiVb-2Z4 YouTube].
 
-
 
-
Upcoming features can be tracked in [http://bugs.meego.com/buglist.cgi?classification=MeeGo%20Platform&query_format=advanced&bug_status=NEW&bug_status=NEEDINFO&bug_status=ASSIGNED&bug_status=WAITING%20FOR%20UPSTREAM&bug_status=REOPENED&component=testrunner%20UI&product=Development%20Tools MeeGo Bugzilla].
 

Latest revision as of 07:58, 24 March 2011

Testrunner

Testrunner-ui-1.png

Testrunner is a simple graphical user interface for testrunner-lite and is used in test execution as presented here. With Testrunner, you can easily:

  • Run automatic, semi-automatic and manual test cases
  • Follow the results in real time
  • Run only the needed test cases
  • Change the execution order of test cases
  • Open the active file in Testplanner for editing

Testrunner takes a test plan file as input, runs the selected test cases and produces results in format that can be published at qa-reports.meego.com.

Testrunner is developed by QA tools team. You can contact us and contribute via the following channels:

In addition, you can check our demo videos at Youtube:

Installation

Testrunner can be installed on MeeGo Netbook UX, Ubuntu 10.04 (and newer) and Fedora 13 by doing the following:

  1. Set up the repository
  2. Install Testrunner

MeeGo Netbook 1.1:

sudo zypper install testrunner-ui

Ubuntu:

sudo apt-get install testrunner-ui

Fedora 13:

# yum install testrunner-ui

Basic Usage

The basic workflow goes as follows:

  1. Open a test plan.
  2. Select the test cases for execution. By default, all cases are selected.
  3. Drag and drop test suites, sets, and cases to change the execution order.
  4. Optionally enter results for manual cases and steps prior to test execution.
  5. Run selected or all tests and see execution progress in real time.
    1. When prompted, enter results and comments for manual cases and steps.
  6. After execution, view execution results in detail.
    1. See testrunner-lite output in a log view.
    2. See test case and step results and stdout/stderr output in a case detail view.
    3. Modify comments of manual and semi-automatic cases.
  7. Save the results.
Personal tools