Quality/Test case template

Revision as of 02:31, 2 August 2010

Test Case Template

Purpose of test case template is to provide sufficient amount of information about test cases for the users. Intention is to keep test case template as simple as possible. Test case template does not contain any information about test execution schedule, intervals how often it will be executed or so. This is defined in test execution management tool(s) what ever they might be. The same template should be used despite the test case concerning UX or Core.

Fields in Test Case Template

Template contains following fields:

• TC Title: (mandatory) <Descriptive title for test case>
• TC ID: (mandatory) <Test case unique identifier>
  • Can consist of characters, numbers or if test case name is unique this can be used as well
• Requirement: (Optional) <Requirement reference>
• Type: (Mandatory) <Type of test case>
  • Values: Certification, Internationalisation, Localisation, System Integration, Variant Testing, 3PO Testing, Services Testing, Functional, Latency, Response time, Frame rate measurement, Technical Benchmark, Benchmark, Memory consumption measurement, Throughput measurement, Load measurement, Power management, Low resource, Recovery, Iterative, Long-lasting, FIT (Feature Interaction Testing),User eXperience testing, Mobility testing, Long Period testing (LPT)
  • Notes: Above values are defined according to Nokia's comments, which align with ISO/IEC 9126-1 Software Quality Model and ISTQB Advanced Level Syllabus.
  • Intel cases can just use Functional, Benchmark(Performance), (Long Period testing) Stress, User Experience testing
• Domain: (Mandatory) <Vertical>
  • Values: Common, Handheld, Netbook, In-Vehicle, Connected TV, Media Phone
• Feature: (Mandatory) <Bugzilla Feature>
• Subfeature: (Optional)
  • Can be used when test case designer wants to identify more detailed level what is tested.
• Component: (Optional) <Bugzilla Component>
• Execution Type: (Mandatory) <Manual, Auto>
• Test Case State: (Mandatory) <Design/Ready/Approved>
• Description: (Mandatory)
  • Purpose (Mandatory): <Test case purpose here. What is tried to achieve with this specific TC>
  • Method (Optional): <Short description of TC method here, e.g., how measurement is done and what the result describes. Could be a link to another document. This field is optional>
  • References (Optional) :<Link to web, wiki or similar place where more detailed information is available (if any) for this TC>
  • Pre/Post-conditions (Optional): <Specific description of things or settings needed prior to this TC run. E.g. memory card in device and audio clip at path /home/user/audioclips>
  • Run instructions (Mandatory): <Run instructions specific for this TC. Describe instructions by steps (n) – refer to PASS / FAIL criteria for this step.>
  • Pass/Fail criteria (Mandatory): <What are the criterion that TC shall fulfil in order to consider TC as passed. For instance, test case returns pass and audio is audible from wired headset. Describe PASS / FAIL criteria for each run step.>
  • Test Environment (Optional): <Link to a document describing manual or automatic test environment. No test cases having dependencies to corporate network or other proprietary SW / HW>
  • Required test data (Optional): <Description of specific test data / parameters for this TC with unambiguous file references>
  • Change history (Optional): <Description of modifications done to this TC, with name of author. Change history of last 5 changes at least>

Example 1, Core Test Case for eMMC

• TC Title: DATAFLOW-FS-Copy-File-eMMC-to-MMC
• TC ID: DATAFLOW-FS-Copy-File-eMMC-to-MMC
• Requirement
• Type: Functional
• Domain: Handheld
• Feature:
• Subfeature: copy
• Component: Kernel
• Execution Type: Auto
• Test Case State: Approved
• Description:
  • Purpose: This case tests file can be copied from eMMC to eMMC
  • Method: Test case copies file from eMMC to eMMC, file block size 1kB, block count 1000
  • References: None
  • Pre/Post-conditions: Test asset and MIN test frame Work is installed to the device. Memory card must be mounted in device. Test must be executed as root.
  • Run instructions: Start 'min' in the shell of the device. Select a case, observe device, and check the test result from min and the log files. Or use command line format 'min -c -t <test case name>'.
  • Pass/Fail criteria: Test case returns passed if operation was succesfull. Result is logged into /var/log/tests/."
  • Test Environment: Handheld device
  • Required test data: None
  • Change history:
    • 11 May 2010. (v.0.1.8) Added steps to test.xml. Tommi Toropainen
    • 21 Apr 2010. (v.0.1.7) Added new steps to OTS execution to get results on Test reporting tools, Removed tmp filesystem tests from OTS. Tommi Toropainen
    • 20 Apr 2010. (v.0.1.6) Changed filesystem partitions in configure file, Added Security file system test case. Tommi Toropainen
    • 15 Mar 2010. (v.0.1.5) Changed mass storage cases to use 1,6GB files. Tommi Toropainen
    • 1 Mar 2010. (0.1.4) added unmounting before formatting (do not format target or source by default) Tommi Toropainen

Example 2, UX Test Case for Browser

• TC Title: Watching flash video via browser by using WLAN
• TC ID: PJ114257
• Requirement
• Type: Functional
• Domain: Handheld
• Feature: Mozilla Fennec Browser
• Subfeature: copy
• Component:
• Execution Type: Manual
• Test Case State: Design
• Description:
  • Purpose: Purpose of this test case is to verify that it is possible to watch flash video via browser by using WLAN.
  • Method: Test case is run manually
  • References: www.youtube.com
  • Pre/Post-conditions: WLAN Access Point is available. Browser application is opened
  • Run instructions:

1) Open webpage where flash videos can be watched (youtube.com).

2) Start watching some flash video on the web page.

3) Stop watching flash video.

4) Close the browser application.

• • Pass/Fail criteria: It is possible to watch flash videos via browser by using WLAN
  • Test Environment: Open WLAN network
  • Required test data: None
  • Change history:
    • 9 Jun 2010. (v.0.1) Test case skeleton created, basic information included. Petri Jylhä