Quality/TestSuite/Video Playback Driver Test Specification

Revision as of 13:20, 8 December 2010

Introduction

The X Window System (commonly X or X11) is a computer software system and network protocol that provides a graphical user interface (GUI). Base X Window System is extended by X Extension libraries (mainly from freedesktop.org and XFree86 projects).

The blts-xvideo test driver (0.0.7) includes functional and performance tests specifically for XVideo extension.

Test Coverage

The test driver currently covers X11 XVideo extension:

• XVideo - Presence check: Simple XVideo extension presence check
• XVideo - Enumerate adapters: List all information from all XVideo adapters
• XVideo - XvPutImage benchmark: Tests XvPutImage performance and functionality. Uses various resolutions, pixel formats and port attributes depending on configuration file.
• XVideo - XvShmPutImage benchmark: Tests XvShmPutImage performance and functionality. Uses various resolutions, pixel formats and port attributes depending on configuration file.
• XVideo - PutImage with QueryBestSize: Functional test for QueryBestImage. Queries best size with different input and output resolutions and tries to display images with the returned size.
• XVideo - Notify events: Functional test for XvPortNotify/XvVideoNotify. Requests events and tries to trigger events from a different process

Software Coverage

Current coverage for tests:

• [XVideo-coverage.ods]

Hardware Coverage

Mainly display devices (and GPU).

Running the tests

Hardware setup and test environment

The test environment must have following packages installed:

• libbltscommon1
• libbltspixelformat1
• libX11
• libXv

Building packages

The xvideo test package comes with a packaging script that can be used to build tarball out of the sources, RPM package or Debian package. To build RPM package, in the root directory execute command:

./pack.sh -r

To get packaging script help, execute command:

./pack.sh -h

The building environment requires the following RPM packages installed:

• libbltscommon-devel
• libbltspixelformat-devel
• libX11-devel
• libXv-devel

Configuration package

The blts-xvideo-tests package is dependent on blts-xvideo-tests-config configuration file package. The packaging script pack.sh creates RPM package blts-xvideo-tests-config-example_{version}.rpm and it must be installed first. The configuration file /etc/blts/blts-xvideo-tests.cnf is copied in the test device during RPM installation.

The configuration file package can be installed in the device by executing the command:

rpm -ivh blts-xvideo-tests-config-example_{version}.rpm

Test asset specific instructions

The test package can be installed in the device by executing the command:

rpm -ivh blts-xvideo-tests_{version}.rpm 

Test case arguments

Arguments:

Test cases must be run with root privileges.

Test cases

Test case execution notices:

Test case descriptions and execution commands:

• XVideo - Presence check

* Simple XVideo extension presence check

* $ blts-xvideo-tests -en "XVideo - Presence check"

• XVideo - Enumerate adapters

* List all information from all XVideo adapters

* $ blts-xvideo-tests -en "XVideo - Enumerate adapters"

• XVideo - XvPutImage benchmark

* Tests XvPutImage performance and functionality.

* Uses various resolutions, pixel formats and port attributes depending on configuration file.

* $ blts-xvideo-tests -en "XVideo - XvPutImage benchmark"

• XVideo - XvShmPutImage benchmark

* Tests XvShmPutImage performance and functionality.

* Uses various resolutions, pixel formats and port attributes depending on configuration file.

* $ blts-xvideo-tests -en "XVideo - XvShmPutImage benchmark"

• XVideo - PutImage with QueryBestSize

* Functional test for QueryBestImage.

* Queries best size with different input and output resolutions and tries to display images with the returned size.

* $ blts-xvideo-tests -en "XVideo - PutImage with QueryBestSize"

• XVideo - Notify events

* Functional test for XvPortNotify/XvVideoNotify. Requests events and tries to trigger events from a different process.

* $ blts-xvideo-tests -en "XVideo - Notify events"

Configuration file examples

Configuration file contains used parameters for benchmarks. To run test case with variable data you need to specify where configuration file is located or if no configuration file is given, test driver tries to use default /etc/blts/blts-xvideo-tests.cnf

To run "X11-XVideo PutImage with QueryBestSize" case you can use: blts-xvideo-tests -l /var/log/tests/X11-XVideo_PutImage_with_QueryBestSize.log -en "X11-XVideo PutImage with QueryBestSize" -C example-blts-xvideo.cnf

######################
# General parameters #
######################

# defines generated video material resolution
[parameter]
   name input_resolution
   const "800x600" "1600x1200"
[end_parameter]

# if output resolution is 0x0, resolution will be root window's size
[parameter]
   name output_resolution
   const "0x0" "1600x1200"
[end_parameter]

# duration of tests
[parameter]
   name duration
   const 5
[end_parameter]

# used X screen(s)
[parameter]
   name screen
   const 0
[end_parameter]

# used XVideo adaptor(s)
[parameter]
   name adaptor
   const 0
[end_parameter]

# Possible choices for test images:
# random: three frames of random pixels
# vh_lines: two frames, horizontal and vertical lines
# checkerboard: two frames, b/w checkerboard
# moving_arrow: white arrow moving from left to right and pointing up
# fps_check: two frames, blocks change between black and white
# colorgradient: red, green and blue gradients
# graygradient: full screen grayscale, from black (left) to right
# colorgradient_scroll: red, green and blue gradients, moves from left to right
# graygradient_scroll: full screen grayscale, moves from left to right
[parameter]
   name test_images
   const "colorgradient_scroll"
[end_parameter]

# used pixel formats (fourcc)
[parameter]
   name format
   const "YUY2" "YV12" "I420" "UYVY"
[end_parameter]

# used port attributes for XVideo adaptor
[parameter]
   name port_attributes
   const "XV_VSYNC 0 XV_BRIGHTNESS 0 XV_CONTRAST 0"
[end_parameter]

# These are for QueryBestSize and Notify events -tests

[parameter]
   name fute_format
   const "YUY2"
[end_parameter]

[parameter]
   name fute_port_attributes
   const "XV_VSYNC 0"
[end_parameter]

Module Design and Architecture

The test module can be compiled to self-sufficient command line program. Both Debian and RPM packaging is also provided.

Architecture diagram

References

Change History