Meego Wiki
Views

Quality/TestSuite/MCTS/MCTS Releases

From MeeGo wiki
< Quality | TestSuite | MCTS(Difference between revisions)
Jump to: navigation, search
(MCTS Release 1.3.2/1.2.20)
(MCTS Release 1.3.6/1.2.22)
 
(15 intermediate revisions not shown)
Line 1: Line 1:
== MCTS Releases==
== MCTS Releases==
 +
=== MCTS Release 1.3.6/1.2.22 ===
 +
 +
Target date: Aug. 4th, 2011<br>
 +
Status:      '''Complete'''
 +
 +
Planned content:<br>
 +
1.3.6
 +
{|cellspacing="0" border="1"
 +
!|Component
 +
!|Changes
 +
|-
 +
|| mwts-* || Update tests.xml test types according to common schema. Fixes: BMC#17877 - Test types update in MCTS
 +
|-
 +
|| blts-* || Update tests.xml test types according to common schema. Fixes: BMC#17877 - Test types update in MCTS
 +
|-
 +
|| mwts-common || Prevent unconnected socket use in monitor (bugfix)
 +
|-
 +
||mcts-ofono-tests|| Fix BMC#17877
 +
|-
 +
||mcts-connman-tests|| A small fix for wireless cases
 +
|-
 +
|}
 +
 +
1.2.22
 +
{|cellspacing="0" border="1"
 +
!|Component
 +
!|Changes
 +
|-
 +
|| mwts-common || Prevent unconnected socket use in monitor (bugfix)
 +
|-
 +
|}
 +
 +
=== MCTS Release 1.3.5 ===
 +
 +
Target date: July 21th, 2011<br>
 +
Status:      '''complete'''
 +
 +
Planned content:<br>
 +
1.3.4
 +
{|cellspacing="0" border="1"
 +
!|Component
 +
!|Changes
 +
|-
 +
||mcts-|| update test type according to new test-definion, update some test cases
 +
|-
 +
|}
 +
 +
=== MCTS Release 1.3.4 ===
 +
 +
Target date: July 7th, 2011<br>
 +
Status:      '''Complete'''
 +
 +
Planned content:<br>
 +
1.3.4
 +
{|cellspacing="0" border="1"
 +
!|Component
 +
!|Changes
 +
|-
 +
||mcts-sensorfw-tests|| Initial version
 +
|-
 +
||mcts-connman-tests|| Add Bearer Managerement cases
 +
|-
 +
|}
 +
 +
 +
=== MCTS Release 1.3.3/1.2.21 ===
 +
 +
Target date: June 23th, 2011<br>
 +
Status:      '''Complete'''
 +
 +
Planned content:<br>
 +
1.3.3
 +
{|cellspacing="0" border="1"
 +
!|Component
 +
!|Changes
 +
|-
 +
||mwts-common || Add measurement series support to CSV output
 +
|-
 +
||mwts-* || (All test packages) Fixes: BMC#19174 - No tests.xml in mwts
 +
|-
 +
||mcts-packagekit-tests|| Fix 11393
 +
|-
 +
|}
 +
 +
1.2.21
 +
{|cellspacing="0" border="1"
 +
!|Component
 +
!|Changes
 +
|-
 +
||mwts-common || Add measurement series support to CSV output
 +
|-
 +
||mwts-* || (All test packages) Fixes: BMC#19174 - No tests.xml in mwts
 +
|-
 +
||mcts-packagekit-tests|| Fix 11393
 +
|-
 +
|}
=== MCTS Release 1.3.2/1.2.20 ===
=== MCTS Release 1.3.2/1.2.20 ===
Target date: June 9th, 2011<br>
Target date: June 9th, 2011<br>
-
Status:      '''In Progress'''
+
Status:      '''Complete'''
Planned content:<br>
Planned content:<br>
Line 16: Line 112:
||blts-usb || Fixes: MB#18224 (Linux 2.6.39 release only)
||blts-usb || Fixes: MB#18224 (Linux 2.6.39 release only)
|-
|-
-
||TBD || TBD
+
||mcts-tracker-tests|| Fix BMC#13564
 +
|-
 +
||mwts-network || Fixes: MB#18122, MB#18123. Clarified the FTP login sequence
 +
|-
 +
||mwts-common || Fixes: MB#18304. Fixed test case verdict
 +
|-
 +
||mwts-xxxxxx || Fixes: MB#18414
 +
|-
 +
||mwts-telepathy || Fixes: MB#14970
 +
|-
 +
||mwts-accounts || Fixes: MB#18461,MB#18462, MB#18464
 +
|-
 +
||mwts-gstreamer || Fixes: MB#16744
|-
|-
|}
|}
Line 30: Line 138:
|-
|-
||mwts-xxxxxx || Fixes: MB#18414
||mwts-xxxxxx || Fixes: MB#18414
-
|-
 
-
||mwts-n900-jkl-core-tests || Initial version
 
|-
|-
||mwts-telepathy || Fixes: MB#14970
||mwts-telepathy || Fixes: MB#14970
Line 43: Line 149:
||blts-usb || Fixes: MB#18224 (Linux 2.6.39 release only)
||blts-usb || Fixes: MB#18224 (Linux 2.6.39 release only)
|-
|-
-
||TBD || TBD
+
||mcts-tracker-tests|| Fix BMC#13564
|-
|-
|}
|}

Latest revision as of 07:10, 5 August 2011

Contents

MCTS Releases

MCTS Release 1.3.6/1.2.22

Target date: Aug. 4th, 2011
Status: Complete

Planned content:
1.3.6

Component Changes
mwts-* Update tests.xml test types according to common schema. Fixes: BMC#17877 - Test types update in MCTS
blts-* Update tests.xml test types according to common schema. Fixes: BMC#17877 - Test types update in MCTS
mwts-common Prevent unconnected socket use in monitor (bugfix)
mcts-ofono-tests Fix BMC#17877
mcts-connman-tests A small fix for wireless cases

1.2.22

Component Changes
mwts-common Prevent unconnected socket use in monitor (bugfix)

MCTS Release 1.3.5

Target date: July 21th, 2011
Status: complete

Planned content:
1.3.4

Component Changes
mcts- update test type according to new test-definion, update some test cases

MCTS Release 1.3.4

Target date: July 7th, 2011
Status: Complete

Planned content:
1.3.4

Component Changes
mcts-sensorfw-tests Initial version
mcts-connman-tests Add Bearer Managerement cases


MCTS Release 1.3.3/1.2.21

Target date: June 23th, 2011
Status: Complete

Planned content:
1.3.3

Component Changes
mwts-common Add measurement series support to CSV output
mwts-* (All test packages) Fixes: BMC#19174 - No tests.xml in mwts
mcts-packagekit-tests Fix 11393

1.2.21

Component Changes
mwts-common Add measurement series support to CSV output
mwts-* (All test packages) Fixes: BMC#19174 - No tests.xml in mwts
mcts-packagekit-tests Fix 11393

MCTS Release 1.3.2/1.2.20

Target date: June 9th, 2011
Status: Complete

Planned content:
1.3.1

Component Changes
blts-ofono Fixes: MB#18172. Call meter cases expected value handling and default parameters fixed.
blts-usb Fixes: MB#18224 (Linux 2.6.39 release only)
mcts-tracker-tests Fix BMC#13564
mwts-network Fixes: MB#18122, MB#18123. Clarified the FTP login sequence
mwts-common Fixes: MB#18304. Fixed test case verdict
mwts-xxxxxx Fixes: MB#18414
mwts-telepathy Fixes: MB#14970
mwts-accounts Fixes: MB#18461,MB#18462, MB#18464
mwts-gstreamer Fixes: MB#16744

1.2.20

Component Changes
mwts-network Fixes: MB#18122, MB#18123. Clarified the FTP login sequence
mwts-common Fixes: MB#18304. Fixed test case verdict
mwts-xxxxxx Fixes: MB#18414
mwts-telepathy Fixes: MB#14970
mwts-accounts Fixes: MB#18461,MB#18462, MB#18464
mwts-gstreamer Fixes: MB#16744
blts-ofono Fixes: MB#18172. Call meter cases expected value handling and default parameters fixed.
blts-usb Fixes: MB#18224 (Linux 2.6.39 release only)
mcts-tracker-tests Fix BMC#13564

MCTS Release 1.3.1/1.2.19

Target date: May 26th, 2011
Status: Complete

Planned content:
1.3.1

Component Changes
mwts-sensors Fixes: MB#17464, MB#13004. Test asset refactored
mwts-location Fixes: MB#14885,
mwts-common Added memory and cpu usage format, fixed log writting
mwts-telepathy Fixes: MB#11981, MB#12954, added missing cases
mwts-feedback Fixes: MB#17514, added actuator checkout
mwts-network Fixes: MB#17680
mwts-messaging Fixes: MB#12633
mwts-qtmultimedia Fixes: MB#16203, fixed audio playing MIN scripts
blts-bluetooth Fixes: MB#17508
mcts-connman-tests Adjust according connman change

1.2.19

Component Changes
mwts-sensors Fixes: MB#17464, MB#13004. Test asset refactored
mwts-location Fixes: MB#14885,
mwts-common Added memory and cpu usage format, fixed log writting
mwts-telepathy Fixes: MB#11981, MB#12954, added missing cases
mwts-feedback Fixes: MB#17514, added actuator checkout
mwts-network Fixes: MB#17680
mwts-messaging Fixes: MB#12633
mwts-qtmultimedia Fixes: MB#16203, fixed audio playing MIN scripts
blts-bluetooth Fixes: MB#17508
mcts-connman-tests Adjust according connman change

MCTS Release 1.2

Target date: May 19th, 2011
Status: complete

Rename MCTS Release 0.1.8 to mcts release 1.2 to be compliant with MeeGo 1.2 release.
+ An new mcts-1.2 branch at gitorious.org
+ An new mcts-1.2 release repository at http://download.meego.com/live/devel:/quality:/mcts1.2/Meego_1.2.0

MCTS Release 0.1.8

Target date: May 12th, 2011
Status: complete

Planned content:

Component Changes
mwts-networkFixed bugs: MB#13534, MB#16521. Fix for downloading file via http
mwts-bluetoothFix for obex file transfer
mwts-accountsFixed bugs:MB#16358, MB#10743
mwts-gstreamerFixed bug: MB#11611
mwts-locationFixed bugs:MB#14885, MB#12668
mwts-systeminfoFixed bug: MB#12008
blts-usbKernel code cleanup on x86_64 architecture
mcts-display-testrevise LICENSE header info
mcts-openvg-testrevise LICENSE header info
*move coverage information from mcts-coverage to each components

MCTS Release 0.1.7

Target date: April 28th, 2011
Status: complete

Planned content:

Component Changes
mcts-blts-ofonoUpdate call swap case to work correctly with oFono 0.46+
mcts-connman-testsAjust test cases for connman change, Fix #14133
mcts-lsw-testsFix .spec issue.

MCTS Release 0.1.6

Target date: April 14th, 2011
Status: Complete

Planned content:

Component Changes
mcts-geoclue-testsupdate spec file
mcts-lsw-testsupdate spec file
mcts-packagekit-testsFix Bug 11393
mcts-connman-testsFix Bug 13777
mcts-blts-bluetoothAdd optional tracer agent; Add environment setup instructions (Fixes bug 10096)
mcts-blts-commonAdd API for synchronizing blts-common using tests
mcts-blts-ofonoRemove Deregister test (oFono API changed); Fix memory leak in data context test; Add Call Waiting test

MCTS Release 0.1.5

Target date: March 31st, 2011
Status: Complete

Planned content:

Component Changes
blts-ofonoBasic data context cases added
blts-bluetoothFix LE build against current Bluez
blts-v4l2N900 and vivi configs added to samples package
mwts-commonRpm packaging fixes and qa-tools compliancy features
mwts-locationaccuracy first version and some logic fixes
mwts-gcameraFixed warning messages
mwts-gstreamerFixed warning messages
mwts-ofonoRemoved ofono build, package requirement
mwts-networkFix for connection establishing,added psd connection functionality
mcts-bluez-testsAdd 14 cases

MCTS Release 0.1.4

Target date: March 17th, 2011
Status: Complete

Planned content:

Component Changes
mcts-geoclue-testsbug fix
mcts-lsw-testsFixed Bug#14199
mcts-connman-testsFix Bug 14040
mcts-blts-bluetoothFix Bluetooth LE compile-time check; Fix LE scan RSSI reading; Add basic LE data transfer cases
mcts-blts-commonAdd Testrunner-compatible measurement reporting API
mcts-blts-opengles2-perfReport performance with new measurement API
mcts-blts-wlan-coreAdd optional automatic connmand/wlan_supplicant disabling

MCTS Release 0.1.3

Target date: March 3rd, 2011
Status: Complete

Planned content:

Component Changes
blts-bluetoothAdd basic Bluetooth LE cases; Fix server racing with new connection close; Use builtin code instead of hcidump
mcts-tablet-tests An collection of test cases for tablet
mcts-connman-testsAdd new cases for WPS
mcts-bluez-testsModify one case to make the test point clearer
mcts-tracker-testsAdd sleep after copy tracks for fixed the issue about unable to index.


MCTS Release 0.1.2

Target date: February 10th, 2011
Status: Complete

Planned content:

Component Changes
blts-input-devicesAdd automatic device select option, remove screen resolution dependency
blts-ofonoImprove runtime instructions for call cases
blts-usbFixed single-endpoint failure handling
blts-wlan-coreDocument incompatibility with Connman WLAN handling
mwts-commonRemoved hard coded path from iperf starting and fine tuned QProcess error handling
mwts-filesystemAdded utils to make Mass Storage functionality into device, it it does not support it by platform
mwts-networkModified wlan scan logic. Now it searches if specifig access point is found
mwts-telepathyAdded SMS cases
mwts-usbAdded iperf instructions to README file
mwts-locationAdded Accuracy test and possibility to perfor measure of cold test fixing
mwts-multimediaAdded functionality to perform scan of whole band range, added script for measuring latency of scanning band
mwts-ofonoAdded classes for sim manager and voice call (forwarding, waiting, barring)
mcts-*-testsChanges for OBS - Rename test.spec and add .changes

MCTS Release 0.1.1

Target date: January 25th, 2011
Status: Complete

Planned content:

Component Changes
blts-openvg-testsFix OBS build failure
mcts-rendercheck-testsFix OBS build failure
mcts-rendercheck-testsSmall fix for Stress cases
mcts-blts-ofonoNew radio technology change test; cleanup flag default reversed; PIN case robustness/documentation fixes
mcts-blts-usbFail when any endpoint fails (bugfix); Fix build with Linux 2.6.37+
mcts-blts-xvideoN900-specific config added to package, example config simplified
mwts-usbFixed timeouts and added one slave case for LOLA cases
mwts-gstreamerAdded playback functionality
mwts-multimediaAdded bug fix for FM radio test cases
mwts-ofonoAdded functionality for suplementary services

MCTS Release 0.1.0

Target date: January 18th, 2011
Status: Complete

Planned content:

Component Changes
mcts-blts-opengles2-testsFix build with new pvr-bin-devel (BMC#10112)
mcts-system-testsinitial version
mcts-ofono-tests add smart message cases/cleanup tests.xml
mcts-connman-tests Add cases for connman features: Tethering/pacrunner/TTLS EAP/OpenVPN
mwts-accounts Initial version
mwts-buteo Initial version
mwts-bluetooth Configuraion changes, OBS support added
mwts-common OBS support added
mwts-gcamera OBS support added
mwts-location OBS support added
mwts-ofono Initial version
mwts-pim Fixed bug 11759, two new test cases added, OBS support added
mwts-template OBS support added
mwts-usb OBS support added

MCTS Release 0.0.9

Target date: January 11th, 2011
Status: Complete

Planned content:

Component Changes
mcts-ofono-tests add real network(2G&3G) cases
mcts-tracker-tests Change some data tracks for tracker testing.
mcts-connman-tests Fix Bug 12017
mcts-baseos-nb-tests Remove invalid src/testinfo.xml
mcts-blts-alsa-core-tests Trivial resource leak fix
mcts-blts-common Fix assert when config missing but values needed
mcts-blts-fbdev-tests Allow backlight to settle before deciding test status
mcts-blts-ofono-tests Fix PIN Lock/Unlock; Default config update for PIN Reset; allow suppressing suppl. service reset
mcts-blts-wlan-core-tests Trivial resource leak fix

MCTS Release 0.0.8

Target date: December 30th, 2010
Status: Complete

Planned content:

Component Changes
mcts-display-tests Update with new Logging macros
mcts-connman-tests Add 13 ConnMan test cases
mcts-bluez-tests Add 3 bluez profile test cases
mcts-tracker-tests Add 21 tracker cases

MCTS Release 0.0.7

Target date: December 16th, 2010
Status: Complete

Planned content:

Component Changes
mcts-blts-alsa-core Clean up obsolete Min support files; Clean up tests.xml
mcts-blts-bluetooth Clean up obsolete Min support files; Clean up tests.xml
mcts-blts-common Add Doxygenized API documentation to source
mcts-blts-fbdev Clean up obsolete Min support files; Add 6 performance cases
mcts-blts-input-devices Clean up tests.xml
mcts-blts-ofono Clean up tests.xml
mcts-blts-opengles2-perf Clean up obsolete Min support files; Clean up tests.xml
mcts-blts-sensor-plugins Fix example plugin packaging
mcts-blts-usb Clean up tests.xml; Fix paths in default configs; Fix build on Linux 2.6.36+; Fix unreported fail on 0-len transfer
mcts-blts-v4l2 Clean up obsolete Min support files; Clean up tests.xml
mcts-blts-watchdog Clean up obsolete Min support files; Clean up tests.xml
mcts-blts-wlan-core Clean up tests.xml; Fix crash when no devices present
mcts-blts-x11 Clean up obsolete Min support files; Clean up tests.xml
mcts-blts-xvideo Clean up obsolete Min support files; Clean up tests.xml
mwts-common Fixes crashes on some environments
mwts-filesystem Min scripts reorganization
mwts-sensors Min scripts reorganization
mwts-usb Fixed master slave case
mwts-bluetooth Fixed dependencies in case naming, added new min options and keyword
mwts-feedback Initial version of test asset
mwts-pim Api reorganization,min scripter update
mwts-systeminfo Initial version of test asset
mcts-display-tests Initial version of test asset, based on Xrandr API
mcts-connman-tests Revise test suite to use net.connman interface

MCTS Release 0.0.6

Target date: December 2nd, 2010
Status: Complete

Planned content:

Component Changes
mcts-blts-alsa-core Fix capture-only device failure in enumeration test case
mcts-blts-opengles2-perf Fix cube vertex scaling
mcts-blts-v4l2 Fix duplicate set in tests.xml
mcts-blts-wlan-core Add establish/join adhoc network cases; code cleanup; retries for disconnect adhoc case.
mcts-openvg-tests Initial version
mcts-piglit-tests Removed
mcts-clutter-tests Removed

MCTS Release 0.0.5

Target date: November 18th, 2010
Status: Complete

Released content:

Component Changes
mcts-blts-alsa-core Timer fix for multiple cards scenario; move volume setting to config; logging fixes; packaging update
mcts-blts-bluetooth Use common frontend; longer timeouts for many cases; info query cases updated; logging fixes; packaging update
mcts-blts-common Logging API updates; variants included in test lists
mcts-blts-fbdev logging fixes; packaging update
mcts-blts-input-devices logging fixes; packaging update
mcts-blts-ofono Support oFono 0.33 ; Poweron/online checks added for init; forwarding/barring fixes; configurable timeouts; smsc handling fixes
mcts-blts-opengles2-perf  logging fixes; packaging update
mcts-blts-pixelformat logging fixes; packaging update
mcts-blts-sensor-plugins logging fixes; packaging update
mcts-blts-sensors-frontend logging fixes; packaging update
mcts-blts-usb logging fixes; packaging update
mcts-blts-v4l2 Fix for variant argument parsing; logging fixes; packaging update
mcts-blts-watchdog Fix tests.xml command lines; logging fixes; packaging update
mcts-blts-wlan-core Initial version
mcts-blts-x11 logging fixes; packaging update
mcts-blts-xvideo logging fixes; packaging update
mcts-ofono-test Add 210 new manual cases and update auto case according ofono API change
mcts-connman-test Update according ConnMan API change - Removal of Device/Network interface
mwts-telepathy Added new cases, starting of IM support
mwts-gstreamer Fixes in packaging and tests.xml
mwts-filesystem Added Ext3 and Ext4 targets
mwts-common Fixes in RPM packaging
mwts-template added template for test asset creation
mwts-network Initial version of networking test asset
mwts-multimedia Initial version of qt-multimedia test asset
mwts-messaging Initial version of qt-messaging test asset
mwts-messaging Initial version of qt-messaging test asset
mwts-gcamera Initial version of gstreamer/camerabin test asset
mwts-bluetooth Initial version of bluetooth test asset
mwts-accounts Initial version / placeholder for accounts test asset

MCTS Release 0.0.4

Target date: October 28th, 2010
Status: Complete

Released content:

Component Changes
mcts-blts-usb Remove unused dependency to DBus and GLib
mcts-blts-fbdev Initial version
mcts-blts-input-devices Initial version
mcts-blts-sensors-frontend Initial version
mcts-blts-sensor-plugins Initial version
mcts-blts-watchdog Initial version
mcts-mwts-gstreamer Initial version
mcts-mwts-usb Initial version
mcts-mwts-location Initial version
mcts-mwts-sensors Initial version
mcts-mwts-telepathy Initial version

MCTS Release 0.0.3

Target date: October 14th, 2010
Status: Complete

This release is planned to add further development items to combine development.

Released content:

Component Changes
mcts-mwts-common Initial version
mcts-mwts-filesystem Initial version
mcts-lsw-tests Initial version
mcts-blts-alsa-core RPM packaging added; Debian packaging fixes; Fix 24/32-bit tone generation; Use driver-provided frame size
mcts-blts-common RPM packaging added; Debian packaging fixes; Use centralised location for configuration files by default
mcts-blts-ofono RPM packaging added; Debian packaging fixes; Support for oFono 0.29; Fix mic volume case segfault
mcts-blts-opengles2-perf RPM packaging added; Debian packaging fixes
mcts-blts-pixelformat RPM packaging added; Debian packaging fixes
mcts-blts-usb RPM packaging added; Debian packaging fixes
mcts-blts-v4l2 RPM packaging added; Debian packaging fixes; Fix build error with new libjpeg headers
mcts-blts-x11 RPM packaging added; Debian packaging fixes
mcts-blts-xvideo RPM packaging added; Debian packaging fixes; Fix window creation with TWM

MCTS Release 0.0.2

Target date: September 30th, 2010
Status: Complete

This release adds further development items to combine development.

Released content:

Component Changes
mcts-packagekit-tests Initial version
mcts-qtgfx-tests Initial version
mcts-connman-tests cases for Signal, Flight etc

MCTS Release 0.0.1

Target date: September 21st, 2010
Status: Complete

This is initial release to combine development.

Released content:

Component Changes
mcts-baseos-nb-tests Initial version
mcts-blts-alsa-core Initial version
mcts-blts-common Initial version
mcts-blts-ofono Initial version
mcts-blts-opengles2-perf Initial version
mcts-blts-pixelformat Initial version
mcts-blts-usb Initial version
mcts-blts-v4l2 Initial version
mcts-blts-x11 Initial version
mcts-blts-xvideo Initial version
mcts-bluez-tests Initial version
mcts-clutter-tests Initial version
mcts-connman-tests Initial version
mcts-geoclue-tests Initial version
mcts-gupnp-tests Initial version
mcts-ofono-tests Initial version
mcts-piglit-tests Initial version
mcts-power-nb-tests Initial version
mcts-pulseaudio-tests Initial version
mcts-rendercheck-tests Initial version
mcts-tracker-tests Initial version
mcts-x-tests Initial version
Personal tools