Meego Wiki
Views

Quality/QA-tools/OTS/DevelopmentStatus

From MeeGo wiki
< Quality | QA-tools | OTS
Revision as of 10:34, 2 February 2011 by Tvainio (Talk | contribs)
Jump to: navigation, search

Contents

Release 0.8 unstable

Application Framework

Feature Description Status
Configuration Single configuration file and format, Done
Plugins Runtime discoverable mechanism, with clear usage model Done
Exceptions An understandable exception handling model. Documented OTS 0.9
Logging A coherent distributed logging system Done
Upgrade Capability Worker version management  OTS 0.9
Function call Conductor should be function call not a process OTS 0.9
Properties Merge from 0.1 branch Done
Exceptions, regression Check that all relevant exceptions from 0.1 are in place Done

Common

Feature Description Status
Data Transfer Objects Taxonomy thereof. Pythonic APIs Done
TestDefinition Removed

Server

Feature Description Status
High Level API Client facing interface Done
Hub High level procedural code Done
Disambiguation Datamodel Clear persistence and data management Done
Distributor Opaque Data Transfer Done
Default Options Mapping of Default Options to SW product Done
XMLRPC Add XMLRPC interface Done
Allocator API for custom Task allocation OTS 0.8.1
Publisher Plugins API and demos for 3rd party Publisher Plugins Done
Input Plugin Incorporate and mark as deprecated OTS 0.8.1
Parallel Testruns Trigger the same testrun on multiple targets OTS 0.8.1

Worker

Feature Description Status
Integrate Conductor Full tool chain running

Plugins

Feature Description Status
Reporting Plugin Clear separation between test tool and reporting Done
Email Plugin Email Plugin for Publisher API Done
QA Reports Plugin Publisher plugin for Meego QA Reports tool Done

Usability Issues

Feature Description Status
Unittests run as sudo Queue size API calls Fixed
Developer Installation out-of-the-box Make as easy as possible. Clear instructions. Awaiting review
API Documentation All component APIs documented In Progress
You Tube Video Instruction Video In Progress

Other Problems

  • A testrun with invalid sw_product executes a testrun with sandbox-values. An error should be raised and no testrun should be executed.
  • Exceptions are not handled and they hit the xmlrpc. request_sync() should always return PASS/FAIL/ERROR. nothing else.
  • Incompatible worker version leaves worker in an unknown state and does not report the problem clearly.

Scheduled for 0.9 Release

Organisation, maintenance and upgrades

  • Component reorg (Assess a better representation of Components in code layout. Check impact on deployment)
  • Better unittest harvester (perhaps setup.py test)
  • Evaluate status of dependencies (AMQP 1.0, minixsv supports Python 2.5, setuptools versus distribute etc)

Conductor

  • Python APIs
  • API stability
  • 6Pack integration
  • Automated reboot

Server

  • Remove InputPlugin
  • Lower level extension points on Result File Parsing
  • 6Pack Integration

Not scheduled items

Security

  • HTTPS XML-RPC
  • AMQP connection using SSL encryption
  • OTS server and worker working in user mode
  • Define firewall settings for OTS server and worker
  • User authentication and access rights
  • Test request DDoS filter
Personal tools