Views
Quality/TestSuite/MCTS/ConnMan Test Plan
Contents |
Connection Manager Test Plan
Component Summary
In core stack, connection management is a key daemon to choose best network, get network status, set network properties, set policy and profile, set configuration, set flight mode, etc. A connection management application is provided also to provide friendly GUI to user. Moblin shall provide a complete communication management solution to support all connection signals as listed in this section of the requirements document. This connection management solution shall have an integrated user interface to manage all device connection events (new connections, connection lost, connection transfer, etc.) in an application without user to work with separately. This connection management solution shall be able to scale to support future new type of connection type without re-architect the solution.
Feature to be Tested
All features provided in the core Connection Manager daemon will be tested.
MeeGo 1.2 Features
|
Feature ID |
Feature Descriptioin |
Test Set |
Comments |
|
3001 |
Connection Manager to support 3G to WiFi session continuity |
TBD |
TBD |
|
4726 |
WiFi Protected Setup pairing (WPS) |
WiFiFeature |
Connect to AP through WPS |
|
4751 |
IPv6 |
IPv6 |
Only support static IPv6. Can ssh between 2 IPv6 machines |
|
4752 |
VPN - Cisco AnyConnect |
VPN |
This is for openconnect. Also works for OpenVPN |
|
4757 |
TCP Support for DNS Proxy |
Advanced |
This feature can be tested through dig |
|
5575 |
EAP-TTLS Support |
WiFiFeature |
Connect to AP through EAP-TTLS |
|
5749 |
Connectivity Context |
TBD |
TBD |
|
6688 |
Missing packages to manage Country Code for Wireless access |
WiFiFeature |
Get regulatory from 3G network and set to Wireless |
|
6756 |
PPP over 3G |
3G |
Support PPP 3G modem |
|
7803 |
Tethering - share cellular data connection to USB tethered device |
Tethering |
Connect to machine A through USB, and access Internet through machine A |
|
7806 |
Tethering - share cellular data connection to BT PAN tethered device |
Tethering |
Connect to machine A through BT PAN, and access Internet through machine A |
MeeGo 1.1 Features
|
Feature ID |
Feature description |
Test Set |
Comments |
|
2991 |
Connection Manager support for wifi, wired(LAN), Wired/Wifi coexistence |
Switch |
Multiple connection exist simultanously |
|
2992 |
Connection Manager support for BT PAN |
BT |
Can connect/ping to BT PAN server |
|
2993 |
Connection Manager support for 3G Data |
3G |
Setup 3G data connection |
|
2994 |
Connection Manager support for flight mode |
Flight |
Flight mode on will powered off all devices BT/WiFi can be powered on in flight mode |
|
2995 |
Connection Manager to support Network selection, WPA-Supplicant |
WiFiFeature |
Can select and connect to a network wpa_supplicant for wifi |
|
2996 |
Connection Manager to support Profile management |
Profile |
Profile management (create/remove/list) |
|
2997 |
Connection Manager to support connection to wifi access points(AP) |
WiFiFeature |
WiFi support master feature (This feature covers following sub features: |
|
2998 |
Connection Manager to support auto connection to wifi access points(AP) |
WiFiFeature |
Auto connection for WiFi |
|
2999 |
Connection Manager to support Secure connections with AP |
WiFiFeature |
WiFi security |
|
4725 |
WEP and WPA |
WiFiFeature |
WiFi security |
|
4730 |
WiFi/Wired connection co-existance |
Switch |
WiFi/Wired co-existance |
|
4731 |
Device On/Off Status after Reboot |
State |
Device Status after reboot |
|
4732 |
Broadcast AP |
WiFiFeature |
Can connect to Broadcast AP |
|
4733 |
Hidden AP |
WiFiFeature |
Can connect to Hidden AP |
|
4734 |
Hidden Group AP |
WiFiFeature |
Can connect to Hidden Group AP |
|
4735 |
Auto connect from Reboot |
AutoConn |
Connman will auto recover previous connection after system reboot. |
|
4736 |
Auto connect from Offline |
AutoConn |
If a device disconnect by flight mode, unset flight mode will auto recover previous connection. |
|
4737 |
Auto connect from Suspend |
AutoConn |
ConnMan will auto recover previous connection after system resume from suspend. |
|
4738 |
Favorite connection setting |
AutoConn |
Auto connection only works for favorite services |
|
4739 |
Automatic selection of best available connection across different WLAN bands |
NetworkSel |
Automatic selection of best available connection across different WLAN bands |
|
4740 |
Auto connectivity order |
NetworkSel |
Auto connectivity order as below: Ethernet Bluetooth GSM?UTMS/3G WiFi/WiMAX |
|
4741 |
WEP 40/128 bit Security |
WiFiFeature |
ConnMan can connect to AP with WEP 40/128 bit Security |
|
4742 |
WEP Passphrase Security |
WiFiFeature |
ConnMan can connect to AP with WEP Passphrase Security |
|
4743 |
WPA Personal Security |
WiFiFeature |
ConnMan can connect to AP with WPA Personal Security |
|
4744 |
WPA2 Security |
WiFiFeature |
ConnMan can connect to AP with WPA2 Security |
|
4745 |
Open System Authentication |
WiFiFeature |
ConnMan can connect to AP with Open System Authentication |
|
4746 |
Shared Key Authentication |
WiFiFeature |
ConnMan can connect to AP with Shared Key Authentication |
|
4747 |
Remember Paswd |
WiFiFeature |
Remember Paswd |
|
4749 |
AP Security type Auto Detect |
WiFiFeature |
ConnMan can auto detect AP Security type |
|
4754 |
HTTP Proxy |
Advanced |
By setting HTTP Proxy, application can access Internet through Intranet |
|
4755 |
Dynamic WEP (802.1x) |
WiFiFeature |
ConnMan can connect to AP with Dynamic WEP (802.1x) |
|
4759 |
Web proxy support |
Advanced |
Web broswer can access Internet through Intranet by setting Web proxy support |
|
4760 |
DNS Proxy |
Advanced |
ConnMan can access DNS through DNS Proxy |
|
4761 |
Host and Domain Name Support |
Advanced |
ConnMan can access Host bye hostname |
|
4762 |
Static IP |
Advanced |
ConnMan can set Static IP for local host |
|
4763 |
Flight Mode Support |
Flight |
Flight Mode Support |
|
4766 |
Portal Detection |
Advanced |
Portal Detection |
Other ConnMan Features
|
Feature |
Test Set |
Comments |
|
Ethernet |
Ethernet |
connect/disconnect |
|
DHCP |
DHCP |
Can get IP automatically |
|
Dbus API Property |
Property |
Property value is valid |
|
Dbus API Signal |
Signal |
Invoke a callback when specific property value changes |
|
ConnMan daemon/components startup |
Launch |
connmand started, relative components started (like wpa_supplicant) |
Feature not to be Tested
1. connman-gnome validation is not covered in this test plan, as it is a simple GTK+-based UI. We will use it to test connman, but we don't validate it. The same is Carrick, it's the application of connMan core, and can be used to test connman. The validation of Carrick can be covered by distribution system test.
2. GPS in connection management is not supported currently
Test Strategy and Approach
Test Methodology
- Test through connman test utility
- Test through Dbus API
Test Types
There are two test types in ConnMan project:
- Upstream testing: This is testing for upstream at connman.net. The testing scope is out of this test plan.
- MeeGo testing: This is testing for MeeGo.
Test Automation
There are so many test cases in ConnMan that it's hard to finish test execution through manual. To improve the test efficiency, automation is neccessary.
MeeGo defined Core Test framework as MCTS. ConnMan test suite is a component of MCTS (mcts-connman-tests). The test automation of ConnMan uses following two methods:
- Using connman test utility
- Develop python test script using ConnMan Dbus API
Test Level
Test Level defined here is according to the level define in test cycle of MeeGo Core Test Plan, which contains Sanity(daily) Testing, Weekly (Data flow testing) and milestone (full) testing. This section defines the test cases used in these test levels.
Sanity Testing
- CM_BT_BigPing
- CM_3G_BigPing
- CM_WG_BigBroadcastPing
- CM_Eth_BigBroadcastPing
Weekly Testing
- CM_WF_CoExists_Wired2
- CM_BT_DeviceIsExist
- CM_BT_SmallPing
- CM_3G_DeviceIsExist
- CM_3G_DeviceControl
- CM_3G_BigPing
- CM_Flt_Online
- CM_NetworkSel_BroadcastWEP
- CM_Prof_Add
- CM_WS_OpenBroadcastRSN
- CM_WG_BigBroadcastPing
- CM_AutoConn_RebootWIFI
- CM_WS_PSK1
- CM_WS_WEP128
- CM_WF_CoExists_Wired
- CM_Device_WIFI_Reboot
- CM_WS_Broadcast
- CM_WS_Hidden
- CM_WG_BigBroadcastPing
- CM_AutoConn_Reboot3G
- CM_Flt_3G_autoconn
- CM_WA_AutoConnectFromSuspend
- CM_AutoConn_FavoriteSetting
- CM_NetworkSel_Best
- CM_3G_Coexist_Priority
- CM_WS_WEP64
- CM_WS_WEP40ascii
- CM_WS_PSK1
- CM_WS_RSN
- CM_WS_Open
- CM_WS_Shared
- CM_WA_RememberPasswd
- CM_WA_DetectSecurityWEP
- CM_Advance_http_proxy
- CM_WF_Connect_WPAEnterprise
- CM_Advance_web_proxy
- CM_Advance_DNS_Set
- CM_Advance_Hostname
- CONNMAN_Advance_StaticIP_Wired
- CM_Flt_Offline
- CM_State_Accountneeded_network
- CM_IPv6_ssh
- CM_VPN_3G
- CM_3G_BigPing
Milestone Testing
- All test cases
Test Design
ConnMan test cases defines all ConnMan Test suite. http://dl.meego.com provides more readable test cases if you can access.
Test Enviroment
Hardware Platform
Up to now, this test plan defines following platforms. It will change according to the MeeGo Core Test Plan.
|
Test platforms |
Networks |
Other Devices |
Priority |
|
Netbook |
Lan, Wifi, 3G |
BT dongles, WiFi card, 3G data card |
P1 |
|
Handset |
Wifi, 3G, BT |
BT dongles, WiFi card, 3G data card |
P1 |
|
PC |
Lan, Wifi, 3G |
BT dongles, WiFi card, 3G data card |
P3 |
Software Environment
MeeGo image
QA Contact
Developers
Marcel Holtmann
Samuel Ortiz
Mohamed Abbas
Martin Xu
Referrences
ConnMan project website: http://connman.net
ConnMan MeeGo 1.1 feature list
ConnMan MeeGo 1.2 feature list