ARM/N900/QA/Performance

Revision as of 15:36, 13 June 2011

Performance Results

This wiki page contains latest performance testing results done for Community Edition of MeeGo for the Nokia N900 device

Response Time

Response Time testing measures the time a system takes to react to given input by end-user; the total time it takes from a user request until response is received

Measurements will be done for every weekly release and updated here on Mondays

How measurements are done:

• used HW is N900
• release is run from memory card (class 6 SD card)
• measurements done from UI
• each use case measured three times with stop watch and median result is used as a result
• currently measured applications don't contain any test data (e.g. call history, received SMS)
• same operator used all the time
• used WLAN is 802.11g

Detail test case descriptions can be found from gitorious (mhts-de-performance-tests)

Handset Start-up Time

• DE.2011-05-06.1: measurement N/A (16429 N900 boots up to power saver mode directly after flashing)

Handset Shutdown Time

• DE.2011-05-06.1: measurement N/A (16196 [n900]Fails to shut down device by pressing power key)
• DE.2011-04-29.1: measurement N/A (16196 [n900]Fails to shut down device by pressing power key)
• Alpha (wk15) release: measurement N/A (device can't be turn off using power button bug 16196)

Application Start-up Time

• DE.2011-05-06.1: Dialer measurement N/A (16814 Dialer fail to launch from UI), Camera measurement N/A (16852 camera application doesn't launch)
• DE.2011-04-29.1: Camera measurement N/A (16852 camera application doesn't launch)
• camera start-up time was measured first time with Alpha (wk15) release

Incoming Call Time

Incoming call time measures how long it takes to start playing ringtone after UI notification for incoming call is visible

• DE.2011-05-06.1: N/A (15950 No audio or audio routing on N900 with Pulseaudio 0.9.22)
• DE.2011-04-29.1: N/A (15950 No audio or audio routing on N900 with Pulseaudio 0.9.22)
• Alpha (wk15): N/A (ringtone doesn't play bug 15950)

Rotation Time

Core

Core tests are run from the core level, so no UI involvement is present.

• HW: N900
• image: latest Developers Edition image

Power measurements

These measurements are done to keep an eye on power consumption of the device. The measurements are done on second boot when the device is in standby. Default configurations are not modified so radios that are on by default will be on. Device is registered to cellular network during the test. -lapoyhon

Current consumption on idle device

Wakeups on idle device

Filesystem tests (bonnie++)

I did a new test run with the memory cards I have available here. Also I tested eMMC from both Maemo and MeeGo system to see the difference. -lapoyhon

eMMC (ext3) - Maemo Fremantle pr1.3

Version 1.03e       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
Nokia-N900-51-1  1G  1793  71  4753   7  3574   5  2577  98 20673  21 247.8   3
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16  5241  65 +++++ +++   119   1  1603  21 +++++ +++    58   0

eMMC (ext3) - MeeGo Community Edition 2011-06-10.1

Version 1.03e       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
localhost.locald 1G  2186  81  5591  18  3696  14  2774  97 15423  36  98.1   3
                    ------Sequential7 Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16   175   2 +++++ +++   109   2  1133  15 +++++ +++    68   1

SanDisk MicroSD HC class 6 (ext4) - MeeGo Community Edition 2011-06-10.1

Version 1.03e       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
localhost.locald 1G  2684  95 14039  34  5587  20  2768  97 13227  30 283.9  10
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16  2273  39 +++++ +++  4682  47  7904  97 +++++ +++  5952  59

Kingston MicroSD HC class 4 (ext4) - MeeGo Community Edition 2011-06-10.1

Version 1.03e       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
localhost.locald 1G  2404  87  7797  20  3728  12  2752  96 12813  29 198.4   7
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16  1205  32 +++++ +++ 11382  98  2041  27 +++++ +++  3040  30