ARM/N900/QA/Performance

Latest revision as of 05:46, 23 August 2011

Performance Results

This wiki page contains latest performance testing results done for Community Edition of MeeGo for the Nokia N900 device

Response Time

Response Time testing measures the time a system takes to react to given input by end-user; the total time it takes from a user request until response is received

Measurements will be done for every weekly release and updated here on Mondays

How measurements are done:

• used HW is N900
• release is run from memory card (class 6 SD card)
• measurements done from UI
• each use case is measured three times with stop watch and median result is used as a result
• measurements will be done for weekly release (Monday's stable image) or if specially asked
• currently measured applications don't contain any test data (e.g. call history, received SMS)
• same operator used all the time

Detail test case descriptions can be found from gitorious (mhts-de-performance-tests)

For questions or comments contact Anssi Takku (IRC: zotte)

Handset Start-up Time

Handset Shutdown Time

Application Start-up Time

• Note! Helium browser was first time included in Summer Release. We continue still tracking Fennec's response time. More info about browsers in Summer Release presentation
• Note2! Fennec start-up time is really slow after every reboot. Start-up time decreases rapidly after opening and closing application successfully few times

Incoming Call Time

Incoming call time measures how long it takes to start playing ringtone after UI notification for incoming call is visible

Rotation Time

Core

Core tests are run from the core level, so no UI involvement is present.

• HW: N900
• image: latest Developers Edition image

Power measurements

These measurements are done to keep an eye on power consumption of the device. The measurements are done on second boot when the device is in standby. Default configurations are not modified so radios that are on by default will be on. Device is registered to cellular network during the test. -lapoyhon

Current consumption on idle device

Wakeups on idle device

Progress from MeeGo 1.1

Here's a quick peek into MeeGo 1.1 handset power consumption on N900, just to give a general idea about progress on this area.

MeeGo 1.1        home screen 15min after 2nd boot      470 mA
MeeGo 1.1 does not blank screen when idle
DE.2011-06-13.1  home screen 15min after 2nd boot      145 mA
DE.2011-06-13.1  blanked screen 15min after 2nd boot    20 mA

Filesystem tests (bonnie++)

I did a new test run with the memory cards I have available here. Also I tested eMMC from both Maemo and MeeGo system to see the difference. -lapoyhon

eMMC (ext3) - Maemo Fremantle pr1.3

Version 1.03e       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
Nokia-N900-51-1  1G  1793  71  4753   7  3574   5  2577  98 20673  21 247.8   3
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16  5241  65 +++++ +++   119   1  1603  21 +++++ +++    58   0

eMMC (ext3) - MeeGo Community Edition 2011-06-10.1

Version 1.03e       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
localhost.locald 1G  2186  81  5591  18  3696  14  2774  97 15423  36  98.1   3
                    ------Sequential7 Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16   175   2 +++++ +++   109   2  1133  15 +++++ +++    68   1

SanDisk MicroSD HC class 6 (ext4) - MeeGo Community Edition 2011-06-10.1

Version 1.03e       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
localhost.locald 1G  2684  95 14039  34  5587  20  2768  97 13227  30 283.9  10
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16  2273  39 +++++ +++  4682  47  7904  97 +++++ +++  5952  59

Kingston MicroSD HC class 4 (ext4) - MeeGo Community Edition 2011-06-10.1

Version 1.03e       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
localhost.locald 1G  2404  87  7797  20  3728  12  2752  96 12813  29 198.4   7
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16  1205  32 +++++ +++ 11382  98  2041  27 +++++ +++  3040  30