Meego Wiki
From MeeGo wiki
(Difference between revisions)
Jump to: navigation, search
(Monthly Metrics: added pdf for March)
(Added June metrics PDF file)
 
(6 intermediate revisions not shown)
Line 1: Line 1:
== Status Update ==
== Status Update ==
-
Metrics for February are posted below --[[User:Dawnfoster|Dawnfoster]] 15:46, 29 March 2011 (UTC)
+
Metrics for June are posted below --[[User:Dawnfoster|Dawnfoster]] 22:39, 26 July 2011 (UTC)
== Monthly Metrics ==
== Monthly Metrics ==
More details than you could possibly want to know about the activity in the MeeGo community.
More details than you could possibly want to know about the activity in the MeeGo community.
-
* [http://wiki.meego.com/images/MeeGo_Community_Metrics_March_2011.pdf March 2011 (PDF] or read the blog post summary (coming soon)
+
* [http://wiki.meego.com/images/MeeGo_Community_Metrics_June_2011.pdf June 2011 (PDF)] or read the blog post summary (coming soon).
 +
* [http://wiki.meego.com/images/MeeGo_Community_Metrics_May_2011.pdf May 2011 (PDF)] or read the [https://meego.com/community/blogs/dawnfoster/2011/meego-community-update-and-metrics-may blog post summary].
 +
* [http://wiki.meego.com/images/MeeGo_Community_Metrics_April_2011.pdf April 2011 (PDF)] or read the [https://meego.com/community/blogs/dawnfoster/2011/meego-community-update-and-metrics-april blog post summary].
 +
* [http://wiki.meego.com/images/MeeGo_Community_Metrics_March_2011.pdf March 2011 (PDF)] or read the [https://meego.com/community/blogs/dawnfoster/2011/meego-community-update-and-metrics-march blog post summary]
* [http://wiki.meego.com/images/MeeGo_Community_Metrics_February_2011.pdf February 2011 (PDF)] or read the [http://meego.com/community/blogs/dawnfoster/2011/meego-community-update-and-metrics-february blog post summary]
* [http://wiki.meego.com/images/MeeGo_Community_Metrics_February_2011.pdf February 2011 (PDF)] or read the [http://meego.com/community/blogs/dawnfoster/2011/meego-community-update-and-metrics-february blog post summary]
* [http://wiki.meego.com/images/MeeGo_Community_Metrics_January_2011.pdf January 2011 (PDF)] or read the [http://meego.com/community/blogs/dawnfoster/2011/meego-community-update-and-metrics-january blog post summary]
* [http://wiki.meego.com/images/MeeGo_Community_Metrics_January_2011.pdf January 2011 (PDF)] or read the [http://meego.com/community/blogs/dawnfoster/2011/meego-community-update-and-metrics-january blog post summary]
Line 176: Line 179:
** [http://is.gd/bOO6E New bugs this month, by product, and their current states] (shortened link)
** [http://is.gd/bOO6E New bugs this month, by product, and their current states] (shortened link)
** [http://bugs.meego.com/report.cgi?x_axis_field=&y_axis_field=product&z_axis_field=&query_format=report-table&short_desc_type=allwordssubstr&short_desc=&longdesc_type=allwordssubstr&longdesc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&deadlinefrom=&deadlineto=&bug_status=RESOLVED&bug_status=RELEASED&bug_status=VERIFIED&bug_status=CLOSED&emailassigned_to1=1&emailtype1=substring&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailcc2=1&emailtype2=substring&email2=&bugidtype=include&bug_id=&chfieldfrom=-1M&chfieldto=Now&chfield=bug_status&chfieldvalue=&format=table&action=wrap&field0-0-0=noop&type0-0-0=noop&value0-0-0= Resolved & closed bugs in the past month] (Status changed in the past month, and current status is one of resolved, released, verified or closed - not sure if this is what you want)
** [http://bugs.meego.com/report.cgi?x_axis_field=&y_axis_field=product&z_axis_field=&query_format=report-table&short_desc_type=allwordssubstr&short_desc=&longdesc_type=allwordssubstr&longdesc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&deadlinefrom=&deadlineto=&bug_status=RESOLVED&bug_status=RELEASED&bug_status=VERIFIED&bug_status=CLOSED&emailassigned_to1=1&emailtype1=substring&email1=&emailassigned_to2=1&emailreporter2=1&emailqa_contact2=1&emailcc2=1&emailtype2=substring&email2=&bugidtype=include&bug_id=&chfieldfrom=-1M&chfieldto=Now&chfield=bug_status&chfieldvalue=&format=table&action=wrap&field0-0-0=noop&type0-0-0=noop&value0-0-0= Resolved & closed bugs in the past month] (Status changed in the past month, and current status is one of resolved, released, verified or closed - not sure if this is what you want)
-
** There are lots of variations - play with [http://bugs.meego.com/query.cgi?format=report-table bugzilla tabular reports] and relative dates for more.  
+
** There are lots of variations - play with [http://bugs.meego.com/query.cgi?format=report-table bugzilla tabular reports] and relative dates for more.
 +
** Get the SQL queries which generate these reports by manually adding "&debug=1" to the URL
*: This might be easiest to automate as a Bugzilla extension querying the BZ database directly. Some potential resources:
*: This might be easiest to automate as a Bugzilla extension querying the BZ database directly. Some potential resources:
** [http://www.ravenbrook.com/project/p4dti/tool/cgi/bugzilla-schema/ Bugzilla database schema by version]
** [http://www.ravenbrook.com/project/p4dti/tool/cgi/bugzilla-schema/ Bugzilla database schema by version]

Latest revision as of 22:39, 26 July 2011

Contents

Status Update

Metrics for June are posted below --Dawnfoster 22:39, 26 July 2011 (UTC)

Monthly Metrics

More details than you could possibly want to know about the activity in the MeeGo community.

Community Health Metrics

My approach to metrics is to focus on measuring the things that help indicate whether the community is healthy and growing and identify any issues early. I have an internal deliverable to provide a monthly report in the first week of every month to my management team, and my plan is to deliver a similar report for the community. I also try to focus on picking the things that have the most impact rather than trying to measure everything. -- Dawn Foster

The metrics that are currently being gathered are organized into four categories:

  • Awareness: Finding the community and visiting it to learn more (potential community members)
  • Membership: Taking the time to sign up and join the community (passive and active community members)
  • Engagement: Interacting with other community members (active community members)
  • Development: Engaging with the MeeGo project at a code level (developers)

Note: Dawn Foster is currently gathering the metrics listed in this section.

Awareness Metrics

  • Website Visits (source Google Analytics)
  • Unique Visitors (source Google Analytics)
  • Page Views (source Google Analytics)
  • Social Media Posts (source Radian6)

Membership Metrics

  • MeeGo.com Total Members (source Drupal)
  • MeeGo-Dev ML Subscribers (source mailing lists)
  • MeeGo-Community ML Subscribers (source mailing lists)
  • MeeGo-SDK ML Subscribers (source mailing lists)
  • MeeGo L10N ML subscribers (source mailing lists)

Engagement Metrics

  • MeeGo-Dev ML Messages (source mailing lists)
  • MeeGo-Community ML Messages (source mailing lists)
  • MeeGo-SDK ML Messages (source mailing lists)
  • MeeGo-iL10n ML messages (source mailing lists)
  • MeeGo-Dev People with 2+ messages (source mailing lists / mlstats)
  • MeeGo-Community People with 2+ messages (source mailing lists / mlstats)
  • Forum Threads (source vBulletin)
  • Blog Comments (source Drupal)
  • Wiki Content Pages (source MediaWiki)
  • Wiki Page Edits (source MediaWiki)
  • Overall MeeGo Translation in the 16 POR languages (source Margie)
  • Community-sourced translations (beyond the POR 16) that are at 50% complete or above (source Margie)
  • Active language teams (source Margie)
  • Overall MeeGo Translation in the 37 languages (source Margie)
  • IRC top contributors and common words used (source irssistats from Stskeeps)

Code Metrics

  • Downloads (source Anas)
  • Commits (source Gitorius)
  • New bugs (source Bugzilla)
  • Closed bugs (source Bugzilla)
  • Total bugs (source Bugzilla)

Content Analysis

  • Most popular mailing list posts across each list (source mailing lists / mlstats)
  • Most popular forum threads (source vBulletin)

Metrics Dashboard Automation Project

Biggest Gaps We Need to Fill Now

  • Add Community OBS Metrics - work with lbt.
  • Add Transifex (localization) metrics - work with Dmitry
  • Add Download numbers (including mirrors) - work with Anas / Adam

Future Improvement Ideas

This is a great way to help out on the MeeGo project - anyone can contribute to the metrics!

If you are starting a task, please add your name next to it to claim your task to avoid duplication (we don't want multiple people working on the same task without coordinating).

Dashboard - high priority

  • An automated dashboard that people can access at any time gathering some of these metrics.
  • We can start with some of the easy ones to gather and add more over time.
  • Would be great to cut this by month for easy report generation.
  • Note: see the points to consider section below for some additional ideas

Other metrics that people may want to capture

  • Software packaging
    • New packages added to repository
    • Updates to existing packages
    • Number of developers/maintainers uploading packages
  • Server performance and maintenance metrics
    • Server use levels
    • Network bandwidth
    • Downtime and error reports
    • OS and firmware patching
  • bugzilla reports
    • Fixed bug reports
    • Unfixed closed bugreports (dups, not a bug, etc)
    • Upstreamed bug reports (MeeGo bug matched with upstream bug report)
  • various open source aspects
    • Activity of Intel & Nokia developers vs activity of "NIN" (Not Intel/Nokia) developers
    • Number of NIN committers, number of MeeGo specific modules with NIN committers.
    • Not sure what you might want to quantitatively measure here - qualitative is hard to automate. See Siobhan O'Mahony's reports for Eclipse & various Eclipse Foundation reports for inspiration Dneary 10:00, 10 March 2010 (UTC)
  • membership / user accounts
    • member satisfaction
    • member recognition
    • Not sure what you might want to quantitatively measure here - qualitative is hard to automate. Dneary 10:00, 10 March 2010 (UTC)
  • Planet MeeGo
    • Blog posts
    • Voting activity
    • Reactions to posts from outside meego.com

Alerts

  • Planned events
    • Infrastructure service outages
  • Unplanned events
    • Capacity shortages (monitor storage and throughput; report on threshold breaches)
    • Attacks on infrastructure

Points to consider

References

Contributors

Additional Helpful Details on Specific Metrics

mlstats queries:

  • Count posts of most popular threads:
    select subject,year(first_date) as y, monthname(first_date),count(*) as c from messages group by subject, month(first_date) order by y, month(first_date), c;
  • Count the number of posts for each person
    select p.email_address,year(m.first_date) as y, monthname(m.first_date),count(*) as c from messages as m,messages_people as p where m.message_id=p.message_ID group by p.email_address, month(m.first_date) order by y, month(m.first_date), c;
  • Restricting queries to a date range / month
    The query above gives month-by-month totals, you could add an order by year(first_date) to get the year too
    The easiest way is to add where month(first_date)=3 and year(first_date)=2010 for March 2010. For the current month, month(m.first_date)=month(NOW()) and year(first_date)=year(NOW()) works.

Bugzilla:

MediaWiki

  • A MediaWiki extension exists to provide "user scores" for MediaWiki users, ordered by number of edits and number of pages changed. The guts of the query is:
SELECT COUNT(wr.rev_id) as value,
       COUNT(DISTINCT wr.rev_page) as page_value,
       wu.user_name as name,
       wu.user_real_name as real_name
FROM   $user wu,
       $revision wr,
       $page wp
WHERE  wu.user_id = wr.rev_user
   and wp.page_id = wr.rev_page
   and wp.page_namespace = 0
GROUP BY wu.user_name
ORDER BY value desc;

where $user, $revision and $page are the names of the respective MediaWiki tables (MediaWiki tables have a prefix associated with them for a given instance, specified by $wgDBprefix in LocalSettings.php).

IRC

Stskeeps has started running monthly IRC reports:

Personal tools