Having good metrics and reporting is important for any community. We'll use this page to start to build out a plan for gathering the right metrics that we can use to report on the health of the community.
Metrics to capture
- Software packaging
- New packages added to repository
- Updates to existing packages
- Number of developers/maintainers uploading packages
- Server performance metrics
- Server use levels
- Network bandwidth
- Downtime and error reports
- bugzilla reports (Intel has some of this already from Moblin that we can re-use).
- New bug reports
- Fixed bug reports
- Unfixed closed bugreports (dups, not a bug, etc)
- Upstreamed bug reports (MeeGo bug matched with upstream bug report)
- various open source aspects
- Activity of Intel & Nokia developers vs activity of "NIN" (Not Intel/Nokia) developers
- Number of NIN committers, number of MeeGo specific modules with NIN committers.
- Not sure what you might want to quantitatively measure here - qualitative is hard to automate. See Siobhan O'Mahony's reports for Eclipse & various Eclipse Foundation reports for inspiration Dneary 10:00, 10 March 2010 (UTC)
- membership / user accounts
- member satisfaction
- member recognition
- Not sure what you might want to quantitatively measure here - qualitative is hard to automate. Dneary 10:00, 10 March 2010 (UTC)
- mailing list subscriptions / participation
- Number of subscribers
- New subscriptions
- Departing subscribers
- contributor activity
- Wiki edits
- Talk posts
- Mailing list posts
- Code commits
- Bugzilla comments, bugs opened, bugs closed
- Monitoring (not exactly metrics, but related)
- Tracking press / blog / analyst mentions (more qualitative data)
- Dawn is working with Intel to get access to Radian6 for this data and plan to publish the output to the community.
Points to consider
- Reporting solution
- Report sharing methods
- Dashboard(s) for ongoing data reports (server health, member stats, bugs, app stats, etc) --Texrat 18:15, 10 March 2010 (UTC)
- Voluntary subscriptions (ie, RSS) for periodic public reports --Texrat 18:16, 10 March 2010 (UTC)
- Public vs Private data
References
Contributors
- Dawn Foster/dawnfoster - Intel's MeeGo community manager. I'm interested in helping out on a variety of community activities. I have past experience managing open source, developer and other types of online communities.
- Randall Arnold/Texrat - Maemo Community Council member, former Nokia QA engineer for Maemo devices, Data Analyst and best practices blogger. Ready to translate lessons learned from maemo.org and employment experience to whatever develops here!
- Dave Neary/dneary - Maemo docmaster, free software community "expert" (hate that word).