(Initial page) |
(categorise) |
||
| (One intermediate revision not shown) | |||
| Line 1: | Line 1: | ||
| - | = Reputation and Karma in MeeGo = | + | == Reputation and Karma in MeeGo == |
| - | This page describes the proposed metrics to be used for tracking individuals' contributions to MeeGo. | + | This page describes the proposed metrics to be used for tracking individuals' contributions to MeeGo. This is related to, but separate from, the project metrics discussed in [[Metrics]]. |
| - | = Goals = | + | == Goals == |
The initial goal is to define a set of metrics which reflect a user's participation in various parts of the MeeGo community (for example, platform development, application development, documentation, tutorials, QA, translation, user assistance, bug reporting). These metrics are called "reputation metrics". | The initial goal is to define a set of metrics which reflect a user's participation in various parts of the MeeGo community (for example, platform development, application development, documentation, tutorials, QA, translation, user assistance, bug reporting). These metrics are called "reputation metrics". | ||
| Line 12: | Line 12: | ||
* The metrics should be calculatable, automatically, either in real-time or on a daily basis. | * The metrics should be calculatable, automatically, either in real-time or on a daily basis. | ||
| - | |||
* The metrics should avoid, where possible, incentivising perverse or not-useful behaviour. | * The metrics should avoid, where possible, incentivising perverse or not-useful behaviour. | ||
| - | |||
* The metrics should attempt to measure "value", not just "volume". | * The metrics should attempt to measure "value", not just "volume". | ||
| - | |||
* The metrics should value recent contributions more heavily than older contributions. | * The metrics should value recent contributions more heavily than older contributions. | ||
| - | |||
* The metrics should be reasonably non-controversial. | * The metrics should be reasonably non-controversial. | ||
| Line 29: | Line 25: | ||
* The metrics are primarily intended to give an ordering and do not have to be linear (so if I have a metric of twice yours it does not mean I am twice as valuable as you). | * The metrics are primarily intended to give an ordering and do not have to be linear (so if I have a metric of twice yours it does not mean I am twice as valuable as you). | ||
| - | = People = | + | == People == |
Reputation metrics should be tracked for everyone who has a meego.com account. Some systems do not require a meego.com account (e.g. mailing lists): in these cases, non meego.com account holders will mot have metrics. For each reputation area, the mechanism of relating users to meego.com accounts needs to be worked out (especially if it is not just as simple as "log in with a meego.com account"). | Reputation metrics should be tracked for everyone who has a meego.com account. Some systems do not require a meego.com account (e.g. mailing lists): in these cases, non meego.com account holders will mot have metrics. For each reputation area, the mechanism of relating users to meego.com accounts needs to be worked out (especially if it is not just as simple as "log in with a meego.com account"). | ||
| - | = Reputation areas = | + | == Reputation areas == |
The remainder of this page is divided up into a section for each separate reputation area. | The remainder of this page is divided up into a section for each separate reputation area. | ||
| Line 39: | Line 35: | ||
Each area is proposed, along with a proposal for how the metric should be calculated. Other information may include how a similar metric is calculated in Maemo or any other project and/or what data is available from the software which handles that area. How users are identified should also be described here unless it is obvious. | Each area is proposed, along with a proposal for how the metric should be calculated. Other information may include how a similar metric is calculated in Maemo or any other project and/or what data is available from the software which handles that area. How users are identified should also be described here unless it is obvious. | ||
| - | == Blog posts == | + | === Blog posts === |
Metric is dependent on number of votes received. | Metric is dependent on number of votes received. | ||
| Line 47: | Line 43: | ||
In Maemo, the equivalent karma contribution is 1-10, depending on the number of votes. | In Maemo, the equivalent karma contribution is 1-10, depending on the number of votes. | ||
| - | == Applications == | + | === Applications === |
Measuring the value of applications. Note that the intent is that each author/maintainer, as well as the packager gets credit for the app (it is not divided between them). | Measuring the value of applications. Note that the intent is that each author/maintainer, as well as the packager gets credit for the app (it is not divided between them). | ||
| Line 57: | Line 53: | ||
As it stands, this metric does not degrade over time. If we wish to encourage regular updates then "months since last update" can be a divisor. However, it is assumed that applications which need updates but do not receive them will gradually get marked down and that applications which do one thing well, and do not need further updates, should not be penalised. | As it stands, this metric does not degrade over time. If we wish to encourage regular updates then "months since last update" can be a divisor. However, it is assumed that applications which need updates but do not receive them will gradually get marked down and that applications which do one thing well, and do not need further updates, should not be penalised. | ||
| - | == Development discussions == | + | === Development discussions === |
Contributions to discussions on meego mailing lists (which are primarily focused on development topics). | Contributions to discussions on meego mailing lists (which are primarily focused on development topics). | ||
| Line 67: | Line 63: | ||
As it stands, this does not degrade over time. An alternative metric would be: (yesterday's metric * 0.99) + today's posts. | As it stands, this does not degrade over time. An alternative metric would be: (yesterday's metric * 0.99) + today's posts. | ||
| - | == Bugzilla == | + | === Bugzilla === |
Reporting or commenting on bugs. | Reporting or commenting on bugs. | ||
| Line 75: | Line 71: | ||
In Maemo, the equivalent karma contributions are: 6 * sqrt(# bugs reported), sqrt(# bug comments) | In Maemo, the equivalent karma contributions are: 6 * sqrt(# bugs reported), sqrt(# bug comments) | ||
| - | == Forum == | + | === Forum === |
Contributing to discussions on the forum, which are typically community or application development related. | Contributing to discussions on the forum, which are typically community or application development related. | ||
| Line 83: | Line 79: | ||
In Maemo, the equivalent karma contributions are: 8 * sqrt(# thanks), sqrt(# posts) | In Maemo, the equivalent karma contributions are: 8 * sqrt(# thanks), sqrt(# posts) | ||
| - | == Wiki == | + | === Wiki === |
Contributing to Wiki pages. It is hard to measure the value of each contribution, so the metric is kept simple. | Contributing to Wiki pages. It is hard to measure the value of each contribution, so the metric is kept simple. | ||
| Line 91: | Line 87: | ||
In Maemo, the equivalent karma contribution is: 6 * sqrt(# edits) | In Maemo, the equivalent karma contribution is: 6 * sqrt(# edits) | ||
| - | = Future items = | + | == Future items == |
These areas may be relevant in the future (they are mostly things which exist in the Maemo karma system). However, they are not proposed for the initial set of metrics. | These areas may be relevant in the future (they are mostly things which exist in the Maemo karma system). However, they are not proposed for the initial set of metrics. | ||
| - | == Community news == | + | === Community news === |
Commenting on or voting for news items. | Commenting on or voting for news items. | ||
| Line 103: | Line 99: | ||
In Maemo, the equivalent karma contributions are: 2 * sqrt(# comments) and 0.25 * sqrt(# thumbs) | In Maemo, the equivalent karma contributions are: 2 * sqrt(# comments) and 0.25 * sqrt(# thumbs) | ||
| - | == Application testing == | + | === Application testing === |
Testing community applications. | Testing community applications. | ||
| Line 111: | Line 107: | ||
In Maemo, the equivalent karma contribution is: 0.5 * # thumbs | In Maemo, the equivalent karma contribution is: 0.5 * # thumbs | ||
| - | == Brainstorm == | + | === Brainstorm === |
If a brainstorm process is adopted then some variant on the Maemo karma metric might be used. The maemo karma contribution is 5 for idea under vote or in development, 10 for implemented idea, 2 for solution under vote or in development, 10 for implemented solution. | If a brainstorm process is adopted then some variant on the Maemo karma metric might be used. The maemo karma contribution is 5 for idea under vote or in development, 10 for implemented idea, 2 for solution under vote or in development, 10 for implemented solution. | ||
| + | |||
| + | [[Category:Community]] | ||
Contents |
This page describes the proposed metrics to be used for tracking individuals' contributions to MeeGo. This is related to, but separate from, the project metrics discussed in Metrics.
The initial goal is to define a set of metrics which reflect a user's participation in various parts of the MeeGo community (for example, platform development, application development, documentation, tutorials, QA, translation, user assistance, bug reporting). These metrics are called "reputation metrics".
The initial goals do not include trying to combine these metrics into a single "karma" measure.
There are several desirable attributes for the reputation metrics:
Not all these attributes will be achievable for each metric.
Some non-goals:
Reputation metrics should be tracked for everyone who has a meego.com account. Some systems do not require a meego.com account (e.g. mailing lists): in these cases, non meego.com account holders will mot have metrics. For each reputation area, the mechanism of relating users to meego.com accounts needs to be worked out (especially if it is not just as simple as "log in with a meego.com account").
The remainder of this page is divided up into a section for each separate reputation area.
Each area is proposed, along with a proposal for how the metric should be calculated. Other information may include how a similar metric is calculated in Maemo or any other project and/or what data is available from the software which handles that area. How users are identified should also be described here unless it is obvious.
Metric is dependent on number of votes received.
Metric: Sum of ( number of votes received / number of months since posting )
In Maemo, the equivalent karma contribution is 1-10, depending on the number of votes.
Measuring the value of applications. Note that the intent is that each author/maintainer, as well as the packager gets credit for the app (it is not divided between them).
Metric: Sum of ( number of stars received )
In Maemo, the equivalent karma contribution is 7 * (1 + stars per application).
As it stands, this metric does not degrade over time. If we wish to encourage regular updates then "months since last update" can be a divisor. However, it is assumed that applications which need updates but do not receive them will gradually get marked down and that applications which do one thing well, and do not need further updates, should not be penalised.
Contributions to discussions on meego mailing lists (which are primarily focused on development topics).
Metric: Number of posts
In Maemo, the equivalent karma contribution is 2 * sqrt(# posts).
As it stands, this does not degrade over time. An alternative metric would be: (yesterday's metric * 0.99) + today's posts.
Reporting or commenting on bugs.
Metric: (6 * Number of bug reports opened over last 12 months) + Number of bug comments written over last 12 months
In Maemo, the equivalent karma contributions are: 6 * sqrt(# bugs reported), sqrt(# bug comments)
Contributing to discussions on the forum, which are typically community or application development related.
Metric: (8 * Number of thanks for posts written over last 6 months) + (Number of posts over last 6 months)
In Maemo, the equivalent karma contributions are: 8 * sqrt(# thanks), sqrt(# posts)
Contributing to Wiki pages. It is hard to measure the value of each contribution, so the metric is kept simple.
Metric: Number of edits over last 12 months
In Maemo, the equivalent karma contribution is: 6 * sqrt(# edits)
These areas may be relevant in the future (they are mostly things which exist in the Maemo karma system). However, they are not proposed for the initial set of metrics.
Commenting on or voting for news items.
Metric: (4 * Number of comments) + Number of thumbs (up or down)
In Maemo, the equivalent karma contributions are: 2 * sqrt(# comments) and 0.25 * sqrt(# thumbs)
Testing community applications.
Metric: Number of thumbs
In Maemo, the equivalent karma contribution is: 0.5 * # thumbs
If a brainstorm process is adopted then some variant on the Maemo karma metric might be used. The maemo karma contribution is 5 for idea under vote or in development, 10 for implemented idea, 2 for solution under vote or in development, 10 for implemented solution.