Metrics / Analytics
Let's have a conversation about what data we want to start tracking/measuring/looking at on Loomio and what the next steps are for harvesting this information and displaying it in an intuitive format.
What do we want to track?
These are metrics that can be tracked over time (as in, we could look at them on a graph with time as the x-axis). Please add anything you can think of to this list!
- User creates top level group
- User creates sub group
- User invites new person (not already signed up to loomio)
- User accepts invite
- User creates discussion
- User comments on discussion
- User visits discussion
- User votes on proposal
- Active Users (users who do any of the above)
- Active Groups (groups in which any of the above happen)
- Group size
Immediate tasks
- Improve CSV export on the admin panel
- Decide whether or not we are going to use Piwik (instead of Google Analytics). This will probably require taking a closer look at Piwik
- Decide whether or not we are going to use KISS Metrics
Simon is:
Running google metrics data through R to give us some sort of picture of the engagement pattern, group size effects etc. Due 21st October.
Matthew BartlettMon 15 Oct 2012 2:31AM
Feel like this could be good to work out in a RL meeting.
Jon LemmonMon 15 Oct 2012 6:24AM
@Matthew - fair enough. Although Ross is overseas, so you'll have to find a time to skype with him. I think engaging in here is probably a good start though.
vivien maidabornMon 15 Oct 2012 10:18PM
I am interested in measuring viral growth, how many people are added to a group after group is set up
How many people form a group start other groups
Paul SmithTue 16 Oct 2012 12:49AM
It's excellent we're looking at what we need to collect and I know it's what we're all already thinking anyway but while we're discussing it let's commit it to history:
We'll need a settings option to turn off tracking for an account or group specifically and to make sure users know that any information collected here is anonymously and exactly what it will be used for (improving the tool/community).
Obviously with public groups it's not going to be much of an issue but just want to make sure we're clear to users about what data we're collecting and why.
Jon LemmonWed 17 Oct 2012 12:45AM
Just had a conversation with Josh. He mentioned that "active users" is probably a good first metric to start tracking. Also that we could probably do it using ActiveAdmin (which is what we're using for our current admin panel) and eventually turn it into a Rails gem that could be re-used in other projects.
I also mentioned that putting KISS inside an open-source application could feel a bit strange, so it probably makes sense to not use it for now unless anyone has strong feelings otherwise.
Matthew BartlettWed 17 Oct 2012 7:57PM
From the Enspiral Yammer:
http://railscasts.com/episodes/378-fnordmetric
FnordMetric is a ruby gem that allows you to chart events in real time. This is great for keeping track of user activity in your Rails app as demonstrated in this episode.
Looks worth investigating.
Matthew BartlettWed 17 Oct 2012 8:28PM
From yesterday's meeting, my understanding is that our immediate priority is to produce reliable information about engagement — to help understand what makes groups succeed or fail with the tool; and to see if the improvements the dev team are making (http://loom.io/discussions/962) are helping or hurting engagement.
Ross EdwardsWed 17 Oct 2012 8:57PM
This sounds like a really good place to start. Its a challenging problem to solve actually and is something that should evolve as the application evolves.
Jon LemmonWed 17 Oct 2012 10:04PM
One metric that Simon mentioned for tracking engagement is number-of-group-members-that-visit-the-group / number-of-group-members. Could be on a daily basis.
Also, I'll have a look at that gem. Might be just what we need.
Joshua Vial ·Mon 15 Oct 2012 1:41AM
awesome - have added a few ideas on what to track.
I think the most important metrics to track are active users per week and also active groups per week. Ideally this would be displayed in a form where you can see % growth over period of time.
The other crucial figure is % engagement - every group should have a front and centre stat for what % of it's users engaged with loomio that week and admin should have a metric for the whole site.
I'm currently scheming on an extension which could plugin to active admin to do the active user stuff which would require minimal integration but would then be available for pretty much any other rails project out there and would love to see us build an engine others can use.