Loomio
Wed 25 Nov 2015 1:05AM

UX: Engaging people with notification emails without overwhelming them with noise

RDB Richard D. Bartlett Public Seen by 323

Updated March 9th- next iteration ready for feedback: https://goo.gl/7mjyQv


Original context, November 25th

Notification emails are critical for engaging people: 40% of all traffic to loomio.org comes from emails generated by activity in app.

At the same time, we know that sending too many emails is irritating, and causes people to disengage.

We’ve put a lot of energy into navigating this balance, and we’ve got a really powerful system, once you understand how to use it. The problem is, it takes a huge effort to figure out how it works!

When it comes to email, people’s preferences and needs are really different.

If the default settings are ‘too quiet’, Loomio feels like an empty room: you raise an idea and nobody responds. If the default settings are ‘too loud’, it feels really intimidating to speak up, because you know that your idea is going to be broadcast to every single person in your group.

Either way, the consequence is that people are discouraged from contributing :(

The challenge

The defaults need to work well for people that are not likely to get in and change their settings.

Once you decide to alter your settings, they need to be intuitive and easy to configure.

## How Loomio’s email settings currently work

Right now, when you first join a Loomio group, you’ll get a bunch of emails:

  • Whenever someone starts a thread you will be notified immediately.
  • If you participate in the thread, or if someone @mentions you, you will be emailed notifications of subsequent activity in that thread.
  • You will be emailed when someone starts a proposal, when it is about to close, and when a proposal outcome is published.
  • You will be emailed if someone @mentions you in a comment, or if their comment is posted in reply to yours.
  • You will receive the ‘Yesterday on Loomio’ summary email each morning, which contains all of yesterday’s activity that you haven’t read yet.

The great thing is you can reply directly to any of these emails (excluding the summary email), and your comment will be added to the thread.

Changing these settings is kinda painful

If you want to change any of that behaviour, there’s quite a lot to learn.

First, you can go to your email settings page to change these settings at a global level.

Email settings page

You could be a member of a bunch of groups. Maybe one is really important, and another one you don’t care about so much. To accommodate this, you can have different email settings for different groups: you can go to the group page and choose to be emailed about all activity, just new threads and proposals, or nothing.

Similarly, you can configure your email settings for specific threads.

(Note, this all applies to the new Loomio interface. The old beta interface has similar behaviour, but it is described with different language.)

Design ideas

Right now, there are couple of big ideas I want to explore:

  • Set loud defaults to engage new members, and make it really easy for them to turn the volume down when they arrive.
  • Give the speaker and the audience control over the volume: start a quiet thread, or make an announcement.

Make it easy to turn the volume down

Let’s assume that we change the defaults, so when you first join Loomio, you get an email every time there is new activity in your group. (You’ll notice a lot of other tools do this, as it helps people build a new habit.)

With luck, your group gets really engaged, and there’s heaps of activity. At this point, you’re thinking, “wow it’s cool that I can be involved in decisions without going to a meeting, but sheish Loomio sends so many emails! There must be a way to turn that off!”

Then without having to hunt for it, you see a really obvious button to change your emails settings. You open the email settings form, read it for a few seconds and think ‘yeah, makes sense’. You tick a few boxes and get on with your life, never having to worry about it again. Aaaaah, email freedom.

The devil is in the details so I’m going to draw some picture to illustrate this story. I’m keen to hear other stories and see other pictures too, so feel free to share in this thread :)

Give the speaker and the audience control over the volume

At the moment, the “volume” is totally up to the the audience to control: you change your email settings to configure how much email you receive. I reckon it might be useful to also give some control to the speaker.

Imagine you want to discuss an idea, but you’re not ready to announce it to everyone in your group: it would be cool if you could start the thread quietly, and bring people in gradually.

Or maybe you have an announcement that is really important for everyone in your group to hear about. Wouldn’t it be cool if you could guarantee that everyone is going to receive it?

Maybe someone wants to draw some pictures for this idea too :P

Share what you know

So I’m wondering: how do you use Loomio email settings? What frustrations do you have? What works really well for you?

Thinking about other tools you use - where have you seen the email settings work really well? How have they solved this challenge?

AR

A. Renato
Agree
Wed 9 Mar 2016 3:59PM

Some issues are well addressed; an option for coordinators 'control' the e-mail notifications of their groups and members would make some of the pain be relieved.

RG

Robert Guthrie
Agree
Wed 9 Mar 2016 7:31PM

I love this iteration.

GC

Greg Cassel
Agree
Thu 10 Mar 2016 5:56AM

Fine progress!

G

GasparI
Agree
Thu 10 Mar 2016 2:11PM

I like these changes.

AI

Alanna Irving
Agree
Thu 10 Mar 2016 8:08PM

great step in the right direction. also love the small improvements people are suggesting as part of this process. yay collaboration!

GP

Genevieve Parkes
Agree
Thu 10 Mar 2016 9:21PM

Some great and careful thinking here, I would like clarification about the daily digest email eg if I choose not to receive emails about a group/thread, does activity still show in my digest email? It's not quite clear from this proposal, thanks!

DU
Vote removed
MI

mix irving
Abstain
Fri 11 Mar 2016 8:32PM

I don't find email notifications useful. Hope this goes well for others though

S

Simon
Agree
Sat 12 Mar 2016 10:31PM

I agree this is an area that needs improvement and think you should give the proposed changes a go. I appreciate being able to see the the problem definition and analysis. The proposed changes seem consistent with these and they make sense to me.

BK

Benjamin Knight
Agree
Sun 13 Mar 2016 8:23PM

As someone who uses email notifications all the time, I really appreciate the thought that's going into this

RDB

Poll Created Wed 9 Mar 2016 1:55AM

I’ve reviewed the proposed changes to the email settings and provided feedback Closed Sun 13 Mar 2016 9:08PM

Outcome
by Richard D. Bartlett Mon 27 Feb 2017 10:21PM

Thanks for the feedback everyone! I have updated the designs with some language tweaks.

I expect this will be built and deployed by the end of the week :four_leaf_clover:

We’ve designed the next iteration of the Loomio email settings:
https://goo.gl/7mjyQv

Before we build this, it would be great to hear from more people:

  • do you agree with the problems named in the design doc?
  • do you have other problems with Loomio emails that aren’t named here?
  • looking at the new settings page and modals, do you understand the options?
  • are you confident you could configure your email settings to behave the way you want them to?
  • is the language clear?

Please ‘agree’ on this proposal once you’ve reviewed and given feedback :heart:

Note: unfortunately this design process is not fully accessible to people who are blind as it relies on visual mockups. We’ll be working separately with an expert to confirm the accessibility of the new software development though.

Results

Results Option % of points Voters
Agree 94.4% 17 RG AI BK S T GP JD DU BB JK AR GR GC JCG CYK G
Abstain 5.6% 1 MI
Disagree 0.0% 0  
Block 0.0% 0  
Undecided 0% 882 RDB KC NW CWH BH JG RW MS G N HM C SZ CR J PS N KA ML KA

18 of 900 people have participated (2%)

GR

Gina Rembe
Agree
Wed 9 Mar 2016 2:16AM

focused on the 'Mute' one

DU

Deleted account
Agree
Wed 9 Mar 2016 3:47AM

A lot of thought has gone into this and I think it will be much clearer for new users.

AR

A. Renato
Agree
Wed 9 Mar 2016 3:59PM

Some issues are well addressed; an option for coordinators 'control' the e-mail notifications of their groups and members would make some of the pain be relieved.

RG

Robert Guthrie
Agree
Wed 9 Mar 2016 7:31PM

I love this iteration.

GC

Greg Cassel
Agree
Thu 10 Mar 2016 5:56AM

Fine progress!

G

GasparI
Agree
Thu 10 Mar 2016 2:11PM

I like these changes.

AI

Alanna Irving
Agree
Thu 10 Mar 2016 8:08PM

great step in the right direction. also love the small improvements people are suggesting as part of this process. yay collaboration!

GP

Genevieve Parkes
Agree
Thu 10 Mar 2016 9:21PM

Some great and careful thinking here, I would like clarification about the daily digest email eg if I choose not to receive emails about a group/thread, does activity still show in my digest email? It's not quite clear from this proposal, thanks!

DU
Vote removed
MI

mix irving
Abstain
Fri 11 Mar 2016 8:32PM

I don't find email notifications useful. Hope this goes well for others though

S

Simon
Agree
Sat 12 Mar 2016 10:31PM

I agree this is an area that needs improvement and think you should give the proposed changes a go. I appreciate being able to see the the problem definition and analysis. The proposed changes seem consistent with these and they make sense to me.

BK

Benjamin Knight
Agree
Sun 13 Mar 2016 8:23PM

As someone who uses email notifications all the time, I really appreciate the thought that's going into this

RDB

Richard D. Bartlett Wed 9 Mar 2016 1:57AM

@ginarembe I'd love to hear if these proposed changes will fix the frustrations you've experienced!

JCG

Josir Cardoso Gomes Wed 9 Mar 2016 2:28PM

Hi folks, all suggestion are great and it will help a lot.

Today I admin a group of 600 activists and the major complaint is that they don't know how to stop the emails.

And I have to answer one by one, teaching them how to turn off the email notification :(((

So I have just one suggestion: the default "Mute" option for a group. This would be a group attribute that implements the following logic:

  • if this option was checked by admin, all new group users will enter in mute mode, that is, they will not receive any emails at all.
RDB

Richard D. Bartlett Wed 9 Mar 2016 8:21PM

Sorry about the frustration @josircardosogomes :(((

I hope this fixes it! Thanks for your cool suggestion too.

G

GasparI Thu 10 Mar 2016 2:09PM

Hi! This is a really fine proposal and discussion!
@richarddbartlett just one remark:
"Set loud defaults to engage new members" - being too pushy is just as bad as being too shy :)
I would give an explicit choice to users at registration or start from a medium level (e.g. daily digest from the areas of interest).

RDB

Richard D. Bartlett Thu 10 Mar 2016 6:44PM

Thanks for the support and extra feedback too :)

Regarding your suggestion: if I were redesigning the group-joining process, my priority would be to explain the group's code of conduct to the new member, and invite them to consent to it before proceeding. This is a feature that a lot of experienced facilitators have been pleading for.

Perhaps we could include a 'set your email preferences' step at that point too, though I wonder if it will be a bit premature for the average user. They don't have context for how useful or not those emails are going to be yet.

I wonder if we could achieve a similar thing to what you're proposing, with a pop-up that appears the first time you participate in a thread. Something like: "Thanks for participating! We'll send you an email with any further activity so you don't miss out. If that sounds annoying, [go here] to change your email preferences."

What do you think?

G

GasparI Thu 10 Mar 2016 8:29PM

This would be a welcomed proactive measure - clear expectations and ground rules are top enablers for effective collaboration.
If I had to describe an intelligent design I would say: it foresees the majority of common issues and pain points and address them before they become pain :)

DS

Danyl Strype Fri 11 Mar 2016 3:42AM

I think @alanna 's comment is relevant here, whether emails are useful depends a lot on why a group has chosen to start using Loomio. If it's to move discussions out of their inbox to somewhere they can go when they want to engage with their group, a default that sends a bunch of email will be annoying. If they are coming from FarceBook, and they've adopted Loomio because they want a more email list style of interaction, then not getting any email by default will be annoying. I can see why its been a challenge to find a happy medium :smiley:

I think Loud/ Quiet/ Mute options, per-group and per-thread, are a big improvement on the sea of check-boxes required to give that kind of granular control. I really like having these controls on group/ thread pages, and at the bottom of each email, as well as an email control dashboard that controls emails across my whole account. I think giving each new user an option to set their account to Loud/ Quiet/ Mute, with some explanation of the resulting experience and reassurance that these options can be changed both globally and per-group/ per-thread would really help address the needs of different groups coming to Loomio group different reasons.

GC

Greg Cassel Fri 11 Mar 2016 3:53AM

if I were redesigning the group-joining process, my priority would be to explain the group's code of conduct to the new member, and invite them to consent to it before proceeding.

Hear hear!

RDB

Richard D. Bartlett Thu 10 Mar 2016 9:59PM

Excellent point @genevieveparkes, I will have a go at incorporating that too :)

GP

Genevieve Parkes Thu 10 Mar 2016 10:15PM

Cool, it's not so much in the scope of this proposal, but I've often thought I'd like the option to relegate certain convos to a weekly digest email if there was one.

AR

A. Renato Fri 11 Mar 2016 6:47AM

@richarddbartlett is in tune with @gregorycassel's newest paper :thumbsup:

RDB

Richard D. Bartlett Sun 13 Mar 2016 7:42PM

Just want to say thanks everyone for your constructive feedback. Makes me feel a lot more confident in this change.

I'm looking forward to opening up some more exciting feature design discussions with y'all soon :)

ME

Marianne Elliott Sun 13 Mar 2016 9:05PM

Looks like I missed the window for this. I think it looks great, but may still need some help to manage overall email inundation :-)

DU

Deleted account Mon 14 Mar 2016 12:03AM

Delighted to meet Richard (in 3D) on Friday and he asked for a quote to here it is.

"If I log in to Loomio and make the reply from there then there is no record in my email history and I have to log in to Loomio to see it. It might be helpful for Loomio to include your own postings so that when you look at the thread in the "Yesterday on Loomio" the full discussion is there in front of you. Otherwise they might as well just say - "There was some discussion yesterday so go onto Loomio and have a look at it". There is probably a downside to this idea that I haven't thought of. It is all a bit complicated trying to keep track of everything."

I have some sympathy for the suggestion.