Loomio
Wed 2 May 2018 2:56PM

Proposal to take over a Mastodon hosting service, hosting external instances, but also to enable the creation of thematic sister coop-instances

MDB Mayel de Borniol Public Seen by 62

I've been put in touch with Alice, who runs the Mastodon hosting service https://maastodon.net (currently hosting 38 instances with 171,652 accounts, including the mothership instance https://mastodon.social) and wants to either find a way to share the workload, or transfer it to another person/group.

Of course, I suggested turning it into a co-op! And here's what she replied (and said I could share here to see if we might be interested):

I really like that model and can only wish MaaS becomes a coop.

Financially, the service is slightly profitable, the income over the previous two months was 182€ and 293€. The current servers cost 175€/month (209€ with taxes, it could be lowered with some changes)

Technically, it works okay but require constant attention (mostly for mastodon.social's traffic bursts).
It has some custom software that'd I'd be happy to continue working on, in a less pressured context, and see open-source. (i can't guarantee my time without a remuneration, but i would help the migration in any case). It's all already highly automated, including billing and instance setup. Given the right resources and maintenance/scaling it doesn't require much intervention except answering support tickets.

My main issue with it is that i can't healthily handle such pressure alone, i just feel more and more crushed by a thing that's visibly too heavy.

I think that while Alice might not have the energy to start up a co-op from scratch, she would probably be happy to transfer it to us (we'd give her something as a payout) and become a member of social.coop instead where she could be part of the soon-to-exist Tech Ops team.

It seems to me that this ties in perfectly with our bigger vision for social.coop from the beginning (creating a model for user-controlled social platforms, to then inspire/help others do the same). And now that we've reached 1000 members, the question of scaling is relevant, and I personally think horizontal scaling is preferable (for both technical and social reasons).

We could use a similar model as Q&A service StackExchange for creating new communities (see http://area51.stackexchange.com/faq) which could result in sister instances like art.social.coop, science.social.coop, or even aww.social rather than sticking with one increasingly noisy and general instance.

As for the external instances already hosted by Alice: https://maastodon.net/instances/ they could be a secondary source of funds for social.coop which would help remunerate the ever-more-needed Tech Ops team. Of course, we could then prod the instance admins to see about turning them into #platformcoops (or becoming sister instances of social.coop just like the hypothetical aww.social) Imagine announcing that mastodon.social is now a #platformcoop! It's no #BuyTwitter but still pretty cool :wink:

Another option, in case the whole social.coop collective doesn't want to take this on, woud be to create a small worker-coop to manage maastodon.net and possibly "outsource' the hosting/maintenance of social.coop to that coop.

I'm keen to hear what people think, especially those members for which this would mean extra labour (even though the beauty here is collectivisation of effort, it might be 2x more work to maintain 10 instances compared to 1, not 10x), and so will wait for some feedback before starting any polls.

RB

Robert Benjamin Wed 2 May 2018 4:34PM

Not sure the $4,000 figure is an accurate reflection of what the reserves actually are as a budget that captures all the expenses for sustainably running the platform as it scales has yet to be created. Living wage might not be attainable at the moment but a system for tracking critical admin hours and providing partial compensation should be.

RB

Robert Benjamin Wed 2 May 2018 4:17PM

Wow. This got traction fast.

Seems like potentially good idea and the direction social.coop was heading in.

I recommend we prioritize getting a few outstanding social.coop organizational changes in order ASAP while this conversation unfolds.

#1 - The Admin Ops discussion needs feedback so can be up for proposal vote. https://www.loomio.org/d/URY9AKci/creation-of-admin-ops-teams

#2 - A fully formed allocations based budget should be put in place to make sure that the base financial needs of the social.coop (including a funding for remuneration of operation critical admin duties) is provided for. Discussion in progress but needs feedback in order to create a proposal. https://www.loomio.org/d/cIA3pK4a/looking-at-the-long-term-financial-vitality-of-social-coop-

MN

Matt Noyes Wed 2 May 2018 4:19PM

This looks great! Helping move Mastodon in the direction of platform cooperativism would be a big step forward. Like I said elsewhere -- I feel like we need something like a retreat to discuss strategy for social.coop. Because it seems so great, and in the spirit of scientific inquiry, I would also like to hear from @mayel all the best arguments AGAINST this idea.

MC

Matthew Cropp Wed 2 May 2018 4:28PM

So I had actually been weighing the idea of going to a third-party for some of the hosting work as part of the Tech WG strategy, so this is a little different than what I'd imagined, but a very interesting opportunity.

My initial sense would not be for social.coop to take it over directly, but form it as a "shared services" co-op owned by the instances that use its services, with social.coop as a founding member. If we wanted to get more complex, it could make for a very interesting multi-stakeholder co-op model, with the staff owning one half of the hosting company, and the instances owning the other half (shared services co-op), but the "second-tier"/shared services model would probably be the simplest.

I'd be happy to get on a call to discuss options and possibilities, if @mayel can find a few dates/times that work for him and Alice and builds a schedule poll around them.

G

Graham Wed 2 May 2018 4:48PM

Does social.coop have a legal entity, or is it an unincorporated cooperative? (excuse my ignorance on this, I'm new here).

MDB

Mayel de Borniol Wed 2 May 2018 4:54PM

Unincorporated, but we have the ability to issue and pay invoices through our OpenCollective host acting as fiscal sponsor.

MN

Matt Noyes Wed 2 May 2018 4:56PM

That is in the process of changing now that we are in IoO and working with Sarapis.org @ntnsndr @thomasbeckett

MDB

Mayel de Borniol Wed 2 May 2018 4:58PM

Right, the fee will be 5% rather than 10%, but we'll retain the same abilities, correct?

MN

Matt Noyes Wed 2 May 2018 5:18PM

My understanding is free, but @ntnsndr has the latest info on the Sarapis front

MDB

Mayel de Borniol Wed 2 May 2018 5:19PM

IIRC currently OpenCollective takes 5% as a platform fee, plus 5% as "host fee" for the fiscal sponsorship.

ST

Sam Toland Wed 2 May 2018 7:01PM

You took the words out of my mouth. +1 to this.

AW

Aaron Wagener Thu 3 May 2018 5:26PM

I like the idea of social.coop "seeding" a new shared services cooperative to take on hosting. Starting a coop sounds like it could provide the right environment to solve the questions of how to pay people, make the decisions we have to make, and things like that. It would also mean that social.coop could spread the cooperative model, and participate democratically in decisions about the server, without centralizing power too much by taking over the servers of a bunch of other instances for itself.

JR

Jeremy Rose Sat 5 May 2018 2:17AM

I'm not a huge fan of the idea that a service can be owned by other services—I think the owners of any collective formed should be the humans running and/or using it.

MC

Matthew Cropp Mon 7 May 2018 2:06AM

Federations have one set of problems (alienation inherent to layered representative democracy), co-ops with beyond-human-scale memberships participating in mass democracy have a different set of governance challenges.

One approach might be to require instances hosted instances above a certain size (say, 1k members) to be run in alignment with the Cooperative Principles? So ownership and control of the network ultimately is structurally rooted in a broad base of people?

MDB

Mayel de Borniol Wed 2 May 2018 4:41PM

Welcome to @alice133 who is now on here! Would love to here your thoughts on the conversation, and please let us know if/when we can have a call or some other form of chat soon.

DU

Alice Wed 2 May 2018 4:52PM

I like what I've seen so far, it finally looks like a good future for MaaStodon.

MDB

Poll Created Wed 2 May 2018 5:12PM

A chat with Alice about MaaStodon Closed Fri 4 May 2018 10:39AM

Outcome
by Mayel de Borniol Fri 4 May 2018 10:44AM

Choosing Tuesday becomes it's one of the days that got most RSVPs (15 people) and key participants like @victormatekole can make it

I suggest we have a real time chat over text so more people can participate in the conversation and to help ease any language barriers, device/bandwidth limitations, etc. We could use our Matrix channel: https://riot.im/app/#/room/#SocialCoop:matrix.org

Results

UTC Votes MDB MN MC DM NP EM ST R MK DU TB G DU NS AW DVN CWF
Fri  4 May 2018  5:00PM
8
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Sat  5 May 2018  5:00PM
10
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Sun  6 May 2018  5:00PM
11
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Mon  7 May 2018  5:00PM
12
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Tue  8 May 2018  5:00PM
11
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
Thu  3 May 2018  5:00PM
7
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

18 of 91 people have participated (19%)

ST

Sam Toland Wed 2 May 2018 7:03PM

I'm not participating at this level of detail - but as an ordinary social.coop member, this is really interesting development! :) Good vibes sent your way. ;)

G

Graham Thu 3 May 2018 9:01AM

I'm with @samtoland on this one - I don't think I can usefully add value as a relative noob here. All I would say is be sure to do the due diligence stuff, whatever emerges.

DU

Deleted User Thu 3 May 2018 1:41PM

Mon 7 May 2018 5:00PM
Thu 3 May 2018 5:00PM

I don't see myself as essential, but happy to be involved if the timing coincides.

DVN

Dave V. ND9JR Thu 3 May 2018 9:33PM

Sat 5 May 2018 5:00PM
Sun 6 May 2018 5:00PM

Question: what time zone are these times for? I'm assuming UTC but I'd rather know for sure. It's an important detail that seems to have been left out of the poll description.

G

Graham Wed 2 May 2018 5:14PM

Timezone?

MDB

Mayel de Borniol Wed 2 May 2018 5:15PM

Loomio should be showing you the time in your timezone.

G

Graham Wed 2 May 2018 5:16PM

Neat

G

Glenn Wed 2 May 2018 6:05PM

Thought I should throw in my two cents since I rather accidentally backed into this :)

My thoughts:

  • I like the idea of having hosting run as a separate co-op or sub-co-op (if that is a thing)
  • It could definitely be a step toward #ReplaceTwitter (vs. Buy)
  • Keeping co-op members separate from regular clients is probably best as well
  • Definitely would want to put social.coop instance here (dog-fooding)
  • While this URL is set up for Mastodon, no reason the hosting coop can't expand to GNUsocial, Pleroma, etc. hosting - or any other hosting that makes sense for coop structures
  • This would help insulate this entity from issues if Eugen does something drastic or unexpected w/ Mastodon
  • Would be a natural for other *.social.coop instances, or even just *.coop
  • Definitely need to pay admins/devs - probably on contract basis for now, then utilize consultation or on-call structure after that
TB

Thomas Beckett Thu 3 May 2018 3:25AM

How can this be operated to pay people fairly? I could help develop financial projections. This might also be a good multistakeholder co-op, between worker/hosts and instance/hosted.

Is general server hosting a potential service offering, too?

EM

Erik Moeller Thu 3 May 2018 5:30AM

A few suggested operating principles for how such a project could work:

  • Critical system expenses (hosting, backups) are the top priority.
  • Fair remuneration of core sys admins for key administrative tasks (e.g., upgrades, installs) is the second priority.
  • As a whole, the platform should always invite volunteers, as per the existing initiative to create a volunteer ops team.
  • The co-operative should actively work to mitigate against technical over-centralization (e.g., all instances with the same hosting provider, same location). Replicating the setup with multiple hosting providers should be a medium term goal, to enable spreading out instances over multiple hosting providers, if this is not already the case.
  • The co-operative should give all instances the option to switch to a co-ownership model like social.coop, but this should not be required.
  • We are collaborators and should strive to help make meaningful connections between instances, to provide useful metadata to potential users, and so on. Shared resources like the social.coop wiki can be leveraged across participating instances.
  • Maastodon.net appears to have a solid policy against hate/harassment. It is imperative that this policy is maintained and enforced, including in public messaging. Indeed, ideally we would make it easy for instances to simply inherit a reasonable code of conduct as a starting point.

These are just some initial thoughts. I love the idea of a large synchronous conversation, though timing will be tricky for me if it's during my work week. :| In any event, this is the most exciting proposal I've read since joining social.coop. There are lots of things to figure out and absolutely risks to think through, but please please let's keep the positive momentum going. :)

NS

Nathan Schneider Thu 3 May 2018 4:51PM

This is very exciting. Thank you, @mayel! This is an opportunity to move the social.coop vision forward in showing how the co-op model can really super-power federated networks. However, the logistical issues at play here are quite considerable, and I worry that we're still struggling a bit to make our own small instance functional. This will require a rapid curve of professionalization and accountability—especially as it means switching from an affinity-based model to one that includes people who are not necessarily avid cooperators.

Nevertheless, I am extremely hopeful about this and believe it is an occasion we should make the effort to rise to!

I'm sorry I can't make any of those times for the call. But I'll be watching this thread enthusiastically. Please let me know how I can be of help.

MDB

Mayel de Borniol Fri 4 May 2018 5:46AM

@davevnd3jr Loomio should be showing the times in your local timezone

G

Graham Fri 4 May 2018 8:45AM

An option that should be on the table here is to partner with an existing tech co-op to help manage the infrastructure.

MDB

Mayel de Borniol Fri 4 May 2018 10:30AM

If anyone knows of such a tech co-op that may be interested, I'd be very happy to speak with them (about the SaaS, about the possibility of them doing the maintenance of social.coop's tech infrastructure, and about me and possibly Alice and others joining them ;)

MDB

Mayel de Borniol Fri 4 May 2018 10:30AM

Most of the tech worker coops I've seen seem to be groups of friends in one area rather than internet strangers...

G

Graham Fri 4 May 2018 10:41AM

In the US: https://techworker.coop might be of help.
In the UK: https://www.coops.tech
Elsewhere?
I'm thinking about this option primarily as a means of quickly bringing to bear some solid backing to support the work that yourself, Alice and others are doing, often on a volunteer basis.

DU

greg Tue 8 May 2018 2:58PM

what if we hosted it ourselves? for example, I have some servers sitting around in my room wasting 98% of their cycles, and I would love to put some of those to work. I'm sure other people have unused hardware sitting around too that they could either donate/sell to co-op and/or bring it with them when they join the smaller sysadmin workers coop and then manage it with everything else. we (should) own it!

MDB

Mayel de Borniol Tue 8 May 2018 2:59PM

@gregcerna what's your connectivity / bandwidth like?

MDB

Mayel de Borniol Tue 8 May 2018 3:01PM

I am now chatting with Chris from https://www.webarchitects.coop/ (I was put in touch by a mutual friend) about this option (of working with an existing tech workers coop for this)

DU

greg Tue 8 May 2018 3:08PM

300 mbps up and down, but I live in a housing cooperative, so I share that bandwidth with the rest of my housemates lol. it's just a residential connection but it's a solid one, and I've been running a toooon of services behind a reverse proxy for almost a year now, and my isp has yet to notice and doubt they would anytime soon. if that's not enough bandwidth, one of our other houses like two blocks away has a gigabit fiber connection (the lucky bastards) and it would be straightforward to move my machines there.

G

Graham Tue 8 May 2018 3:41PM

Say hi from me.

NS

Nathan Schneider Tue 8 May 2018 10:41PM

Web Architects seems like a great candidate for this, since they're already building out co-op cloud services like git.coop

LW

Liaizon Wakest Fri 4 May 2018 11:19AM

got an email that said the call is on monday the 7th. but then saw a comment that its happening on a tuesday, is this because of conflicting timezones? I am in berlin.

MDB

Mayel de Borniol Sat 5 May 2018 11:06AM

Not sure what happened but it should be 05/08 at 7:00pm, in Berlin, Germany.

SJK

Stephanie Jo Kent Sun 6 May 2018 12:23PM

Love it love it love it! Way to GO!

BH

Blake Haswell Tue 8 May 2018 11:01AM

I've been offline for a few days so I missed this, but this is a really exciting proposal. I agree with @matthewcropp's suggestion of seeding a "shared services" co-op—I think this would allow social.coop to focus on spreading the co-operative model, while allowing MaaStodon to focus on hosting.

MDB

Mayel de Borniol Tue 8 May 2018 3:51PM

So the chat about this proposal is happening on Matrix in about an hour. Alice from MaaStodon will be joining us, and maybe also Chris from https://www.webarchitects.coop/

There is a collaborative agenda that needs populating here: https://oasis.sandstorm.io/shared/l6owJmSrlcNlOGi1lr2npBMLxsLBLQQUhhLqL8RlKdo
18:48

It would be great if people (whether you can join the meeting or not) could add important points / questions / suggestions there so we can reduce the noise during the scheduled chat by following the agenda.

MN

Matt Noyes Tue 8 May 2018 9:00PM

Here is the agenda for the call, in an ODT doc.

MN

Matt Noyes Tue 8 May 2018 9:59PM

Couldn't figure out how to export the chat, so here's are the notes from our 5/8/2018 meeting.

MN

Matt Noyes Tue 8 May 2018 10:29PM

Gender check self-criticism -- the discussion participants were nearly all male, as far as I can tell. We need to be more intentional in our organizing of discussions.

NS

Nathan Schneider Tue 8 May 2018 10:42PM

Thank you for raising this.

D

Darren Wed 9 May 2018 12:18AM

I copy/pasted the chat into the attached .odt file also into the pad that was used for the agenda. I'm spreading this thread among co-op minded people who may have necessary tech skills

D

Darren Wed 9 May 2018 12:20AM

should note that its not at all clear when people were quoting others - so bear this in mind if reading

DU

greg Wed 9 May 2018 12:56AM

is there any way you could post the pdf version as well? my phone can't open odts. also, are we putting these in the wiki?

D

Darren Wed 9 May 2018 1:06AM

@gregcerna heres a pdf of the copy/pasted chat text from #socialcoop.matrix.org

MDB

Mayel de Borniol Thu 10 May 2018 1:12PM

Quick update - I'm gonna be posting an initial poll here based on the chat we had, but I first want to catch up on all the related discussions and proposals in Loomio (such as about Tech Ops team) in order to take those into acount in framing the proposal, so please bear with me!

MDB

Mayel de Borniol Thu 10 May 2018 1:13PM

By the way, some of these other proposal are happening in the various working groups, so for any members who are interested, you might want to join them to participate.

LW

Liaizon Wakest Thu 10 May 2018 8:42PM

which working groups are these proposals in? I can't find them

MDB

Mayel de Borniol Thu 10 May 2018 8:59PM

There are a few, I see one's in Governance, the other Finance, and maybe more.

LW

Liaizon Wakest Sat 12 May 2018 7:41PM

so quick update: Eugene is moving mastodon.social off of being hosted by maastodon. So the main instance that we would be taking over control of is no longer present. Has this conversation gone elsewhere? seemed to die after the group chat....

DU

Alice Mon 14 May 2018 1:21PM

I can confirm Mastodon.social has now moved to their own servers.
It did get quiet since the group chat; I'd love to see some development before the end of the month.

N

Neil - @neil@social.coop Mon 14 May 2018 5:24PM

I missed all of this while away of holiday, it's a really exciting prospect! Just now trying to catch up on the backlog.

DU

Alice Tue 15 May 2018 6:05PM

MaaStodon is effectively closed, it shouldn't change much related to this discussion, but for the time i will be responsible of it it will stay in that state.

ES

Ed Summers @edsu Wed 16 May 2018 3:59PM

I wasn't part of the call, and so perhaps I don't fully understand the proposal, but I personally don't want to support a large instance of users (e.g. Octodon) who are not themselves contributing to the coop. I would prefer to see us grow social.coop organically, and go through the technical and administrative growing pains, without doing a big infusion of users which could amplify some of the problems we will encounter. Bigger is not better.

ELP

Edward L Platt Wed 16 May 2018 4:28PM

I feel the same way. It could be nice to have multiple cooperative instances either under the social.coop group or (organizationally) federated and invite other instances to join if they're using a cooperative model. If octodon.social was interested in moving to a coop model, I'd be happy to help them with the transition.

DU

Alice Wed 16 May 2018 4:56PM

As I understood it, hosting other instances as a commercial service would benefit the coop by funding the infrastructure (and potentially more), while being able to host other coop instances.

ES

Ed Summers @edsu Wed 16 May 2018 6:21PM

I think I like the proposal even less now. I didn't get into social.coop to help start a business.

MN

Matt Noyes Wed 16 May 2018 6:57PM

I like Alice's understanding; it is a bit more like a workers coop or producers coop model than a consumer coop model. The big cost, in time, skill, and money, is the hosting and admin. It makes sense to pool instances to economize, rather than each instance try to solve that problem. It also makes sense to make that hosting and admin cooperative -- something we can do, and from which we benefit.

ES

Ed Summers @edsu Wed 16 May 2018 7:36PM

It seems to me that the big assumption being made here is that pooling resources is going to make things easier--that economies of scale are going to kick in when we are managing 100 instances with 100,000 users instead of 1 instance with 1000 users. That seems pretty debatable if you ask me.

I would prefer to see social.coop focus on getting one instance working with a team of co-op member admins with a code of conduct folks can live with, and work from there instead of trying to manage the complexity of multiple communities, with different values, all using the same infrastructure.

RB

Robert Benjamin Wed 16 May 2018 8:58PM

Though I do believe a degree of economies of scale is beneficial and feel Social.coop can and should facilitate many different actives where ever there is enough member support and will to voluntarily manage, I'm completely on board with your prioritization of activities (especially involving funds) around making this instance operationally sustainable. There is a in-depth discussion inside of the Finance working around with some ideas that I believe could accomplish both. Would love to have others weigh in.

As far growing social.coop to a stage where it had 1000 paying members I think that would be an amazing goal and achievement. Currently we have around 150 paying members, 1000 registered users, an unknown amount of them active.

ST

Sam Toland Thu 17 May 2018 10:04AM

I think we should give @mayel, @alice133 and Co. the space to develop their proposal - and the pros and cons for social.coop, the scalability of social.coop and Mastodon and the spreading of co-operative governance to the Mastodon eco-system more generally.

I think at that point we can have a more grounded conversation about what role social.coop could/should have in it. Until then, we get into the dangerous territory of discussing a proposal without any concrete facts.

@mayel are you guys coming towards some sort of working proposal for how things would operate etc.?

If I were you guys - I would also craft your proposal so that it wasn't just dependent on social.coop (the hosting co-op could be a viable option with our without social.coop's immediate participation). :)

And props again for even considering this @mayel and @alice133 - and for doing the thinking work on it. I'm very inspired.

MDB

Mayel de Borniol Thu 17 May 2018 10:20AM

Thanks @samtoland :)

I personally haven't had much time to think about this or discuss it further since the big chat-up the other week (things have been crazier than usual, as I'm in the middle of taking on a new gig). I also haven't had time to catch up on other possibly related discussions on Loomio.

I still think there's something to this (maybe as a new workers co-op or multi-stakeholder co-op separate to the main social.coop - or by combining our forces with an existing co-op like Webarchitects if they're willing), and that it could help solve many pain points for social.coop, for @alice133, and for @victormatekole and I. For that to be the case though, it seems we'd need some new people who have the time/energy to step up and help make it happen, and also help with operations/sysadmin of the new organisation in an ongoing way, as it seems most of the existing people are a combination of busy and burned out.

CCC

Chris Croome (Webarchitects Co-operative) Thu 17 May 2018 11:56AM

Hi, regarding Mayel's post:

I still think there's something to this (maybe as a new workers co-op or multi-stakeholder co-op separate to the main social.coop - or by combining our forces with an existing co-op like Webarchitects if they're willing), and that it could help solve many pain points for social.coop, for @alice133, and for @victormatekole and I.

We are definitely interested in exploring this further as and when it is suitable to do so. It does take quite a lot of time and energy to setup and maintain co-operatives and if we can save some effort and help the project continue and make it sustainable then we would be happy to help.

MN

Matt Noyes Thu 17 May 2018 4:06PM

I think where we stand is that social.coop needs to a) find consensus in our current discussions of organization (operations teams) and financing, b) get the tech ops team/working group organized, so that the work can be spread and coordinated, and then c) come back to this really important discussion. So, I hope Alice and Chris will not give up on us.