updating to 0.5.0.1

We went below 2MB. So after talking with @manukrishnantv I've stopped the diaspora service.

@amardeepsingh , what's up?

I have no idea how much pressure the guys behind Facebook, etc would be taking when the site goes down. LoL.

@akshay @praveenarimbrathod I am away as well for couple of days. My public is attached, as soon as I get access I'll try to sort something out with minimal disruption.

@praveenarimbrathod @akshay @amardeepsingh Apparently the server was so high it wouldn't even hold Amardeep's key :)

I've added the key after removing some old packages found in /var/cache/apt/archives. Please see if you can login @amardeepsingh.

/usr/share is 2.2G with package files that is not relevant to server. Like so many gnome directories, libreoffice, gimp and cheese. We have some space there.

Edit. Thought its a good idea to comment out login/sign-up links from home page to avoid 404 and replace with a maintenance message. Done that.

Remove gimp, libreoffice etc and start diaspora service.

Nice catch @fayadfami !
I've just done apt-get remove gimp and apt-get autoremove (which apparently removed libreoffice too :D)
We have 155M now

Removed that maintenance message from home page and re-enabled login links.

Some other packages like brasero, imagemagick, evolution, gnome games, documents removed to free up 15MB.

And inkscape - 64MB.

I'm gonna run the following commands, please review.

sudo apt-get --purge remove \
bluez \
bluez-alsa:amd64 \
bluez-cups \
bluez-gstreamer \
brasero \
brasero-cdrkit \
brasero-common \
browser-plugin-gnash \
cheese-common \
espeak-data:amd64 \
evince \
evince-common \
evolution \
evolution-common \
evolution-data-server \
evolution-data-server-common \
evolution-indicator \
evolution-plugins \
firefox \
firefox-locale-en \
folks-common \
fontconfig \
fontconfig-config \
fonts-cantarell \
fonts-dejavu-core \
fonts-freefont-ttf \
fonts-lyx \
fonts-opensymbol \
foomatic-db \
foomatic-db-engine \
four-in-a-row \
gcalctool \
gedit \
gedit-common \
gedit-plugins \
genisoimage \
geoclue \
gettext-base \
ghostscript \
ghostscript-x \
gimp-help-common \
gimp-help-en \
gir1.2-appindicator3-0.1 \
gir1.2-atk-1.0 \
gir1.2-atspi-2.0 \
gir1.2-clutter-1.0 \
gir1.2-clutter-gst-2.0 \
gir1.2-cogl-1.0 \
gir1.2-coglpango-1.0 \
gir1.2-dbusmenu-glib-0.4 \
gir1.2-dee-1.0 \
gir1.2-evince-3.0 \
gir1.2-freedesktop \
gir1.2-gconf-2.0 \
gir1.2-gdata-0.0 \
gir1.2-gdesktopenums-3.0 \
gir1.2-gdkpixbuf-2.0 \
gir1.2-ges-1.0 \
gir1.2-glib-2.0 \
gir1.2-gmenu-3.0 \
gir1.2-gnomebluetooth-1.0 \
gir1.2-gnomedesktop-3.0 \
gir1.2-gnomekeyring-1.0 \
gir1.2-goa-1.0 \
gir1.2-gst-plugins-base-1.0 \
gir1.2-gstreamer-1.0 \
gir1.2-gtk-3.0 \
gir1.2-gtkclutter-1.0 \
gir1.2-gtksource-3.0 \
gir1.2-gucharmap-2.90 \
gir1.2-gudev-1.0 \
gir1.2-javascriptcoregtk-3.0 \
gir1.2-json-1.0 \
gir1.2-notify-0.7 \
gir1.2-packagekitglib-1.0 \
gir1.2-panelapplet-4.0 \
gir1.2-pango-1.0 \
gir1.2-peas-1.0 \
gir1.2-rb-3.0 \
gir1.2-rest-0.7 \
gir1.2-rsvg-2.0 \
gir1.2-soup-2.4 \
gir1.2-totem-1.0 \
gir1.2-totem-plparser-1.0 \
gir1.2-tracker-0.16 \
gir1.2-udisks-2.0 \
gir1.2-unity-5.0:amd64 \
gir1.2-vte-2.90 \
gir1.2-webkit-3.0 \
gir1.2-zeitgeist-2.0 \
gir1.2-zpj-0.0 \
glib-networking:amd64 \
glib-networking-common \
glib-networking-services \
gnash \
gnash-common \
gnome-accessibility-themes \
gnome-applets \
gnome-applets-data \
gnome-backgrounds \
gnome-bluetooth \
gnome-brave-icon-theme \
gnome-calculator \
gnome-chess \
gnome-color-manager \
gnome-colors-common \
gnome-contacts \
gnome-control-center \
gnome-control-center-data \
gnome-desktop3-data \
gnome-disk-utility \
gnome-documents \
gnome-font-viewer \
gnome-icon-theme \
gnome-icon-theme-extras \
gnome-icon-theme-full \
gnome-icon-theme-symbolic \
gnome-keyring \
gnome-klotski \
gnome-mahjongg \
gnome-media \
gnome-menus \
gnome-mines \
gnome-nibbles \
gnome-online-accounts \
gnome-online-miners \
gnome-panel \
gnome-panel-data \
gnome-power-manager \
gnome-robots \
gnome-screensaver \
gnome-screenshot \
gnome-session \
gnome-session-bin \
gnome-session-canberra \
gnome-session-common \
gnome-settings-daemon \
gnome-settings-daemon-schemas \
gnome-sudoku \
gnome-sushi \
gnome-system-monitor \
gnome-terminal \
gnome-terminal-data \
gnome-tetravex \
gnome-themes-standard:amd64 \
gnome-themes-standard-data \
gnome-user-guide \
gnome-user-share \
gnomine \
gnuchess \
gstreamer0.10-alsa:amd64 \
gstreamer0.10-gconf:amd64 \
gstreamer0.10-nice:amd64 \
gstreamer0.10-plugins-base:amd64 \
gstreamer0.10-plugins-good:amd64 \
gstreamer0.10-pulseaudio:amd64 \
gstreamer1.0-alsa:amd64 \
gstreamer1.0-clutter \
gstreamer1.0-gnonlin \
gstreamer1.0-libav:amd64 \
gstreamer1.0-plugins-bad:amd64 \
gstreamer1.0-plugins-bad-faad:amd64 \
gstreamer1.0-plugins-bad-videoparsers:amd64 \
gstreamer1.0-plugins-base:amd64 \
gstreamer1.0-plugins-good:amd64 \
gstreamer1.0-plugins-ugly:amd64 \
gstreamer1.0-pulseaudio:amd64 \
gstreamer1.0-x:amd64 \
gvfs:amd64 \
gvfs-backends \
gvfs-backends-goa \
gvfs-bin \
gvfs-common \
gvfs-daemons \
gvfs-libs:amd64 \
language-pack-en \
language-pack-en-base \
language-pack-gnome-en \
language-pack-gnome-en-base \
mobile-broadband-provider-info \
modemmanager \
mousetweaks \
mozilla-plugin-gnash \
nautilus \
nautilus-data \
nautilus-open-terminal \
pidgin \
pidgin-data \
pidgin-libnotify \
pidgin-plugin-pack \
pitivi \
poppler-data \
poppler-utils \
plymouth-label \
plymouth-theme-hamara-gnome-logo \
plymouth-theme-hamara-gnome-text \
plymouth-theme-hamara-logo \
plymouth-theme-hamara-text \
pm-utils \
policykit-1-gnome \
poppler-data \
poppler-utils \
printer-driver-foo2zjs \
printer-driver-foo2zjs-common \
printer-driver-gutenprint \
printer-driver-hpcups \
printer-driver-min12xxw \
printer-driver-pnm2ppa \
printer-driver-pxljr \
printer-driver-splix \
pulseaudio \
rhythmbox \
rhythmbox-data \
rhythmbox-mozilla \
rhythmbox-plugin-cdrecorder \
rhythmbox-plugins \
x11-common \
x11-utils \
x11-xkb-utils \
x11-xserver-utils \
x11proto-core-dev \
x11proto-input-dev \
x11proto-kb-dev \
x11proto-render-dev \
x11proto-xext-dev \
xbitmaps \
xcursor-themes \
xdg-user-dirs \
xdg-user-dirs-gtk \
xdg-utils \
xdiagnose \
xfonts-base \
xfonts-encodings \
xfonts-utils \
xinput \
xorg-docs-core \
xserver-common \
xserver-xorg \
xserver-xorg-core \
xserver-xorg-input-all \
xserver-xorg-input-evdev \
xserver-xorg-input-mouse \
xserver-xorg-input-synaptics \
xserver-xorg-input-vmmouse \
xserver-xorg-input-wacom \
xserver-xorg-video-all \
xserver-xorg-video-ati \
xserver-xorg-video-cirrus \
xserver-xorg-video-fbdev \
xserver-xorg-video-glamoregl \
xserver-xorg-video-intel \
xserver-xorg-video-mach64 \
xserver-xorg-video-mga \
xserver-xorg-video-modesetting \
xserver-xorg-video-neomagic \
xserver-xorg-video-nouveau \
xserver-xorg-video-openchrome \
xserver-xorg-video-qxl \
xserver-xorg-video-r128 \
xserver-xorg-video-radeon \
xserver-xorg-video-s3 \
xserver-xorg-video-savage \
xserver-xorg-video-siliconmotion \
xserver-xorg-video-sis \
xserver-xorg-video-sisusb \
xserver-xorg-video-tdfx \
xserver-xorg-video-trident \
xserver-xorg-video-vesa \
xserver-xorg-video-vmware \
xterm \
yelp \
yelp-tools \
yelp-xsl \
zenity \
zenity-common

partial source: http://askubuntu.com/a/216304

if [ "$1" = "configure" ] && [ -z "$2" ]; then
echo "Removing documentation..." >&2
find /usr/share/doc -depth -type f ! -name copyright|xargs rm || true
find /usr/share/doc -empty|xargs rmdir || true
rm -rf /usr/share/man /usr/share/groff /usr/share/info /usr/share/lintian /usr/share/linda /var/cache/man
fi

source: https://wiki.ubuntu.com/ReducingDiskFootprint#Documentation

Further removed some desktop related files. Free space is now 500M.

All kinds of gstreamer plugins are installed which can be removed to get good amount of space. Does diaspora have any dependencies on them ? @praveenarimbrathod @akshay

Edit. apt-cache show diaspora-common, diaspora-installer doesn't show any dependencies for gstreamer. I am removing it.

@askhay Be careful with the dependencies. Some of them will be linked so its safe to pick them each and confirm the packages removed.

Thank @fayadfami I can login now.

Just checked the partition is 4.9 GB
/dev/vda1 4.9G 4.1G 629M 87% /

But the disk is 10GB
Disk /dev/vda: 10.7 GB, 10737418240 bytes

I am just looking at re-sizing and expanding the current partition.

Would be an idea to understand what sort of capacity is required over time so that disk space can be provisioned accordingly.

We hope to start working on a hamara server meta package very soon (after the current debianisation work) - so future hamara/diaspora installs can be much more lightweight!

@praveenarimbrathod I will also try to update our diaspora package this coming week

I am preparing new server to move the vm to other datacentre on temp basis. This will be done by tomorrow.

Can some one let me know which directories to sync for diaspora or should I do state transfer as its.

@amardeepsingh shut down the vm. Copy the disk image and start it at the new place.

@vik just wait till I upload this to Debian. I'll upload it as soon I confirm its working once I update diasp.in.

Hi all,

I am moving the diaspora VM to our Gurgaon datacentre.
VM has not been shutdown I will let you guys know when I initiate the shutdown.

@saurabh could you add a "undergoing maintenance" message while there is downtime?

@vik : I have put the under maintenance message. Going to do the final sync now.

Who will be doing the DNS change? Please let me know the ttl value. I will update the ip to be added against diasp.in when I am done with the final sync.

I have shutdown the Diaspora VM now.
Migrated instance is available at 210.7.64.54, please make the DNS changes.

@Saurabh Updated DNS. The site shows under maintenance though. Please do update that too.

DNS propagation will take some time, as it still resolves the old IP hence was showing the under maintenance page.

@saurabh perhaps a redirect on that page in the meantime?

@Saurabh I was mentioning about the new ip, when typed in browser.

The DNS change is reflected now. I can login and access the system fine. Please check.

@amardeepsingh I cannot ssh into the system, the site is accessible, so DNS is ok.

$ ssh hamara@diasp.in
ssh: connect to host diasp.in port 22: Connection timed out

@praveenarimbrathod its firewalled. We have hardware firewall which is preventing ssh.

@saurabh - can you open port 22 for public along with 80 and 443.

@amardeepsingh I have allowed port 22.

@praveenarimbrathod Can you give it a try now?

@amardeepsingh @saurabh thanks! SSH is working. Can you enable mosh ports too?

mosh did not make a successful connection to 210.7.64.54:60001.
Please verify that UDP port 60001 is not firewalled and can reach the server.

(By default, mosh uses a UDP port between 60000 and 61000. The -p option
selects a specific UDP port number.)

@praveenarimbrathod I have allowed port 60001 as well now. please check.

@praveenarimbrathod I have allowed the whole port range from 60000 to 61000.

@praveenarimbrathod we have also increased space to 20GB on this temp server.

Before we move back to our upgraded server, do let us know how much space you looking for in future.

@saurabh are you sure you enabled UDP?

@praveenarimbrathod My mistake, I did it for TCP. I have enabled UDP now. Please check.

@saurabh thanks! it is working now. I will shutdown the diaspora service, take backup of db and run the update.

@saurabh I can't download from github, and ping to google.com isn't working either. Can you allow outgoing connections for http and https, at least to github.com?

@praveenarimbrathod I have allowed the outgoing connections form the pod.

diasp.in is now running 0.5.0.1 I had a little bit of issues with ruby, gem and bundler versions. My notes,

sudo apt-get install bc rake

Commands to backup and restore database is given below (run as root user):

sudo -u postgres pg_dump diaspora_production -f /var/lib/postgresql/diaspora_production.sql

sudo -u postgres psql -d diaspora_production -f /var/lib/postgresql/diaspora_production.sql

sudo dpkg -i diaspora-transition.deb

sudo dpkg -i diaspora-common_0.5.0.1+debian3_all.deb

(don't overwrite the config file /etc/diaspora.conf)
(overwrite /etc/init.d/diaspora)

sudo apt-get install ruby2.0

sudo ln -sf /usr/bin/ruby2.0 /usr/bin/ruby

sudo ln -sf /usr/bin/gem2.0 /usr/bin/gem

sudo apt-get remove bundler

sudo dpkg -i diaspora-installer_0.5.0.1+debian3_all.deb

@vik you may take the git master branch to import the new package. my package is stuck in new queue because I moved diaspora-common to main from contrib.

@amardeepsingh @saurabh thanks guys for the support!

@fayadfami @akshay can you folks see if we missed any customizations in the update. I think, twitter/tumblr integration is lost. Any customization should be integrated into the installer so we don't lose them on updates.

statistics is also gone.

I added the keys back to the config/diaspora.yml. Twitter and tumblr are working now.

Additionally wordpress also started working :D

Not recieving emails though. exim4 is working, sendmail works from command line. But dunno why. :(

@praveenarimbrathod the service diaspora restart still says "diaspora is already running"

Ah! @akshay try to debug the init script.

@praveenarimbrathod I'd suggested once. The sidekiq or whatever backend there is might be taking a second to shut down. The init script doesn't wait for that, it just does stop, start. We need stop, wait, start.

@akshay patches welcome :)

I knew you'd tell that.

@akshay mail needs to be re enabled in diaspora.yml, enable statistics as well. Make a note of all manual changes and we need to find a way to integrate into diaspora-installer

Enabled statistics. Enabling mail seems to be having absolutely no effect.
The settings I've tried
binary /usr/sbin/sendmail and /usr/sbin/exim4
exim_fix true and false

Would the firewall be causing problem? But I am able to send from command line.

Checkout this log:

2015-05-28 18:35:14 1YxxUo-000NHB-ES <= no-reply@diasp.in U=diaspora P=local S=914 id=5567128a68cfa_e0b23ff7fe00f2042513c@diasp.in.mail
2015-05-28 18:35:15 1YxxUo-000NHB-ES mx1.investici.org [2001:888:2000:56::19] Network is unreachable
2015-05-28 18:35:15 1YxxUo-000NHB-ES mx5.investici.org [2002:b2ff:9023::1] Network is unreachable
2015-05-28 18:35:20 1YxxUo-000NHB-ES => akshay@autistici.org R=dnslookup T=remote_smtp H=mx1.investici.org [82.94.249.234] X=TLS1.2:DHE_RSA_AES_128_CBC_SHA1:128 DN="C=IT,O=Autistici/Inventati,OU=Autistici/Inventati mail services,CN=smtp.autistici.org" C="250 2.0.0 Ok: queued as 19A581205F4"
2015-05-28 18:35:20 1YxxUo-000NHB-ES Completed
2015-05-28 18:36:23 1YxxVv-000NJM-Ar <= no-reply@diasp.in U=diaspora P=local S=910 id=556712cf4d732_15dd032052444255e@diasp.in.mail
2015-05-28 18:36:43 1YxxVv-000NJM-Ar => akshay@autistici.org R=dnslookup T=remote_smtp H=mx2.investici.org [94.23.50.208] X=TLS1.2:DHE_RSA_AES_128_CBC_SHA1:128 DN="C=IT,O=Autistici/Inventati,OU=Autistici/Inventati mail services,CN=smtp.autistici.org" C="250 2.0.0 Ok: queued as 27EEB120FC8"
2015-05-28 18:36:43 1YxxVv-000NJM-Ar Completed
2015-05-28 18:38:50 Start queue run: pid=89673
2015-05-28 18:38:50 End queue run: pid=89673


It looks like the mail is delivered. But i'm not receiving it. Is this a/i specific?

@akshay Maybe delivered in spam ?

@manukrishnantv we should update DNS SPF records?

Got it. I got an email from diasp.in. Who did what?