updating to 0.5.0.1

I'm ready with the package but there is only 48 MB left. @vik can we add more space? I need to backup the data and also we need space to grow.

Just 48MB? What is the disk size for diasp.in?

@manukrishnantv @praveenarimbrathod Amardeep should be joining this group shortly and will be able to help with the disk space

There are few things we need to do on the server.

• One we are upgrading our cloud stack and moving running instances temporarily to other datacentre in gurgaon.
• If I provide you new system how easy is to move the data I am happy to put someone on this from hamara to move the data and get the server ready.

Let me know if this is fine with you guys and also how much space you need.

@praveenarimbrathod will be the best person to comment on this as diasp.in is the only pod in production, which used the installer package. He was looking forward to test the upgrade feature which was added to the installer. So, if you can move the VM entirely to the new data center, that will be more preferred.

Again, just 48MB left is a serious issue to address. Logs a day itself might take up that size.

@amardeepsingh can we move the whole VM first? Then add more disk space. I think 10 more GB at least should be added.

@praveenarimbrathod yes no issues. I'll get on with moving the vm today. Is it possible to provide me ssh access to the server.

Meanwhile can we clear or move some data to free up space. I can attach another drive to vm.

@amardeepsingh I'm travelling next few days. @akshay @fayadfami can you folks work with Amardeep?

@amardeepsingh please give me your public key, I shall add to the ssh authorized_keys

Meanwhile, there's only 25 MB left now.

The /var/log/diaspora/access.log file is 37965682 bytes (38MB). Is it okay to delete this log?
Also, there're some zips, tars, etc inside /usr/share/diaspora/public which'd be like 1MB, 2MB, etc.

We went below 2MB. So after talking with @manukrishnantv I've stopped the diaspora service.

@amardeepsingh , what's up?

I have no idea how much pressure the guys behind Facebook, etc would be taking when the site goes down. LoL.

@akshay @praveenarimbrathod I am away as well for couple of days. My public is attached, as soon as I get access I'll try to sort something out with minimal disruption.

@praveenarimbrathod @akshay @amardeepsingh Apparently the server was so high it wouldn't even hold Amardeep's key :)

I've added the key after removing some old packages found in /var/cache/apt/archives. Please see if you can login @amardeepsingh.

/usr/share is 2.2G with package files that is not relevant to server. Like so many gnome directories, libreoffice, gimp and cheese. We have some space there.

Edit. Thought its a good idea to comment out login/sign-up links from home page to avoid 404 and replace with a maintenance message. Done that.

Remove gimp, libreoffice etc and start diaspora service.

Nice catch @fayadfami !
I've just done apt-get remove gimp and apt-get autoremove (which apparently removed libreoffice too :D)
We have 155M now

Removed that maintenance message from home page and re-enabled login links.

Some other packages like brasero, imagemagick, evolution, gnome games, documents removed to free up 15MB.

And inkscape - 64MB.

I'm gonna run the following commands, please review.

sudo apt-get --purge remove \
bluez \
bluez-alsa:amd64 \
bluez-cups \
bluez-gstreamer \
brasero \
brasero-cdrkit \
brasero-common \
browser-plugin-gnash \
cheese-common \
espeak-data:amd64 \
evince \
evince-common \
evolution \
evolution-common \
evolution-data-server \
evolution-data-server-common \
evolution-indicator \
evolution-plugins \
firefox \
firefox-locale-en \
folks-common \
fontconfig \
fontconfig-config \
fonts-cantarell \
fonts-dejavu-core \
fonts-freefont-ttf \
fonts-lyx \
fonts-opensymbol \
foomatic-db \
foomatic-db-engine \
four-in-a-row \
gcalctool \
gedit \
gedit-common \
gedit-plugins \
genisoimage \
geoclue \
gettext-base \
ghostscript \
ghostscript-x \
gimp-help-common \
gimp-help-en \
gir1.2-appindicator3-0.1 \
gir1.2-atk-1.0 \
gir1.2-atspi-2.0 \
gir1.2-clutter-1.0 \
gir1.2-clutter-gst-2.0 \
gir1.2-cogl-1.0 \
gir1.2-coglpango-1.0 \
gir1.2-dbusmenu-glib-0.4 \
gir1.2-dee-1.0 \
gir1.2-evince-3.0 \
gir1.2-freedesktop \
gir1.2-gconf-2.0 \
gir1.2-gdata-0.0 \
gir1.2-gdesktopenums-3.0 \
gir1.2-gdkpixbuf-2.0 \
gir1.2-ges-1.0 \
gir1.2-glib-2.0 \
gir1.2-gmenu-3.0 \
gir1.2-gnomebluetooth-1.0 \
gir1.2-gnomedesktop-3.0 \
gir1.2-gnomekeyring-1.0 \
gir1.2-goa-1.0 \
gir1.2-gst-plugins-base-1.0 \
gir1.2-gstreamer-1.0 \
gir1.2-gtk-3.0 \
gir1.2-gtkclutter-1.0 \
gir1.2-gtksource-3.0 \
gir1.2-gucharmap-2.90 \
gir1.2-gudev-1.0 \
gir1.2-javascriptcoregtk-3.0 \
gir1.2-json-1.0 \
gir1.2-notify-0.7 \
gir1.2-packagekitglib-1.0 \
gir1.2-panelapplet-4.0 \
gir1.2-pango-1.0 \
gir1.2-peas-1.0 \
gir1.2-rb-3.0 \
gir1.2-rest-0.7 \
gir1.2-rsvg-2.0 \
gir1.2-soup-2.4 \
gir1.2-totem-1.0 \
gir1.2-totem-plparser-1.0 \
gir1.2-tracker-0.16 \
gir1.2-udisks-2.0 \
gir1.2-unity-5.0:amd64 \
gir1.2-vte-2.90 \
gir1.2-webkit-3.0 \
gir1.2-zeitgeist-2.0 \
gir1.2-zpj-0.0 \
glib-networking:amd64 \
glib-networking-common \
glib-networking-services \
gnash \
gnash-common \
gnome-accessibility-themes \
gnome-applets \
gnome-applets-data \
gnome-backgrounds \
gnome-bluetooth \
gnome-brave-icon-theme \
gnome-calculator \
gnome-chess \
gnome-color-manager \
gnome-colors-common \
gnome-contacts \
gnome-control-center \
gnome-control-center-data \
gnome-desktop3-data \
gnome-disk-utility \
gnome-documents \
gnome-font-viewer \
gnome-icon-theme \
gnome-icon-theme-extras \
gnome-icon-theme-full \
gnome-icon-theme-symbolic \
gnome-keyring \
gnome-klotski \
gnome-mahjongg \
gnome-media \
gnome-menus \
gnome-mines \
gnome-nibbles \
gnome-online-accounts \
gnome-online-miners \
gnome-panel \
gnome-panel-data \
gnome-power-manager \
gnome-robots \
gnome-screensaver \
gnome-screenshot \
gnome-session \
gnome-session-bin \
gnome-session-canberra \
gnome-session-common \
gnome-settings-daemon \
gnome-settings-daemon-schemas \
gnome-sudoku \
gnome-sushi \
gnome-system-monitor \
gnome-terminal \
gnome-terminal-data \
gnome-tetravex \
gnome-themes-standard:amd64 \
gnome-themes-standard-data \
gnome-user-guide \
gnome-user-share \
gnomine \
gnuchess \
gstreamer0.10-alsa:amd64 \
gstreamer0.10-gconf:amd64 \
gstreamer0.10-nice:amd64 \
gstreamer0.10-plugins-base:amd64 \
gstreamer0.10-plugins-good:amd64 \
gstreamer0.10-pulseaudio:amd64 \
gstreamer1.0-alsa:amd64 \
gstreamer1.0-clutter \
gstreamer1.0-gnonlin \
gstreamer1.0-libav:amd64 \
gstreamer1.0-plugins-bad:amd64 \
gstreamer1.0-plugins-bad-faad:amd64 \
gstreamer1.0-plugins-bad-videoparsers:amd64 \
gstreamer1.0-plugins-base:amd64 \
gstreamer1.0-plugins-good:amd64 \
gstreamer1.0-plugins-ugly:amd64 \
gstreamer1.0-pulseaudio:amd64 \
gstreamer1.0-x:amd64 \
gvfs:amd64 \
gvfs-backends \
gvfs-backends-goa \
gvfs-bin \
gvfs-common \
gvfs-daemons \
gvfs-libs:amd64 \
language-pack-en \
language-pack-en-base \
language-pack-gnome-en \
language-pack-gnome-en-base \
mobile-broadband-provider-info \
modemmanager \
mousetweaks \
mozilla-plugin-gnash \
nautilus \
nautilus-data \
nautilus-open-terminal \
pidgin \
pidgin-data \
pidgin-libnotify \
pidgin-plugin-pack \
pitivi \
poppler-data \
poppler-utils \
plymouth-label \
plymouth-theme-hamara-gnome-logo \
plymouth-theme-hamara-gnome-text \
plymouth-theme-hamara-logo \
plymouth-theme-hamara-text \
pm-utils \
policykit-1-gnome \
poppler-data \
poppler-utils \
printer-driver-foo2zjs \
printer-driver-foo2zjs-common \
printer-driver-gutenprint \
printer-driver-hpcups \
printer-driver-min12xxw \
printer-driver-pnm2ppa \
printer-driver-pxljr \
printer-driver-splix \
pulseaudio \
rhythmbox \
rhythmbox-data \
rhythmbox-mozilla \
rhythmbox-plugin-cdrecorder \
rhythmbox-plugins \
x11-common \
x11-utils \
x11-xkb-utils \
x11-xserver-utils \
x11proto-core-dev \
x11proto-input-dev \
x11proto-kb-dev \
x11proto-render-dev \
x11proto-xext-dev \
xbitmaps \
xcursor-themes \
xdg-user-dirs \
xdg-user-dirs-gtk \
xdg-utils \
xdiagnose \
xfonts-base \
xfonts-encodings \
xfonts-utils \
xinput \
xorg-docs-core \
xserver-common \
xserver-xorg \
xserver-xorg-core \
xserver-xorg-input-all \
xserver-xorg-input-evdev \
xserver-xorg-input-mouse \
xserver-xorg-input-synaptics \
xserver-xorg-input-vmmouse \
xserver-xorg-input-wacom \
xserver-xorg-video-all \
xserver-xorg-video-ati \
xserver-xorg-video-cirrus \
xserver-xorg-video-fbdev \
xserver-xorg-video-glamoregl \
xserver-xorg-video-intel \
xserver-xorg-video-mach64 \
xserver-xorg-video-mga \
xserver-xorg-video-modesetting \
xserver-xorg-video-neomagic \
xserver-xorg-video-nouveau \
xserver-xorg-video-openchrome \
xserver-xorg-video-qxl \
xserver-xorg-video-r128 \
xserver-xorg-video-radeon \
xserver-xorg-video-s3 \
xserver-xorg-video-savage \
xserver-xorg-video-siliconmotion \
xserver-xorg-video-sis \
xserver-xorg-video-sisusb \
xserver-xorg-video-tdfx \
xserver-xorg-video-trident \
xserver-xorg-video-vesa \
xserver-xorg-video-vmware \
xterm \
yelp \
yelp-tools \
yelp-xsl \
zenity \
zenity-common

partial source: http://askubuntu.com/a/216304

if [ "$1" = "configure" ] && [ -z "$2" ]; then
echo "Removing documentation..." >&2
find /usr/share/doc -depth -type f ! -name copyright|xargs rm || true
find /usr/share/doc -empty|xargs rmdir || true
rm -rf /usr/share/man /usr/share/groff /usr/share/info /usr/share/lintian /usr/share/linda /var/cache/man
fi

source: https://wiki.ubuntu.com/ReducingDiskFootprint#Documentation

Further removed some desktop related files. Free space is now 500M.

All kinds of gstreamer plugins are installed which can be removed to get good amount of space. Does diaspora have any dependencies on them ? @praveenarimbrathod @akshay

Edit. apt-cache show diaspora-common, diaspora-installer doesn't show any dependencies for gstreamer. I am removing it.

@askhay Be careful with the dependencies. Some of them will be linked so its safe to pick them each and confirm the packages removed.

Thank @fayadfami I can login now.

Just checked the partition is 4.9 GB
/dev/vda1 4.9G 4.1G 629M 87% /

But the disk is 10GB
Disk /dev/vda: 10.7 GB, 10737418240 bytes

I am just looking at re-sizing and expanding the current partition.

Would be an idea to understand what sort of capacity is required over time so that disk space can be provisioned accordingly.

We hope to start working on a hamara server meta package very soon (after the current debianisation work) - so future hamara/diaspora installs can be much more lightweight!

@praveenarimbrathod I will also try to update our diaspora package this coming week

I am preparing new server to move the vm to other datacentre on temp basis. This will be done by tomorrow.

Can some one let me know which directories to sync for diaspora or should I do state transfer as its.

@amardeepsingh shut down the vm. Copy the disk image and start it at the new place.

@vik just wait till I upload this to Debian. I'll upload it as soon I confirm its working once I update diasp.in.

Hi all,

I am moving the diaspora VM to our Gurgaon datacentre.
VM has not been shutdown I will let you guys know when I initiate the shutdown.

@saurabh could you add a "undergoing maintenance" message while there is downtime?

@vik : I have put the under maintenance message. Going to do the final sync now.

Who will be doing the DNS change? Please let me know the ttl value. I will update the ip to be added against diasp.in when I am done with the final sync.

I have shutdown the Diaspora VM now.
Migrated instance is available at 210.7.64.54, please make the DNS changes.

@Saurabh Updated DNS. The site shows under maintenance though. Please do update that too.

DNS propagation will take some time, as it still resolves the old IP hence was showing the under maintenance page.

@saurabh perhaps a redirect on that page in the meantime?

@Saurabh I was mentioning about the new ip, when typed in browser.

The DNS change is reflected now. I can login and access the system fine. Please check.

@amardeepsingh I cannot ssh into the system, the site is accessible, so DNS is ok.

$ ssh hamara@diasp.in
ssh: connect to host diasp.in port 22: Connection timed out

@praveenarimbrathod its firewalled. We have hardware firewall which is preventing ssh.

@saurabh - can you open port 22 for public along with 80 and 443.

@amardeepsingh I have allowed port 22.

@praveenarimbrathod Can you give it a try now?

@amardeepsingh @saurabh thanks! SSH is working. Can you enable mosh ports too?

mosh did not make a successful connection to 210.7.64.54:60001.
Please verify that UDP port 60001 is not firewalled and can reach the server.

(By default, mosh uses a UDP port between 60000 and 61000. The -p option
selects a specific UDP port number.)

@praveenarimbrathod I have allowed port 60001 as well now. please check.

@praveenarimbrathod I have allowed the whole port range from 60000 to 61000.

@praveenarimbrathod we have also increased space to 20GB on this temp server.

Before we move back to our upgraded server, do let us know how much space you looking for in future.

@saurabh are you sure you enabled UDP?

@praveenarimbrathod My mistake, I did it for TCP. I have enabled UDP now. Please check.

@saurabh thanks! it is working now. I will shutdown the diaspora service, take backup of db and run the update.

@saurabh I can't download from github, and ping to google.com isn't working either. Can you allow outgoing connections for http and https, at least to github.com?

@praveenarimbrathod I have allowed the outgoing connections form the pod.

diasp.in is now running 0.5.0.1 I had a little bit of issues with ruby, gem and bundler versions. My notes,

sudo apt-get install bc rake

Commands to backup and restore database is given below (run as root user):

sudo -u postgres pg_dump diaspora_production -f /var/lib/postgresql/diaspora_production.sql

sudo -u postgres psql -d diaspora_production -f /var/lib/postgresql/diaspora_production.sql

sudo dpkg -i diaspora-transition.deb

sudo dpkg -i diaspora-common_0.5.0.1+debian3_all.deb

(don't overwrite the config file /etc/diaspora.conf)
(overwrite /etc/init.d/diaspora)

sudo apt-get install ruby2.0

sudo ln -sf /usr/bin/ruby2.0 /usr/bin/ruby

sudo ln -sf /usr/bin/gem2.0 /usr/bin/gem

sudo apt-get remove bundler

sudo dpkg -i diaspora-installer_0.5.0.1+debian3_all.deb

@vik you may take the git master branch to import the new package. my package is stuck in new queue because I moved diaspora-common to main from contrib.

@amardeepsingh @saurabh thanks guys for the support!

@fayadfami @akshay can you folks see if we missed any customizations in the update. I think, twitter/tumblr integration is lost. Any customization should be integrated into the installer so we don't lose them on updates.

statistics is also gone.

I added the keys back to the config/diaspora.yml. Twitter and tumblr are working now.