Documentation places
- This wiki: http://savannah.gnu.org/maintenance/
- The administration 'infra' repository, with system installation notes and maintenance script: http://bzr.savannah.gnu.org/lh/administration/
- The Savane code: http://git.savannah.gnu.org/cgit/savane-cleanup.git
- The next Savane code: http://git.savannah.gnu.org/cgit/savane-cleanup/framework.git/
Global architecture
See also the rest of the GnuArchitecture.
Savannah is located in Quincy near Boston, MA, at Global Naps. The hardware was donated to the FSF by HP, and the bandwidth is provided by the FSF.
Savannah was setup and is maintained by the Savannah Hackers (SavannahTeam).
https://savannah.gnu.org/bzr/?group=administration contains step-by-step notes about the system setup.
Xen architecture
Savannah operates with five critical Xen domU's:
- frontend.savannah.gnu.org (140.186.70.70, 140.186.70.71)
- vcs.savannah.gnu.org (140.186.70.72)
- download.savannah.gnu.org (140.186.70.73)
- mgt.savannah.gnu.org (140.186.70.74)
- internal.savannah.gnu.org. (140.186.70.75)
mgt.savannah.gnu.org
This is the management domU, where maintenance scripts can be run and software can be built for the other four domU's.
Scripts may be found in the /root/maintenance directory.
Savannah hackers may maintain individual user accounts on this domU for running/creating/maintaining maintenance scripts and for other administrative functions.
From the mgt domU, the other domU's are accessible via ssh.
- ssh root@download
- ssh root@vcs
- ssh root@frontend
- ssh root@internal
SSH keys may be synced to the savannah virtual machines using the /root/maintenance/authorized_keys_replicate.sh script, which copies the /root/.ssh/vm_authorized_keys file to the other virtual machines.
The /root/.ssh/authorized_keys file should be meant to control access to only the management vm, and /root/.ssh/vm_authorized_keys for the other virtual machines. This allows us to include key's from the management vm on the other vm's without actually being in the mgt vm's authorized_keys file.
frontend.savannah.gnu.org
The frontend domU runs the web server instances for Savannah.
The frontend Savane repository pulls from administration/savane.git
internal.savannah.gnu.org
The internal domU runs mysql as well as bind (for the .savannah.gnu.org/.savannah.nongnu.org domains)
vcs.savannah.gnu.org
This is the version control system virtual machine. It runs cvs/git/bzr/etc as well as webservers for repository viewing.
download.savannah.gnu.org
This is the "download" vm, it runs a webserver and stores the released packages from Savannah.
High load
If a DomU is experiencing heavy load, running these rwo commands will dump some basic system state for possible post mortems:
d=`date +%F.%T`; cd ~; ps auxww>ps-$d & lsof>lsof-$d & netstat --numeric-hosts>netstat-$d &
We have often seen high loads due to vc browsers being hit too hard.
Misc
Suggested Debian mirror: http://debian.csail.mit.edu/debian/
Initial setup of the previous hardware: http://fsffrance.org/news/article2001-05-28-01.en.html
2 sets of files are replicated from/to Savannah:
- syncaliases@syncaliases.savannah.gnu.org (a.k.a. from Dom0): the GNU mail system replicates these @gnu.org aliases from Savannah
- nongnulogcopy@nongnulogcopy.savannah.gnu.org (a.k.a. vcs-noshell): nongnu.org logs are synchronized to Savannah for processing (WIP)