Difference between revisions of "Babel / Server Background jobs"

From Eclipsepedia

Jump to: navigation, search
(publishPackFromLive.sh)
Line 23: Line 23:
 
cd /path/to/babel/classes/export/
 
cd /path/to/babel/classes/export/
 
php5 generate1.php
 
php5 generate1.php
 +
 +
# The language packs are generated, and now the Eclipse specific part begins, rsyncing to the downloads server.
 
cd /home/babel-working/live/output
 
cd /home/babel-working/live/output
  

Revision as of 06:56, 9 October 2008

The Babel server running at http://babel.eclipse.org runs a number of jobs. All jobs are run from a plain user account which is not the Apache user.

*This job initiates the maps processor, which crawls Eclipse CVS and searches for new English strings:
**36 21 * * * wget http://babel.eclipse.org/babel/process_map_files.php
 
 
*This job produces our Nightly build. It essentially calls 'php5 path/to/generate1.php', and uses rsync to upload the language packs to eclipse.org servers.
**34 4 * * 1-6 ~/publishPackFromLive.sh
 
*Same job as above, but this is the weekly build.  It is uploaded to download.eclipse.org
**34 4 * * 0 ~/publishPackFromLive.sh W
 
* This job essentually calls php5 path/to/dbmaintenance_15min.php
** */15 * * * * ~/dbmaintenance_15min.sh > /dev/null

publishPackFromLive.sh

#!/bin/sh
# Generate language packs, rsync to download.eclipse.org
 
cd /path/to/babel/classes/export/
php5 generate1.php
 
# The language packs are generated, and now the Eclipse specific part begins, rsyncing to the downloads server.
cd /home/babel-working/live/output
 
rsync -av --delete -e ssh *
droy@build.eclipse.org:/shared/technology/babel/test-updates/
 
# Produce weekly content
if [ "$1" = "W" ]; then
        sed -e 's/<site>/<site
mirrorsURL="http:\/\/www.eclipse.org\/downloads\/download.php?file=\/technology\/babel\/update-site\/europa\/site.xml\&amp;format=xml">/'
europa/site.xml > europa/site2.xml; mv -f europa/site2.xml europa/site.xml
        sed -e 's/<site>/<site
mirrorsURL="http:\/\/www.eclipse.org\/downloads\/download.php?file=\/technology\/babel\/update-site\/ganymede\/site.xml\&amp;format=xml">/'
ganymede/site.xml > ganymede/site2.xml; mv -f ganymede/site2.xml
ganymede/site.xml
        rsync -av --delete -e ssh *
droy@dev.eclipse.org:downloads/technology/babel/update-site/
fi

db_maintenance.sh

#!/bin/sh
# Do the maintenance of the db, you may force the regeneration of the scorebard by entering the --force argument.
 
if [ "$1" = "--force" ]; then
  export FORCE_BABEL_REFRESH=true 
fi
cd /var/www/babel/server/classes/export/
php5 dbmaintenance_15min.php
export FORCE_BABEL_REFRESH=false