Page Comparison

Introduction

We are developing a cluster for local ATLAS computing using the TACC Alamo site of FutureGrid Rodeo system to boot virtual machines. Local Personnel: Crystal Riley If you just want to use the system, see the next section and ignore the rest (which describes the virtual machine setup and is a bit out of date as of Sep 2015).

Getting started with Bosco

The Tier-3 uses utatlas.its.utexas.edu as a submission host - this is where the Condor scheduler lives.  However 

Bosco is a job submission manager designed to manage job submissions across different resources.  It is needed to submit jobs from our workstations to the Tier-3.

Make sure you have an account on our local machine utatlas.its.utexas.edu, and that you have passwordless ssh set up to it from the tau* machines.

To do this create an RSA key and copy your .ssh folder onto the tau machine using scp.

 Then carry out the following instructions on any of the tau* workstations:

cd ~
curl -o bosco_quickstart.tar.gz ftp://ftp.cs.wisc.edu/condor/bosco/1.2/bosco_quickstart.tar.gz
tar xvzf ./bosco_quickstart.tar.gz
./bosco_quickstart

this will ask you if you would like to install. Select y and continue. 

Bosco Quickstart
Detailed logging of this run is in ./bosco_quickstart.log

************** Starting Bosco: ***********
BOSCO Started
************** Connect one cluster (resource) to BOSCO: ***********
At any time hit [CTRL+C] to interrupt.

Type the submit host name for the BOSCO resource and press [ENTER]: 
No default, please type the name and press [ENTER]: utatlas.its.utexas.edu
Type your username on utatlas.its.utexas.edu (default USERNAME) and press [ENTER]: 
Type the queue manager for utatlas.its.utexas.edu (pbs, condor, lsf, sge, slurm) and press [ENTER]: condor
Connecting utatlas.its.utexas.edu, user: USERNAME, queue manager: condor

This may take some time to configure and test, but when it finishes, you should run.

source ~/bosco/bosco_setenv

Then you will be able to submit jobs as if you were running condor!
And lastly, here is a more detailed guide to Bosco. 

VM configuration

Our virtual machines are CentOS 5.7 6 instances configured with CVMFS for importing the ATLAS software stack from CERN. They also boot individual instances of the Condor job scheduling system. They will also boot access the same instance of the Squid HTTP caching serversserver which our local workstations use (on utatlas.its.utexas.edu), which help reduce network traffic required for CVMFS and for database access using the Frontier system.

...

ssh username@alamo.futuregrid.org

Then visit the list of instances to see which nodes are running. Then simply 

ssh root@10.XXX.X.XX

and you are now accessing a node!

Getting started with Bosco

Bosco is a job submission manager designed to manage job submissions across different resources.  It is needed to submit jobs from local machines to openstack.

Make sure you have an account on our local machine utatlas.its.utexas.edu, and that you have passwordless ssh set up to it from the tau* machines.

To do this create an RSA key and copy your .ssh folder onto the tau machine using scp.

 Then carry out the following instructions on any of the tau* workstations:

...

cd ~
curl -o bosco_quickstart.tar.gz ftp://ftp.cs.wisc.edu/condor/bosco/1.2/bosco_quickstart.tar.gz
tar xvzf ./bosco_quickstart.tar.gz
./bosco_quickstart

this will ask you if you would like to install. Select y and continue. 

...

Bosco Quickstart
Detailed logging of this run is in ./bosco_quickstart.log

************** Starting Bosco: ***********
BOSCO Started
************** Connect one cluster (resource) to BOSCO: ***********
At any time hit [CTRL+C] to interrupt.

Type the submit host name for the BOSCO resource and press [ENTER]: 
No default, please type the name and press [ENTER]: utatlas.its.utexas.edu
Type your username on utatlas.its.utexas.edu (default USERNAME) and press [ENTER]: 
Type the queue manager for utatlas.its.utexas.edu (pbs, condor, lsf, sge, slurm) and press [ENTER]: condor
Connecting utatlas.its.utexas.edu, user: USERNAME, queue manager: condor

This may take some time to configure and test, but when it finishes, you should run.

...

source ~/bosco/bosco_setenv

Then you will be able to submit jobs as if you were running condor!
And lastly, if you are looking for a more detailed guide on Bosco.