...
| Home | Work2 | Scratch | |
|---|---|---|---|
| quota | 10 GB | 1024 GB = 1 TB | 2+ PB (basically infinite) |
| policy | backed up | not backed up, not purged | not backed up, purged if not accessed recently (~10 days) |
| access command | cd | cdw2cdw | cds |
| environment variable | $HOME | $WORK (different sub-directory for each cluster) $STOCKYARD (root of the shared Work file system) | $SCRATCH |
| root file system | /home | /work | /scratch |
| use for | Small files such as scripts that you don't want to lose. | Medium-sized files you don't want to copy over all the time. For example, custom programs you install (these can get large), or annotation file used for analysis. | Large files accessed from batch jobs. Your starting files will be copied here from somewhere else, and your final results files will be copied elsewhere (e.g. stockyard, corral, your BRCF POD, or your organization's storage area. |
...
When you first login, you start in your Home directory. Use the cd, cdw2 cdw and cds commands to change to your other file systems. Notice how your command prompt helpfully changes to show your location.
...
- $STOCKYARD - This refers to the root of your shared Work area
- e.g. /work/01063/abattenh
- e.g. /work/01063/abattenh
- $WORK - Refers to a sub-directory of the shared Work area that is different for different clusters, e.g.:
- /work/01063/abattenh/ls6 on ls6 lonestar6
- /work2work/01063/abattenh/stampede2 on stampede2
...
The cp command copies one or more files from a local source to a local destination. It has many options, but the most common form is:
cp [options] <source_file_1> <source_file_2> ... <destination_directory>/
Make a directory in your Scratcharea and copy a single file to it. The trailing slash ( / ) on the destination says the destination is a directory.
...
rsync is a very complicated program, with many options (http://rsync.samba.org/ftp/rsync/rsync.html). However, if you use the recipe shown here for directories, it's hard to go wrong:
rsync -avW local/path/to/source_directory/ local/path/to/destination_directory/
Both the source and target directories are local (in some file system accessible directly from lonestar6). Either full or relative path syntax can be used for both. The -avW options above stand for:
...