...
TACC compute clusters now share a common Work file system called stockyard. So files in your Work area do not have to be copied, for example from to stampede2 stampede3 to ls6 – they can be accessed directly from either cluster.
...
- $STOCKYARD - This refers to the root of your shared Work area
- e.g. /work/01063/abattenh
- e.g. /work/01063/abattenh
- $WORK - Refers to a sub-directory of the shared Work area that is different for different clusters, e.g.:
- /work/01063/abattenh/ls6 on lonestar6
- /work/01063/abattenh/stampede2stampede3 on stampede2 stampede3
A mechanism is being developed for purchasing larger stockyard allocations (above the 1 TB basic quota) from TACC are in development.
The UT Austin BioInformatics Team, a loose group of bioinformatics researchers, maintains a common directory area on stockyard.
...
corral is a gigantic (multiple PB) storage system (spinning disk) where researchers can store data. UT researchers may request up to 5 TB of corral storage through the normal TACC allocation request process. Additional space on corral can be rented for ~$80~$43/TB/year.
A couple of things to keep in mind regarding corral:
...
There is currently no charge for ranch storage. However, since the data is stored on tape it is not immediately available – robots find and mount appropriate tapes when the data is requested, and it can take minutes to hours for the data to appear on disk. The metadata about your data – the directory structures and file names – is always accessible, but the actual data in the files is not on disk until unless "staged". See the ranch user guide for more information: https://wwwdocs.tacc.utexas.edu/user-services/user-guides/ranch-user-guidehpc/ranch/.
Once that data is staged to the ranch disk it can be copied to other places. However, the ranch file system is not mounted as a local file system from the stampede2 stampede3 or ls6 clusters. So remote copy commands are always needed to copy data to and from ranch (e.g. scp, rsync).
...