...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
Our Mission:
Biomedical Research Computing Facility (BRCF) "PODs" are small compute clusters that provide a standard hardware, software and storage architecture, suitable for
...
small-scale, interactive research computing, that can be efficiently managed.
If you are associated with a lab or organization that already has a BRCF pod (Available BRCF PODs), just create a BRCF account (Obtaining a BRCF Account) with the appropriate Affiliation specified and we will give you access to that POD.
...
This option is appropriate for those who expect to do heavy computing and/or have large storage requirements, and prefer to have more control over the resources in their computing environment.
In our "POD Equipment Ownership" offering, one or more groups buy purchase the initial POD servers then pay a monthly maintenance fee, which is $609/month for a full POD as of February 1, 2023. PODs can be shared among participants, in which case they share in both initial equipment and monthly maintenance costs (e.g. $304.50/mo for a POD . As of December 1, 2024, BRCF monthly maintenance is $681/month for a full pod, or, for example, $340.50/month for a pod shared by two PIs). We can assist in finding a suitable partner if you select this option. (Note that the 12/2/2024 $72/mo, 11.8% increase, the first in two years, was needed to cover higher costs for both support personnel and equpment.)
A POD consists of one or more compute servers that share a storage server; thus there are three components ton to consider:
- Compute server(s) – how many, and how configured for RAM and cores
- The storage server – our standard is an empty 36-bay ThinkMate server
- Disks for the storage server – quantity/size depending on needs
Typical equipment costs for this offering are in the $8$18,000 - $25$45,000+ range depending on your desired compute and storage configurations, and current server pricing.
Compute servers
You can purchase one or more compute servers. Prices, with the UT Dell discount, vary considerably. Some recent (April 2024) examples:
- Dell R660xs; 256 RAM; 56 cores - $8,000
- Dell R660xs; 512 RAM; 56 cores - $10,000
- Dell R660xs; 768 RAM; 56 cores - $14,250
- Dell R640R7625: 768 RAM; 128 cores - $24,250
GPU-enabled servers are available from other vendors, but typically start around cost $40,000+.
Compute servers
You can purchase one or more compute servers. Prices, with the UT Dell discount, vary considerably, from ~$7,000 for 36 cores/256GB RAM to ~$15,000 for 52 cores/768GB RAM. Again, prices vary considerably, and are remain high right now due to supply chain shortages. We We can work with our UT Dell representative and ThinkMate representatives to help you order a suitable configuration.
Our standard compute server requirements are as follows:
- Dual power supplies
- Dual 10Gbit network interfaces
- Enterprise iDRAC or equivalent out of band management (OOBM)
- 5 years technical support (but not next-day)
Storage server
Our standard storage server is an empty 36-bay ThinkMate, with 192 GB RAM or more, depending on configured storage (more TB of storage requires more GB of RAM). The cost is around $8,000100. We will obtain a quote for you for your desired RAM configuration.
Disks
The storage server has 36 bays, and we populate them in groups of 6 (a "vdev"), so up to 6 vdevs can be populated. It is generally best to start with at least 2 vdevs (12 disks) and we , although having just one vdev is acceptable. We also require that you purchase extra disks as spares (e.g. 1 extra for 2 vdevs, 2 extra for 3+ vdevseach vdev).
Two of each group of 6 vdev disks are reserved for redundancy (RAID-like), so there are effectively 4 storage-available disks in each vdev. The formula for calculating a vdev's available storage is:
per vdev (6 disks) available = <individual disk capacity> * 4 * 0.85875
So, for example:
- 1 vdev of 16 TB disks is ~54 ~56 TB = 16 * 4 * 0.85875
- 2 vdevs of 16 TB disks is 108 ~112 TB
- 3 vdevs of 16TB disks is 162 ~168 TB
Additional storage Additional storage can be added later, in groups of 6 (plus 1 spare), so folks often start with just 2 or 3 vdevs. Note However, note that additional vdevs must be populated with the same capacity disks.
We recommend Amazon for disk purchases (see this Seagate Exos disks link). As of 1/24/2023, 16TB disks cost $280 each ($17.5/raw TB), and 18TB disks are $300 ($16.7/TB). Some recent (October, 2024) prices are shown below. Disk prices often go up and down, so be sure to check the latest!
| Disk model | Cost per disk | Cost per TB | Cost per vdev (6 disks + 1 spare) | Available storage per vdev |
|---|---|---|---|---|
| $294.30 | $18.4 | $2061.50 | ~56 TB | |
| $330 | $18.3 | $2,310 | ~63 TB | |
| $380 | $19.0 | $2,660 | ~70 TB |
Rental POD offering
This option is appropriate for those with less demanding computational requirements, need less storage initially, or cannot fund the initial POD equipment purchase.
In this "Rental POD" offering, participants have no initial equipment buy-in but instead pay a larger per-TB/month maintenance fee are shown below, as of February December 1, 20232024. Note that allocations Allocations can be increased at any time, and all we need from you to get started is an account number for monthly billing.
| Rental % | Rental fraction | Monthly fee | Storage (TB) | 100% | 1 | $1325 | 256|
|---|---|---|---|---|---|---|---|
| 50% | 1/2 | $710 | 128 | ||||
| 25% | 1/4 | $355 | 64 | ||||
| 20% | 1/5 | $284 | 51 | ||||
| 15% | 1/6.5 | $213 | 38 | ||||
| 12.5% | 1/8 | $177 | 32 | ||||
| 10% | 1/10 | $142 | 26 | ||||
| 5% | 1/20 | $71 | 13 |
| Expand | ||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||||||||||||||||||||||||||||
| title | Rental pod rates 2/1/2023 - 12/1/2024
| |||||||||||||||||||||||||||||||||||
| Expand | ||||||||||||||||||||||||||||||||||||
Rental pod rates before 2/1/2023:
|
...