Tier-2 Storage Infrastructure#
The storage attached to our HPC clusters is organized according to the VSC storage guidelines.
All HPC clusters in VSC have their own shared storage solution accessible
from all nodes within that cluster. The so-called VSC_DATA and
VSC_SCRATCH use this type of storage and constitute the main storage of the
cluster.
Each compute node also has a local storage that can be used by jobs for
temporary storage. This is usually referred to as VSC_SCRATCH_NODE or just
TMPDIR. In general, VSC_SCRATCH is preferred over the local storage on
the node as the most performant option for scratch files.
Variable |
Type |
Access |
Backup |
Default quota |
|---|---|---|---|---|
$VSC_HOME |
NFS |
VSC |
YES |
3 GB |
$VSC_DATA |
NFS |
VSC |
YES |
75 GB |
$VSC_SCRATCH |
Lustre |
Genius & wICE |
NO |
500 GB |
$VSC_SCRATCH_SITE |
Genius & wICE |
NO |
500 GB |
|
$VSC_SCRATCH_NODE |
ext4 |
Genius wICE |
NO |
200 GB 600 GB |
For more information check: KU Leuven storage
Filesystem name |
Intended usage |
Total storage space |
Personal storage space |
VO storage space (+) |
|---|---|---|---|---|
$VSC_HOME |
Home directory, entry point to the system |
51 TB |
3GB (fixed) |
(none) |
$VSC_DATA |
Long-term storage of large data files |
1.8 PB |
25GB (fixed) |
250GB |
$VSC_SCRATCH |
Temporary fast storage of ‘live’ data for calculations |
1.9 PB |
25GB (fixed) |
250GB |
$VSC_SCRATCH_ARCANINE |
Temporary very fast storage of ‘live’ data for calculations (recommended for very I/O-intensive jobs) |
70 TB NVME |
(none) |
upon request |
(+) Storage space for a group of users (Virtual Organisation or VO for short) can be increased significantly on request.
For more information check: HPC-UGent Shared storage
Environment variable |
Type |
Access |
Backup |
Default quota |
Total capacity |
|---|---|---|---|---|---|
$VSC_HOME |
NFS/XFS |
VSC |
YES |
3 GB, 20k files |
3.5 TB |
$VSC_DATA |
NFS/XFS |
VSC |
YES |
25 GB, 100k files |
60 TB |
$VSC_SCRATCH
$VSC_SCRATCH_SITE
|
BeeGFS |
Site |
NO |
50 GB, 100k files |
0.6 PB |
$VSC_SCRATCH_NODE |
ext4 |
Node |
NO |
node-specific |
For node-specific details, see the hardware information for Vaughan, Leibniz and Breniac.
For more information check: UAntwerp storage
Variable |
Type |
Access |
Backup |
Default quota |
|---|---|---|---|---|
$VSC_HOME |
GPFS |
VSC |
YES |
6 GB |
$VSC_DATA |
GPFS |
VSC |
YES |
50 GB |
$VSC_SCRATCH
$VSC_SCRATCH_SITE
|
GPFS |
Hydra |
NO |
100 GB |
$VSC_SCRATCH_NODE |
ext4 |
Node |
NO |
(no quota) |
For more information check: VUB storage