Storage Overview
Below you find all the information you need to know about Komondor storage.
Komondor has three tiers of storage. Two out of the three tiers are clustered filesystems (Lustre), and these are complemented by an archive:
scratch (Lustre)
project (Lustre)
archive (DMF + Spectra Tfinity)
Suggested use for each of the tiers
The scratch filesystem (/scratch) provides you with a temporary workspace, which you could use for your jobs. This storage contains NVMe SSDs exclusively. Out of the three tiers this one has the best performance.
The project filesystem (/project) provides you with persistent data storage for your projects. For example you could store input data for your jobs, results of jobs etc. As a conventional, HDD-based storage, this tier is less performant than scratch.
Warning
Because of the difference in performance it is particularly important that users are aware of the performance characteristics of both the filesystem and their applications. Working with a lot of small files has a huge negative impact on performance.
The archive tier consists of a DMF (Data Management Framework) coupled with a Spectra Tfinity tape library. On this tier you could store data that is not currently used but might be needed in the future. Files on the archive tier could be released from project, so in addition to preservation, this tier can also play a role in space management.
Usage and paths
Path |
Use |
|---|---|
/home/<user_ID> |
User data (eg. config files) |
Path |
Use |
|---|---|
/scratch/<project_ID> |
Temporary workspace for input,
output and checkpoint files
|
Path |
Use |
|---|---|
/project/<project_ID> |
Persistent storage for projects |
DMF works alongside the project tier.
Important
Recall of fully migrated files (those that are only present on tapes) to project could take quite some time depending on other migrations/recalls.
Block and Inode quotas
Block quota |
Inode quota |
Extendable? |
|---|---|---|
20 GB |
100k |
No |
Block quota |
Inode quota |
Extendable? |
|---|---|---|
1 TB |
300k |
On a case-by-case basis |
Block quota |
Inode quota |
Extendable? |
|---|---|---|
4 TB |
1M |
On a case-by-case basis |
Note
Quotas, with the exception of the home quota, are set for projects. Please contact officials at KIFÜ HPC Competence Centre to learn more about possible extensions.
How to check your quotas?
You could use the squota command to check your (both personal and project) quotas. Example:
$ squota
account Filesystem used soft limit hard limit grace files soft limit hard limit grace
--------- ------------ -------- ------------ ------------ ----------- ------- ------------ ------------ -------
tesztuser /project 23.2 GB 20.0 GB 25.0 GB 6d11h19m36s 11215 100000 110000 -
tesztpro /project 4.0 KB 4.0 TB 4.4 TB - 1 1000000 1100000 -
tesztpro /scratch 4.0 KB 1.0 TB 1.1 TB - 1 300000 330000 -