3. Storage
The LRZ AI Systems are integrating the full offer of the LRZ Data Science Storage (DSS) system.
Storage Options
| Storage Pool | Use Case | Top-level Directory | Size Limit | Automated Backup | Expiration |
|---|---|---|---|---|---|
| Home Directory | Critical files like code, scripts, and configs that need regular backups and are small. | /dss/dsshome1/.../<user> | 100 GB | Yes, backup to tape and file system snapshots | Lifetime of LRZ project |
| AI Systems DSS | High-bandwidth, low-latency storage for I/O. use this for reading and writing | /dss/dssfs04 | up to 4 TB (4+ TB, costs apply) | No for free tier / Yes for paid option | Until further notice |
Linux Cluster DSS | General purpose, long-term storage. | /dss/dssfs02 | up to 10 TB | No for free tier / Yes for paid option | Lifetime of the data project |
Private DSS | specified by system owner | /dss/dsslegfs01 | System Owner Defined | System Owner Defined | System Owner Defined |
Home directory
The LRZ AI Systems provide a unified home directory together with the LRZ Linux Cluster (cf. File Systems and IO on Linux-Cluster).
This is shared among all the LRZ AI Systems resources described here: 2. Compute.
User home directories can be accessed both from the login nodes (login.ai.lrz.de) via SSH and from the web front end (https://login.ai.lrz.de).
Home directories are located in a dedicated DSS container managed by LRZ.
AI Systems DSS
A dedicated AI Systems DSS provides high-performance, SSD-based network storage designed for demanding AI workloads.
It is optimized for high-bandwidth, low-latency I/O operations to support the data-intensive needs of modern AI applications.
Access to this storage is granted upon request by the Master User of an LRZ project via the LRZ Servicedesk using the following form.
A quota of up to 4 TB, 8 million files, and a maximum of 3 DSS containers (typically a single container) can be allocated.
Once provisioned, the Master User assumes the role of DSS Data Curator and is responsible for managing the assigned storage quotas within their project.
Additional AI Systems DSS storage (4 TB or more) can be requested as part of the DSS on demand offer offering, which is subject to additional costs.
Linux Cluster DSS
The Master User can request additional storage of up to 10 TB, primarily intended for long-term use.
To do so, they must first request the activation of the project for the Linux Cluster via the LRZ Servicedesk using the following form,
and then submit a separate request for explicit Linux Cluster DSS storage via this form.
Private DSS
As part of a joint project offering, dedicated DSS systems can be purchased, deployed, and operated exclusively for a private group of users.
Additional Information
Additional information can be found at File Systems and IO on Linux-Cluster and Data Science Storage.
Use the following command on the login nodes to get an storage utilization overview of all individually accessible DSS containers:
dssusrinfo all