Overview of storage systems

The administration and troubleshooting slightly various across installations. The table below summarizes responsibilities. If in doubt it's always a good idea to contact uco@desy.de.

FilesystemRemarksMountsContact
AFSGood for static data/documents and software. Not good for multi-threaded applications and log running jobs (> 24h)/afs/desy.de/

DESY IT

uco@desy.de  for questions about increasing quote, general problems

dCacheGood for mass storage of scientific data. Not suitable for volatile data./pnfs/desy.de/

DESY IT

maxwell.service@desy.de to arrange (missing) mounts. uco@desy.de for general problems

DESY beegfs

Fast. Without backup or snapshots. Deleted files are not recoverable.. Not intended for archiving data, only for actively used data!  It's scratch space really!

Do not use more than 10 TB over a longer period (more than 2 weeks). If you have an ongoing project that requires more space in the long term, please send us an email

/beegfs/desy/

DESY IT

Generating a folder: execute mk-beegfs on maxwell. Contact maxwell.service@desy.de for all other issues.

CSSB beegfsFast. Without backup or snapshots. Deleted files are not recoverable. Lifetime of data is up to CSSB policy. Get in touch with CSSB admins for details!/beegfs/cssb/

CSSB  IT / DESY IT

it@cssb-hamburg.de for access/usage rights. maxwell.service@desy.de for issues.

sync&shareGood for data sharing.none

DESY IT

uco@desy.de for all issues

CFEL GPFSFast. Good for scientific data of CFEL.see below

CFEL IT / DESY IT

DESY CFEL admins for access/usage issues. maxwell.service@desy.de for technical issues

EXFEL GPFS
see below

EXFEL IT / DESY IT

EXFEL admins for access/usage issues.maxwell.service@desy.de for technical issues

FS GPFSFast. Good for scientific data from PETRA III and FLASH experiments and analysis.see below

ASAP3 Team

it-asap3@desy.de ASAP3 team for all issues.

Scratch / TMPScratch. Limited space and subject to erasure without prior notice./scratch /tmp

DESY IT

Unmanaged temporary space.

HOME
/home

DESY IT

maxwell.service@desy.de for all issues. Quota will not be extended!


Characteristics of storage systems substantially differ for different storage systems. Tables below give a rough overview. Contact maxwell.service@desy.de for open questions.

FilesystemMount PointQuotaSizeLifetimetokensBackupSnapshotNetworkProtocolThroughputAvailabilityRemote
AFS/afs/per Volumeper Volumeunlimitedyesyes1yes2ethafsslowyesyes
BeeGFS/beegfs/desy/

no

(see Remarks)

1.2PB

unlimted

nononoibbeegfs>10GB/syesno
CSSB BeeGFS/beegfs/cssb/no3.2PBunlimitednononoibbeegfs
CSSB onlyno
dCache/pnfsnounlimitedunlimitednononoethnfsvariesyesyes
sync&sharenone90TBunlimitedunlimitednononoethhttpsslow

webdav

sync-client

yes
GPFS EXFL/gpfs/exfel/d
13PB









/gpfs/exfel/data
516TB









/gpfs/exfel/exp
42GB









/gpfs/exfel/u
1.4PB








GPFS FS

/asap3/petra3/gpfs
/asap3/flash/gpfs
/asap3/spec.instruments/gpfs

no

4.7PB

unlimited

no

yes

yes3

ibgpfs, nfs>10GB/s

FS only

no
/gpfs/petra3/scratchno30TB3 monthnononoFS onlyno
GPFS CFEL

gpfs-data

no501TBunlimitedno??ibgpfs, nfs

>10GB/s

CFEL onlyno
gpfs-scratchno49TBn.a.nononono
scratch/scratchnofew GBnonenonono-localfastyesno
HOME/home on FS GPFS20GB hard30TBaccountnonoyes4ibgpfs>10GB/syesno



Any files without any associated user (account does not exist anymore) will be removed from BEEGFS, HOME, GPFS-FS-SCRATCH without prior notifications! Similar policies might apply for group-storages, please verify with your admins! if in doubt!


IMPORTANT: Snapshots

  1. For information about backup & recovery: check IT-Services
  2. AFS-snapshots are located in <afs-home>/.OldFiles
  3. GPFS Snapshots are located in /asap3/.snapshots/@<time-stamp>
  4. GPFS-Home snapshots are located in /home/.snapshots/@<time-stamp>/$USER

Where to store Scientific data

Available for everyone are AFS, BeeGFS, Desycloud and dCache.

In addition to generic storage resources, some group specific resources are available:

Where to store Software

Most applications are small enough to be deployed in (almost) arbitrary locations. Suitable storage systems are

Where to store Documents

Assuming that documents are usually small 

Where to store Temporary data


Best Place(s) for storing information - overview


AFSBeeGFSdCacheDESY-CloudHOME

Local Scratch

GPFS-Scratch
scientific data--+(+)---
temporary data-+---++
software(+)(+)--+--
documents+--+---