beamline file-system
/gpfs/
├── local
├── current
| ├── raw
| ├── processed
| ├── shared
| └── scratch_bl
└── commissioning
├── raw
├── processed
├── shared
└── scratch_bl
/common/
└── <beamline>
core file-system
/asap3/
└── <facility>
└── gpfs
├── <beamline>
| ├── <year>
| ├── data
| | └── <beamtime-ID>
| | ├── raw
| | ├── processed
| | ├── shared
| | └── scratch_cc
| └── commissioning
| └── <commissioning-tag>
| |── raw
| ├── processed
| ├── shared
| └── scratch_cc
└── common
└── <beamline>
Description
- 'local':
- A 3 TiB local share of the beamline file-system which stays there independently of the beamtimes
- It is managed by the beamlines themselves
- There is no syncing across to the core file-system.
- It serves as a local buffer.
- Anybody on the beamline can read/write from/to it
- Cannot be accessed from the core file-system
- 'current':
- Non-permanent share from the beamline file-system
- It will appear when a beamtime is started and disappear if it is stopped
Meaning of the different directories:
- raw:
- For raw data
- will be
- migrated into the core file-system
- written to tape
- shown in the Gamma-portal
- processed
- For meaningful processed data
- will be
- migrated into the core file-system
- written to tape
- shown in the Gamma-portal
- shared
- For user specific macros, scripts, metadata, text-files,...
- will be
- migrated into the core file-system
- written to tape
- shown in the Gamma-portal
- scratch
- Meant for
- temporarily data
- data it is not known in advance if is meaningful or not. That data can be written here and if its meaningful copied into 'processed' afterwards.
- will not be migrated into the core file-system
- Meant for
- raw:
- 'commissioning'
- Same as 'current' but for commissioning runs
- Commissioning runs are limited to a 1 TiB hard quota
- 'common':
- Mounted read-only in the beamline space
- Its world-readable meaning that all beamlines can read it
- Meant for documentation, macros, ... provided to the users by the beamline staff
- If users has to edit something, like a macro, they can copy it into 'shared'
- Can be changed from the core side by the beamline staff
Description
- Access only with a valid DESY or Science Account
- '<facility>'
- Determines the facility, where the data has been acquired
- Either "petra3" or "flash"
- The remaining directory structure is identical between both facilities