beamline file-system
/gpfs/ ├── local ├── current | ├── raw | ├── processed | ├── shared | └── scratch_bl └── commissioning ├── raw ├── processed ├── shared └── scratch_bl /common/ └── <beamline>
core file-system
/asap3/ └── <facility> └── gpfs ├── <beamline> | ├── <year> | ├── data | | └── <beamtime-ID> | | ├── raw | | ├── processed | | ├── shared | | └── scratch_cc | └── commissioning | └── <commissioning-tag> | |── raw | ├── processed | ├── shared | └── scratch_cc └── common └── <beamline>
Description
- 'local':
- A 3 TiB local share of the beamline file-system which stays there independently of the beamtimes
- It is managed by the beamlines themselves
- There is no syncing across to the core file-system.
- It serves as a local buffer.
- Anybody on the beamline can read/write from/to it
- Cannot be accessed from the core file-system
- 'current':
- Non-permanent share from the beamline file-system
- It will appear when a beamtime is started and disappear if it is stopped
Meaning of the different directories:
- raw:
- For raw data
- will be
- migrated into the core file-system
- written to tape
- shown in the Gamma-portal
- processed
- For meaningful processed data
- will be
- migrated into the core file-system
- written to tape
- shown in the Gamma-portal
- shared
- For user specific macros, scripts, metadata, text-files,...
- will be
- migrated into the core file-system
- written to tape
- shown in the Gamma-portal
- scratch
- Meant for
- temporarily data
- data it is not known in advance if is meaningful or not. That data can be written here and if its meaningful copied into 'processed' afterwards.
- will not be migrated into the core file-system
- Meant for
- raw:
- 'commissioning'
- Same as 'current' but for commissioning runs
- Commissioning runs are limited to a 1 TiB hard quota
- 'common':
- Mounted read-only in the beamline space
- Its world-readable meaning that all beamlines can read it
- Meant for documentation, macros, ... provided to the users by the beamline staff
- If users has to edit something, like a macro, they can copy it into 'shared'
- Can be changed from the core side by the beamline staff
Description
- Access only with a valid DESY or Science Account
- '<facility>'
- Determines the facility, where the data has been acquired
- Either "petra3" or "flash"
- The remaining directory structure is identical between both facilities