You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 15 Next »

 

beamline file-system
/gpfs/
├── local
├── current
|   ├── raw
|   ├── processed
|   ├── shared
|   └── scratch_bl
└── commissioning
    ├── raw
    ├── processed
    ├── shared
    └── scratch_bl
 
/common/
└── <beamline>
core file-system
/asap3/
└── <facility>
    └── gpfs
        ├── <beamline>
		|	├── <year>
		|		├── data
	    |       |    └── <beamtime-ID>
    	|       |       ├── raw
        |	    |       ├── processed
        |    	|       ├── shared
        |       |	    └── scratch_cc
		|		└── commissioning
        |        	└── <commissioning-tag>
        |            	|── raw
        |            	├── processed
        |            	├── shared
        |            	└── scratch_cc
        └── common
            └── <beamline>

Description:

  • 'local': 
    • A 3 TiB local share of the beamline file-system which stays there independently of the beamtimes
    • It is managed by the beamlines themselves
    • There is no syncing across to the core file-system.
    • It serves as a local buffer.
    • Anybody on the beamline can read/write from/to it
    • Cannot be accessed from the core file-system
  • 'current':
    • Non-permanent share from the beamline file-system
    • It will appear when a beamtime is started and disappear if it is stopped
    • Meaning of the different directories:

      • raw: 
        • For raw data
        • will be 
          • migrated into the core file-system
          • written to tape
          • shown in the Gamma-portal
      • processed
        • For meaningful processed data
        • will be 
          • migrated into the core file-system
          • written to tape
          • shown in the Gamma-portal
      • shared
        • For user specific macros, scripts, metadata, text-files,...
        • will be
          • migrated into the core file-system
          • written to tape
          • shown in the Gamma-portal
      • scratch
        • Meant for 
          • temporarily data
          • data it is not known in advance if is meaningful or not. That data can be written here and if its meaningful copied into 'processed' afterwards.
        • will not be migrated into the core file-system
  • 'commissioning'
    • Same as 'current' but for commissioning runs
    • Commissioning runs are limited to a 1 TiB hard quota
  • 'common':
    • Mounted read-only in the beamline space
    • Its world-readable meaning that all beamlines can read it
    • Meant for documentation, macros, ... provided to the users by the beamline staff
    • If users has to edit something, like a macro, they can copy it into 'shared'
    • Can be changed from the core side by the beamline staff

 

 

  • No labels