Computing
Page tree
Frank Schluenzen posted on 09. Dec. 2015 15:32h - last edited by Frank Schluenzen on 17. Jan. 2019 15:11h

The Maxwell cluster allows to bring in group resources to become part of the cluster. The Maxwell cluster is organized in (SLURM) partitions which can be tuned to meet the individual requirements. In general, group partitions can be configured to be available for all Maxwell users, but prioritizing group members for their partitions, removing all "hostile" jobs within an adjustable period of time. Advance reservations are currently only possible for SLURM admins, but we are working on it. Let us know if you need to reserve nodes in advance!

The current partition scheme

  • The Maxwell partition. This is the default partition containing. If you don't specify a partition, your jobs are scheduled for the maxwell partition.
  • The EXFEL partitions for European XFEL groups and external users
  • The Photon Science partition for members of FS. Use -p ps to select the photon science partition.
  • The PSX partition for external Photon Science users. Use -p psx to select this partition.
  • The CFEL partition consisting of the resources of the CFEL-DESY groups. Use -p cfel to select this partition.
  • The CSSB partition consisting of CSSB resources. Use -p cssb to select this partition.
  • The PETRA4 partition consisting of resources for Petra4 design.
  • The XFEL partitions for operation and simulation of the XFEL accelerator at DESY.
  • The CMS partitions.
  • The ALL partition consisting of almost all nodes from the all partitions. Use -p all to select this partition. Please note that preemption-rules apply!

There are more partitions in maxwell. Have a look at the partition overview also for the job limits applying!

Check out the hardware pages for details of all nodes available as well as for individual partitions.

Login Nodes / Job-Submission Hosts

For the various partitions and hardware platforms different login nodes are available, mostly for compilation and tests of applications requiring specific hardware. Job-Submission can always be done from any of the login nodes, regardless of the partition or hardware requested.  A quick overview over available login nodes:

Login namePartitionAccessScopeURLComments
max-displayNONEany maxwell usergeneric graphical login nodeshttps://max-display.desy.de:3443/Accessible from outside
max-wgsNONEany maxwell usergeneric login nodes
remote via bastion
max-wgsaNONEany maxwell usergeneric login nodes
will be decommissioned
European XFEL
max-exflEXFEL, UPEXEXFEL members & usersinteractive CPU node for EXFEL
remote via bastion
max-exfl-displayEXFEL, UPEXEXFEL members & usersgraphical login node
coming soon
Photon Science
max-fscPSFS membersinteractive CPU nodehttps://max-fsc.desy.de:3443/remote via bastion
max-fsgPSFS membersinteractive GPU nodehttps://max-fsg.desy.de:3443/remote via bastion
desy-ps-cpuPSXExternal Photon Science usersinteractive CPU nodehttps://desy-ps-cpu.desy.de:3443/remote via desy-ps-ext
desy-ps-gpuPSXExternal Photon Science usersinteractive GPU nodehttps://desy-ps-gpu.desy.de:3443/remote via desy-ps-ext
max-novaNONEnova users onlygraphical login nodes for the NOVA projecthttps://max-nova.desy.de:3443/Accessible from outside
CFEL
max-cfelCFELCFEL DESY usersinteractive CPU nodes for CFEL
remote via bastion
max-cfelgCFELCFEL DESY usersinteractive GPU nodes for CFEL
remote via bastion
CSSB
max-cssb-displayCSSBALL CSSB maxwell usersgraphical login nodes for CSSBhttps://max-cssb-display.desy.de:3443/tbd
max-cssbaCSSB, UKEMembers of the UKE group in CSSBinteractive CPU node for UKE@CSSB
remote via bastion

A list of all nodes with some hardware specs can be found on the hardware page.

Resources and Partitions

If you are uncertain which partitons you are allowed, you can check it using simple scriplets:

Resource overview 
# from any SL6, Centos7 node on campus (for example pal, bastion, desy-ps-ext)
my-resources   # gives a short overview of the major resources
       Resource   Access   URL                             Comments                                                     
---------------------------------------------------------------------------------------------------------------- 
General Resources      
      desycloud      yes   https://desycloud.desy.de     
            afs      yes   /afs/desy.de/m/monlic         
         oracle      yes   https://it.desy.de            

Compute Resources      
           bird       no   https://bird.desy.de             ask uco@desy.de for the batch resource                        
        maxwell       no   https://maxwell.desy.de          ask maxwell.service@desy.de for the maxwell resource          
  exfel@maxwell       no   https://maxwell.desy.de          please contact it-support@xfel.eu                             
   upex@maxwell       no   https://maxwell.desy.de          please contact it-support@xfel.eu                             
   cfel@maxwell       no   https://maxwell.desy.de          please contact CFEL DESY admins                               
     ps@maxwell       no   https://maxwell.desy.de          please contact fs-ec@desy.de                                  
    psx@maxwell       no   https://maxwell.desy.de          please contact fs-ec@desy.de                                  
   cssb@maxwell       no   https://maxwell.desy.de          please contact it@cssb-hamburg.de                             
 petra4@maxwell       no   https://maxwell.desy.de          please contact MPY admins                                     
   xfel@maxwell       no   https://maxwell.desy.de          please contact MPY admins                                     

Atlassian Tools        
     confluence      yes   https://confluence.desy.de    
           jira       no   https://agira.desy.de            ask your group admins for jira access                         
          stash       no   https://stash.desy.de            ask your group admins for stash access                        
         bamboo       no   https://bamboo.desy.de           ask your group admins for bamboo access                       
---------------------------------------------------------------------------------------------------------------- 
yes: you have access. no:  you don't have access.


# on any of the maxwell login nodes
my-partitions  # gives a detailed overview of all partitions available in maxwell
Partition overview 
# on any of the maxwell login nodes
my-partitions  # gives a detailed overview of all partitions available in maxwell

       Partition   Access   Allowed groups                                                                               
---------------------------------------------------------------------------------------------------------------- 
            all      yes   all                           
           cfel       no   cfel-wgs-users                
            cms       no   max-cms-uhh-users,max-cms-desy-users
       cms-desy       no   max-cms-desy-users            
        cms-uhh       no   max-cms-uhh-users             
           cssb       no   max-cssb-users                
      epyc-eval      yes   all                           
          exfel       no   exfel-wgs-users               
      exfel-spb       no   exfel-theory-users,school-users
       exfel-th       no   exfel-theory-users            
   exfel-theory       no   exfel-theory-users            
     exfel-wp72       no   exfel-theory-users            
        fspetra       no   max-fspetra-users             
           grid       no   max-grid-users                
           jhub      yes   all                           
        maxwell       no   maxwell-users,school-users    
            p06       no   max-p06-users                 
         petra4       no   p4_sim                        
             ps       no   max-ps2-users                 
            psx       no   max-psx2-users                
            uke       no   max-uke-users                 
           upex       no   upex-users,school-users       
     xfel-guest       no   max-xfel-guest-users,p4_sim   
        xfel-op       no   max-xfel-op-users             
       xfel-sim       no   max-xfel-sim-users

Viewing the partition scheme

Simply ssh to any of the login nodes and run sview to get an overview of available partitions, nodes and jobs. sview will per default only  display the partitions you are entitled to use (select "Hidden" under Options if you want to see all of them!)!  The sinfo command gives a more detailed and more customizable view on the partitions and limits. See the sinfo man page for details. 




  • No labels