The NAF is reachable via ssh
, through an internet browser ssh interface and through Jupyter notebooks.
For access to the NAF, you need a DESY user account and the correct resources assigned to you. Please ask your group leader and your namespace administrator for the necessary capabilities.
ssh Access
Login is possible from outside the DESY network with a ssh
client.
Simply connect to a cluster of work group servers (WGS) with
where naf-YOURGROUP.desy.de
is the WGS address of your group listed below. You should use the generic name (e.g. naf-YOURGROUP.desy.de) instead of a particular server name (e.g. naf-YOURGROUP11.desy.de) in general, since we balance the load and availability behind the generic name.
Browser Access & Remote Desktop:
Point your browser to one of our generic systems:
- https://naf-x-el.desy.de:3389 ... currently, an CentOS 7 system
- https://naf-x-ubuntu.desy.de:3389 ... currently, an Ubuntu 20.04 system
You can also use a dedicated client if you make much use of FastX, please contact naf-helpdesk@desy.de for more information.
See below for more information on the configuration and usage of these systems.
Jupyter Hub
Jupyter provides interactive notebooks based on Python. Please check the dedicated documentation on how to use Jupyter notebooks on the NAF.
Usage of WGS
Be reasonable when you use the WGS as you are sharing the resources with your colleagues and any (mis)use will affect them. So, please be careful and nice to your colleagues. As a rule of thumb, use the WGS for development, short (<10min) test jobs, graphical things, ... Do not use the WGS for longer lasting processes, or processes that do not require interactive return. Such processes are best placed onto the batch system - which has much more resources and resource control mechanisms.
We check WGS on a daily basis, and if we find long running jobs or jobs consuming huge amounts of memory, we write an automated email.
We have to reboot systems to activate new kernels. Using load balancing and alias mechanisms, we try hard to keep logins alive for at least one week. Sometimes we must act faster, though.
NAF Work-Group-Server WGS
Usually, you will login via ssh to a WGS (work group server). Usually, one or more WGS exists per experiment. HTCondor is available on all nodes for submission into the NAF/BIRD
Name | OS | Purpose | Comment |
---|---|---|---|
naf-atlas.desy.de | EL7 | ATLAS Group Workgroup Server | cluster with members naf-atlas{11..18} |
ATLAS special Workgroup Server | multithreaded and high density tracking development | ||
naf-cms.desy.de | EL7 | CMS Group Workgroup Server | cluster with members naf-cms{12..16} |
naf-desy-cms.desy.de | EL7 | CMS Workgroup Server (DESY) | dedicated WGS cluster for CMS DESY group. naf-cms{20,22,23,24}.desy.de |
naf-belle2.desy.de | EL7 | Belle II Group Workgroup Server | cluster with members naf-belle{11..12} |
naf-hone.desy.de | EL7 | H1 Group Workgroup Server | cluster with members naf-hone{11..12} (partly naf-hone-el7.desy.de) |
naf-ilc.desy.de | EL7 | ILC Group Workgroup Server | cluster with members naf-ilc{11..12} |
naf-iaxo.desy.de | EL7 | IAXO Group Workgroup Server | cluster with members naf-iaxo{01..02} |
naf-luxe.desy.de | EL7 | LUXE Group Workgroup Server | cluster with members naf-luxe{01..02} |
naf-m.desy.de | EL7 | M Group Workgroup Server | cluster with members naf-m{01..02} |
naf-zeus-el7.desy.de | EL7 | naf-zeus12.desy.de | |
naf-lhcb11.desy.de | EL7 | ||
naf-zeus | ❌ | ❌ | decommissioned |
Other Work-Group-Server WGS with access to BIRD batch system
Name | OS | Physiclal/VM | Purpose | Comment |
---|---|---|---|---|
pal.desy.de | EL7 | generic login nodes | cluster with members pal{51..54} | |
uh2neutrino-wgs04.desy.de | ||||
theo-wgs{11,12}.desy.de | ||||
astro-wgs{11,12}.desy.de |
(Operating system: EL7 = CentOS 7 - for other operating system please consider using Singularity containers on the NAF)
Grid Commands
The generic Grid commands are not automatically set up on the WGS' but can be easily sourced:
naf-xxx: [~] source /cvmfs/grid.desy.de/etc/profile.d/grid-ui-env.sh Using Grid environment in '/cvmfs/grid.cern.ch/centos7-umd4-ui-4_200423'. Adding DESY site environment.
NAF Remote Desktop
You can run graphics application on the NAF by logging in like the following: ssh -X user@naf-wgs.desy.de
This works ... but the X-protocol is not good at handling latency. Whereas this will work sufficiently fast and fluid when you log in from a DESY Hamburg machine (be it your desktop or your laptop), a login from DESY Zeuthen or CERN will result in a much slower work even if the bandwidth is sufficiently large. This is even worse when you log in from your home computer via DSL or from a mobile device.
A possible alternative is the usage of a protocol that hides the latency. NX-like protocols and tools can do this, but they need client and server programs.
Our idea is to give NAF users working from remote access to a machine acting as "a desktop at DESY" via such an NX-like protocol. This desktop can then be used to perform the ssh -X user@naf-wgs.desy.de
necessary to run the graphics application.
The product used is the FastX product from Starnet.
Here you see an example usage. The left part shows how a remote user would run graphical application on a WGS, whereas the right part shows a Hamburg user.
Access:
Point your browser to one of our generic systems:
- https://naf-x-el.desy.de:3389 ... currently, an CentOS 7 system
- https://naf-x-ubuntu.desy.de:3389 ... currently, an Ubuntu 20.04 system
You can also use a dedicated client if you make much use of FastX, please contact naf-helpdesk@desy.de for more information.
Comments:
I just figured out that one needs to hack the FastX client, if one uses it on Fedora 30, 31, 32 or CentOS 8. This might apply to other more recent distros. Error message: /opt/FastX/FastX: symbol lookup error: /lib64/libfontconfig.so.1: undefined symbol: FT_Done_MM_Var As root got to /opt/FastX/lib and rename libfreetype.so.6 e.g. NO_libfreetype.so.6 Hint found here: https://mathematica.stackexchange.com/questions/189306/cant-launch-mathematica-11-on-fedora-29
Posted by wissing at 28. Jun. 2019 13:48
|
Die Liste der WGS muss mal ueebrarbeitet werden.
Posted by gellrich at 07. Jan. 2021 15:15
|
... und das waere ...
Posted by flemming at 08. Jan. 2021 11:25
|
CMS habe ich gerade nach bestem Wissen angepaßt. Allerdings sind die Poise Cluster naf-desy-cms und naf-desy-cms-el7 da noch nicht ganz angepaßt.
Posted by wissing at 08. Jan. 2021 11:30
|