Computing : NAF Login, WGS and remote Desktop


The NAF is reachable via ssh, through an internet browser ssh interface and through Jupyter notebooks.

For access to the NAF, you need a DESY user account and the correct resources assigned to you. Please ask your group leader and your namespace administrator for the necessary capabilities.

ssh Access

Login is possible from outside the DESY network with a ssh client.

Simply connect to a cluster of work group servers (WGS) with

ssh account@naf-YOURGROUP.desy.de 

where naf-YOURGROUP.desy.de is the WGS address of your group listed below. You should use the generic name (e.g. naf-YOURGROUP.desy.de) instead of a particular server name (e.g. naf-YOURGROUP11.desy.de) in general, since we balance the load and availability behind the generic name.

Browser Access & Remote Desktop:

Point your browser to one of our generic systems:

You can also use a dedicated client if you make much use of FastX, please contact naf-helpdesk@desy.de for more information.

See below for more information on the configuration and usage of these systems.

Jupyter Hub

Jupyter provides interactive notebooks based on Python. Please check the dedicated documentation on how to use Jupyter notebooks on the NAF.


Usage of WGS

Be reasonable when you use the WGS as you are sharing the resources with your colleagues and any (mis)use will affect them. So, please be careful and nice to your colleagues. As a rule of thumb, use the WGS for development, short (<10min) test jobs, graphical things, ... Do not use the WGS for longer lasting processes, or processes that do not require interactive return. Such processes are best placed onto the batch system - which has much more resources and resource control mechanisms.

We check WGS on a daily basis, and if we find long running jobs or jobs consuming huge amounts of memory, we write an automated email.

We have to reboot systems to activate new kernels. Using load balancing and alias mechanisms, we try hard to keep logins alive for at least one week. Sometimes we must act faster, though.




NAF Work-Group-Server WGS

Usually, you will login via ssh to a WGS (work group server). Usually, one or more WGS exists per experiment. HTCondor is available on all nodes for submission into the NAF/BIRD


NameOSPurposeComment
naf-atlas.desy.deEL7ATLAS Group Workgroup Servercluster with members naf-atlas{11..18}


ATLAS special Workgroup Server

multithreaded and high density tracking development

naf-cms.desy.deEL7CMS Group Workgroup Servercluster with members naf-cms{12..16}

naf-desy-cms.desy.de

EL7CMS Workgroup Server (DESY)dedicated WGS cluster for CMS DESY group. naf-cms{20,22,23,24}.desy.de
naf-belle2.desy.deEL7Belle II Group Workgroup Servercluster with members naf-belle{11..12}
naf-hone.desy.deEL7H1 Group Workgroup Servercluster with members naf-hone{11..12}
(partly naf-hone-el7.desy.de)
naf-ilc.desy.deEL7ILC Group Workgroup Servercluster with members naf-ilc{11..12}
naf-iaxo.desy.deEL7IAXO Group Workgroup Servercluster with members naf-iaxo{01..02}
naf-luxe.desy.deEL7LUXE Group Workgroup Servercluster with members naf-luxe{01..02}
naf-m.desy.deEL7M Group Workgroup Server

cluster with members naf-m{01..02}


naf-zeus-el7.desy.deEL7
naf-zeus12.desy.de
naf-lhcb11.desy.deEL7





naf-zeusdecommissioned


Other Work-Group-Server WGS with access to BIRD batch system

NameOSPhysiclal/VMPurposeComment
pal.desy.deEL7
generic login nodescluster with members pal{51..54}
uh2neutrino-wgs04.desy.de



theo-wgs{11,12}.desy.de



astro-wgs{11,12}.desy.de




(Operating system: EL7 = CentOS 7 - for other operating system please consider using Singularity containers on the NAF)


Grid Commands

The generic Grid commands are not automatically set up on the WGS' but can be easily sourced:

naf-xxx: [~] source /cvmfs/grid.desy.de/etc/profile.d/grid-ui-env.sh
Using Grid environment in '/cvmfs/grid.cern.ch/centos7-umd4-ui-4_200423'.
Adding DESY site environment.



NAF Remote Desktop

You can run graphics application on the NAF by logging in like the following: ssh -X user@naf-wgs.desy.de This works ... but the X-protocol is not good at handling latency. Whereas this will work sufficiently fast and fluid when you log in from a DESY Hamburg machine (be it your desktop or your laptop), a login from DESY Zeuthen or CERN will result in a much slower work even if the bandwidth is sufficiently large. This is even worse when you log in from your home computer via DSL or from a mobile device.

A possible alternative is the usage of a protocol that hides the latency. NX-like protocols and tools can do this, but they need client and server programs.

Our idea is to give NAF users working from remote access to a machine acting as "a desktop at DESY" via such an NX-like protocol. This desktop can then be used to perform the ssh -X user@naf-wgs.desy.de necessary to run the graphics application.

The product used is the FastX  product from Starnet.

Here you see an example usage. The left part shows how a remote user would run graphical application on a WGS, whereas the right part shows a Hamburg user.


Access: 

Point your browser to one of our generic systems:

You can also use a dedicated client if you make much use of FastX, please contact naf-helpdesk@desy.de for more information.


Attachments:

image.png (image/png)
image.png (image/png)

Comments:

I just figured out that one needs to hack the FastX client, if one uses it on  Fedora 30, 31, 32 or CentOS 8. This might apply to other more recent distros.

Error message:

/opt/FastX/FastX: symbol lookup error: /lib64/libfontconfig.so.1: undefined symbol: FT_Done_MM_Var

As root got to /opt/FastX/lib and rename libfreetype.so.6 e.g. NO_libfreetype.so.6

Hint found here: https://mathematica.stackexchange.com/questions/189306/cant-launch-mathematica-11-on-fedora-29

Posted by wissing at 28. Jun. 2019 13:48

Die Liste der WGS muss mal ueebrarbeitet werden.

Posted by gellrich at 07. Jan. 2021 15:15

... und das waere ...

Posted by flemming at 08. Jan. 2021 11:25

CMS habe ich gerade nach bestem Wissen angepaßt. Allerdings sind die Poise Cluster naf-desy-cms und naf-desy-cms-el7 da noch nicht ganz angepaßt.


Posted by wissing at 08. Jan. 2021 11:30