The new HPC cluster has the same name, Talapas (pronounced TA-la-pas) but with newer hardware and operating system. Although some things have changed, most changes are for the better, and most software should continue to “just work”. |
Red Hat Enterprise Linux 8 (RHEL8) operating system
Intel (Ice Lake) and AMD (Milan) 3rd generation processors
Optane and DDR4 3200MT/s memory
Nvidia 80GB A100 PCIe4 GPUs
More storage in user home directories and job I/O scratch space
Talapas uses UO Identity Access Management system, Microsoft Active Directory, for authentication which requires all users to have a valid UO Duckid.
Links are provided below for external collaborators or graduating researchers to continue their access to the cluster.
External collaborators (2 options):
Graduating researchers:
A virtual private network (VPN) connection is required to access the cluster. This adds an extra layer of security. The Talapas VPN should provide all the same capabilities as UO VPN as well as adding access to Talapas.
Instructions here: Article - Getting Started with UO VPN (uoregon.edu)
Use “uovpn.uoregon.edu/talapas" as the connection URL and your duckid and password.
Advanced users might want to use OpenConnect, OpenConnect VPN client. This would support connection using a command such as,
sudo openconnect --protocol=anyconnect uovpn.uoregon.edu/talapas |
Note: do not repeatedly attempt to log in when you’re getting error messages. As with other uses of your DuckID at UO, if you generate a large number of login failures, all DuckID access (including things like e-mail) will be locked University-wide. Similarly, be aware of automated processes like cron jobs that might trigger this situation without your notice.
Note that inbound access to the new cluster is only allowed for SSH and Open OnDemand (coming soon). All other ports are blocked.
The preferred method of access is via login.talapas.uoregon.edu
The new cluster has 3 login nodes. A load balancer is used to redirect SSH connections to different login nodes to spread the load. The load balancers choice of login node is “sticky” in that repeated connections from your IP address will go to the same login node - as long as there has been some activity within the last 24 hours.
Default memory is set to 4GB per CPU; use the --mem or --mem-per-cpu flag to adjust.
There is no default partition, you must specify partition(s) with --partition.
The slurm account (PIRG) is still required, specify with --account.
compute
computelong
gpu
gpulong
interactive
interactivegpu
memory
memorylong
3 GPU memory sizes are available, 10GB, 40GB, 80GB. Specify the GPU size with --constraint, for example: --constraint=gpu-10gb
Due to limitations with CUDA MIG slicing, it appears that a job can only use one slice (GPU) per host. That means one GPU per job unless MPI is being used to orchestrate GPU usage on multiple hosts. See NVIDIA Multi-Instance GPU User Guide :: NVIDIA Tesla Documentation.
Open OnDemand
New Intel compilers
40GB and 80GB plus more 10GB A100 MIG slices
cron jobs
These probably won’t affect you, but they are visible differences that you might notice.
Hostnames now use the long form. (e.g., “login1.talapas.uoregon.edu”)
Use the long form of hostnames to access other campus hosts. That is, somehost.uoregon.edu.
Linux group names have changed to reflect their Active Directory name and are now longer. For example, is.racs.pirg.your_pirg instead of your_pirg.