Overview of the Cluster Configuration

This document gives a short overview of the resources available on the LRZ Linux Cluster.

LRZ Linux Cluster Overview

The LRZ Linux Cluster consists of several segments with different types of interconnect and different sizes of shared memory. All systems have a (virtual) 64 bit address space.

  • Intel Xeon based 4-way nodes for serial processing
  • MPP Cluster with 16-way AMD-based nodes and QDR Infiniband interconnect (system will be retired)
  • CooLMUC2 Cluster with 28-way Haswell-based nodes and FDR14 Infiniband interconnect
  • Intel Broadwell based 6 TByte shared memory server HP DL580

Based on the various node types the LRZ Linux cluster offers a wide span of capabilities:

  • mixed shared and distributed memory
  • large software portfolio
  • flexible usage due to various available memory sizes
  • parallelization by message passing (MPI)
  • shared memory parallelization with OpenMP or pthreads
  • mixed (hybrid) programming with MPI and OpenMP

Hardware

Architecture Total Numbers Max Job Limits How to get access Disk storage
System Name CPU Cores
per Node
RAM
per Node
[GB]
Nodes Cores Nodes Cores Wall
Time
Max. aggreg.
RAM
Queue Login Node

SCRATCH

PROJECT

Linux-Cluster
CoolMUC2
Intel Xeon
E5-2697 v3 ("Haswell")
28 64 384 10752 60 1680 48h 3.8 TB mpp2 lxlogin5.lrz.de, lxlogin6.lrz.de

NAS:
Capacity
1000
TByte
Bandwidth
2 GByte/s

GPFS:
Capacity
1400 TByte
Bandwidth
25 Gbyte/s

Group quota:
up to
5 TB
(NAS)

Bandwidth
2 GByte/s

Linux-Cluster
CoolMUC2
Intel Xeon
E5-2697 v3 ("Haswell")
28 64 1 28 1 28 96h 64 GB serial lxlogin5.lrz.de, lxlogin6.lrz.de
Linux-Cluster
Hugemem
Intel Xeon
E5-2660 v2
("Sandy Bridge")
20 240 11 220 1 20 168h 240 GB hugemem lxlogin1.lrz.de
Linux-Cluster
Hugemem
Intel Xeon
E5-2660 v2
("Sandy Bridge")
20 480 1 20 1 20 168h 480 GB hugemem lxlogin1.lrz.de
Linux-Cluster
Teramem
Intel Xeon E7-8890 v4
96  6144  1  96  1  96  48h 6.1 TB inter any cluster login node
Linux Cluster
Many Core
Intel Xeon Phi (Knights Landing)  64  96  1  64  1  64  24h RAM:96GB
+HBM:32GB
  contact servicedesk

For details on the usage of the background storage, please consult the appropriate LRZ document.