Overview of the Cluster Configuration

This document gives a short overview of the resources available on the LRZ Linux Cluster.

LRZ Linux Cluster Overview

The LRZ Linux Cluster consists of several segments with different types of interconnect and different sizes of shared memory. All systems have a (virtual) 64 bit address space:

  • CooLMUC2 Cluster with 28-way Haswell-based nodes and FDR14 Infiniband interconnect, used for both serial and parallel processing
  • Intel Broadwell based 6 TByte shared memory server HP DL580
  • CooLMUC3 Cluster with 64-way KNL 7210-F many-core processors and Intel Omnipath OPA1 interconnect, for parallel/vector processing

Based on the various node types the LRZ Linux cluster offers a wide span of capabilities:

  • mixed shared and distributed memory
  • large software portfolio
  • flexible usage due to various available memory sizes
  • parallelization by message passing (MPI)
  • shared memory parallelization with OpenMP or pthreads
  • mixed (hybrid) programming with MPI and OpenMP

Hardware

Architecture Total Numbers Max Job Limits How to get access
System Name CPU Cores
per Node
RAM
per Node
[GB]
Nodes Cores Nodes Cores Wall
Time
Max. aggreg.
RAM
Queue Login Node
Linux-Cluster
CoolMUC2
Intel Xeon
E5-2697 v3 ("Haswell")
28 64 384 10752 60 1680 48h 3.8 TB mpp2

lxlogin5.lrz.de, lxlogin6.lrz.de,
lxlogin7.lrz.de

Linux-Cluster
CoolMUC2
Intel Xeon
E5-2697 v3 ("Haswell")
28 64 1 28 1 28 96h 64 GB serial lxlogin5.lrz.de, lxlogin6.lrz.de,
lxlogin7.lrz.de
Linux-Cluster
Hugemem
Intel Xeon
E5-2660 v2
("Sandy Bridge")
20 240 11 220 1 20 168h 240 GB hugemem lxlogin5.lrz.de,
lxlogin6.lrz.de,
lxlogin7.lrz.de
Linux-Cluster
Hugemem
Intel Xeon
E5-2660 v2
("Sandy Bridge")
20 480 1 20 1 20 168h 480 GB hugemem lxlogin5.lrz.de,
lxlogin6.lrz.de,
lxlogin7.lrz.de
Linux-Cluster
Teramem
Intel Xeon E7-8890 v4
96  6144  1  96  1  96  48h 6.1 TB inter lxlogin5.lrz.de,
lxlogin6.lrz.de,
lxlogin7.lrz.de
Linux Cluster
Many Core
Intel Xeon Phi (Knights Landing)  64

RAM:96

HBM:16

 148  64  32  64  24h RAM:2880GB
HBM:512GB
 mpp3 lxlogin8.lrz.de

For details on the usage of the background storage, please consult the LRZ document on available file systems.