Druckansicht der Internetadresse:

Forschungszentrum für wissenschaftliches Rechnen an der Universität Bayreuth

Seite drucken

btrzx5 (2009)

General remarks

The cluster btrzx5 went into operation in 2009 and the most aged clusters at the University of Bayreuth that is still in use. Besides two login nodes, it features several different node types with the overlapping properties p1, p2, p3, p4, sdr, qdr, and qchem which are connected by an SDR or QDR InfiniBand network, respectively.

Login nodes

  • btrzx5-1.rz.uni-bayreuth.de
  • btrzx5-2.rz.uni-bayreuth.de

Compute nodes (state June 2018)

  • 140 nodes (p1qdr)
    2x Intel Xeon E5520 @ 2.27GHz (Bloomfield) with 2x 12GB RAM
    (in total 8 physical cores, hyperthreading enabled)
  • 62 nodes (p2sdr)
    2x Intel Xeon E5520 @ 2.27GHz (Bloomfield) with 2x 12GB RAM
    (in total 8 physical cores, hyperthreading disabled)
  • 52 nodes (p3qdr)
    2x Intel Xeon E5620 @ 2.40GHz (Westmere) with 2x 12GB RAM
    (in total 8 physical cores, hyperthreading disabled)
  • 8 nodes (p4qdr)
    2x Intel Xeon E5-2670 @ 2.60GHz (Sandy Bridge) with 2x 32GB RAM
    (in total 16 physical cores, hyperthreading disabled)

Queues

  • default
    Wall time limit: 500 hours
    Restrictions: no

Network

  • Single Data Rate InfiniBand (sdr)
  • Quadruple Data Rate InfiniBand (qdr)

Commissioning & Extension

  • Commissioning: 2009
  • Several extensions (p2, p3, p4 nodes)

Resource Manager & Scheduler

  • PBS Torque
  • Maui

Operating system

  • Suse Linux Enterprise

Node topology (likwid-topology -g)

p1 & p2: Intel Xeon E5520Einklappen
--------------------------------------------------------------------------------
CPU name:	Intel(R) Xeon(R) CPU           E5520  @ 2.27GHz
CPU type:	Intel Core Bloomfield processor
CPU stepping:	5
********************************************************************************
Hardware Thread Topology
********************************************************************************
Sockets:		2
Cores per socket:	4
Threads per core:	1
--------------------------------------------------------------------------------
HWThread	Thread		Core		Socket		Available
0		0		0		0		*
1		0		1		0		*
2		0		2		0		*
3		0		3		0		*
4		0		4		1		*
5		0		5		1		*
6		0		6		1		*
7		0		7		1		*
--------------------------------------------------------------------------------
Socket 0:		( 0 1 2 3 )
Socket 1:		( 4 5 6 7 )
--------------------------------------------------------------------------------
********************************************************************************
Cache Topology
********************************************************************************
Level:			1
Size:			32 kB
Cache groups:		( 0 ) ( 1 ) ( 2 ) ( 3 ) ( 4 ) ( 5 ) ( 6 ) ( 7 )
--------------------------------------------------------------------------------
Level:			2
Size:			256 kB
Cache groups:		( 0 ) ( 1 ) ( 2 ) ( 3 ) ( 4 ) ( 5 ) ( 6 ) ( 7 )
--------------------------------------------------------------------------------
Level:			3
Size:			8 MB
Cache groups:		( 0 1 2 3 ) ( 4 5 6 7 )
--------------------------------------------------------------------------------
********************************************************************************
NUMA Topology
********************************************************************************
NUMA domains:		2
--------------------------------------------------------------------------------
Domain:			0
Processors:		( 0 1 2 3 )
Distances:		10 20
Free memory:		11427.6 MB
Total memory:		12279.1 MB
--------------------------------------------------------------------------------
Domain:			1
Processors:		( 4 5 6 7 )
Distances:		20 10
Free memory:		11468.6 MB
Total memory:		12288 MB
--------------------------------------------------------------------------------


********************************************************************************
Graphical Topology
********************************************************************************
Socket 0:
+---------------------------------------------+
| +--------+ +--------+ +--------+ +--------+ |
| |    0   | |    1   | |    2   | |    3   | |
| +--------+ +--------+ +--------+ +--------+ |
| +--------+ +--------+ +--------+ +--------+ |
| |  32 kB | |  32 kB | |  32 kB | |  32 kB | |
| +--------+ +--------+ +--------+ +--------+ |
| +--------+ +--------+ +--------+ +--------+ |
| | 256 kB | | 256 kB | | 256 kB | | 256 kB | |
| +--------+ +--------+ +--------+ +--------+ |
| +-----------------------------------------+ |
| |                   8 MB                  | |
| +-----------------------------------------+ |
+---------------------------------------------+
Socket 1:
+---------------------------------------------+
| +--------+ +--------+ +--------+ +--------+ |
| |    4   | |    5   | |    6   | |    7   | |
| +--------+ +--------+ +--------+ +--------+ |
| +--------+ +--------+ +--------+ +--------+ |
| |  32 kB | |  32 kB | |  32 kB | |  32 kB | |
| +--------+ +--------+ +--------+ +--------+ |
| +--------+ +--------+ +--------+ +--------+ |
| | 256 kB | | 256 kB | | 256 kB | | 256 kB | |
| +--------+ +--------+ +--------+ +--------+ |
| +-----------------------------------------+ |
| |                   8 MB                  | |
| +-----------------------------------------+ |
+---------------------------------------------+
p3: Intel Xeon E5620Einklappen
--------------------------------------------------------------------------------
CPU name:	Intel(R) Xeon(R) CPU           E5620  @ 2.40GHz
CPU type:	Intel Core Westmere processor
CPU stepping:	2
********************************************************************************
Hardware Thread Topology
********************************************************************************
Sockets:		2
Cores per socket:	4
Threads per core:	1
--------------------------------------------------------------------------------
HWThread	Thread		Core		Socket		Available
0		0		0		0		*
1		0		1		0		*
2		0		2		0		*
3		0		3		0		*
4		0		4		1		*
5		0		5		1		*
6		0		6		1		*
7		0		7		1		*
--------------------------------------------------------------------------------
Socket 0:		( 0 1 2 3 )
Socket 1:		( 4 5 6 7 )
--------------------------------------------------------------------------------
********************************************************************************
Cache Topology
********************************************************************************
Level:			1
Size:			32 kB
Cache groups:		( 0 ) ( 1 ) ( 2 ) ( 3 ) ( 4 ) ( 5 ) ( 6 ) ( 7 )
--------------------------------------------------------------------------------
Level:			2
Size:			256 kB
Cache groups:		( 0 ) ( 1 ) ( 2 ) ( 3 ) ( 4 ) ( 5 ) ( 6 ) ( 7 )
--------------------------------------------------------------------------------
Level:			3
Size:			12 MB
Cache groups:		( 0 1 2 3 ) ( 4 5 6 7 )
--------------------------------------------------------------------------------
********************************************************************************
NUMA Topology
********************************************************************************
NUMA domains:		2
--------------------------------------------------------------------------------
Domain:			0
Processors:		( 0 1 2 3 )
Distances:		10 21
Free memory:		11344.2 MB
Total memory:		12279 MB
--------------------------------------------------------------------------------
Domain:			1
Processors:		( 4 5 6 7 )
Distances:		21 10
Free memory:		11880.8 MB
Total memory:		12288 MB
--------------------------------------------------------------------------------


********************************************************************************
Graphical Topology
********************************************************************************
Socket 0:
+---------------------------------------------+
| +--------+ +--------+ +--------+ +--------+ |
| |    0   | |    1   | |    2   | |    3   | |
| +--------+ +--------+ +--------+ +--------+ |
| +--------+ +--------+ +--------+ +--------+ |
| |  32 kB | |  32 kB | |  32 kB | |  32 kB | |
| +--------+ +--------+ +--------+ +--------+ |
| +--------+ +--------+ +--------+ +--------+ |
| | 256 kB | | 256 kB | | 256 kB | | 256 kB | |
| +--------+ +--------+ +--------+ +--------+ |
| +-----------------------------------------+ |
| |                  12 MB                  | |
| +-----------------------------------------+ |
+---------------------------------------------+
Socket 1:
+---------------------------------------------+
| +--------+ +--------+ +--------+ +--------+ |
| |    4   | |    5   | |    6   | |    7   | |
| +--------+ +--------+ +--------+ +--------+ |
| +--------+ +--------+ +--------+ +--------+ |
| |  32 kB | |  32 kB | |  32 kB | |  32 kB | |
| +--------+ +--------+ +--------+ +--------+ |
| +--------+ +--------+ +--------+ +--------+ |
| | 256 kB | | 256 kB | | 256 kB | | 256 kB | |
| +--------+ +--------+ +--------+ +--------+ |
| +-----------------------------------------+ |
| |                  12 MB                  | |
| +-----------------------------------------+ |
+---------------------------------------------+
p4: Intel Xeon E5-2670Einklappen
--------------------------------------------------------------------------------
CPU name:	Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz
CPU type:	Intel Xeon SandyBridge EN/EP processor
CPU stepping:	7
********************************************************************************
Hardware Thread Topology
********************************************************************************
Sockets:		2
Cores per socket:	8
Threads per core:	1
--------------------------------------------------------------------------------
HWThread	Thread		Core		Socket		Available
0		0		0		0		*
1		0		1		0		*
2		0		2		0		*
3		0		3		0		*
4		0		4		0		*
5		0		5		0		*
6		0		6		0		*
7		0		7		0		*
8		0		8		1		*
9		0		9		1		*
10		0		10		1		*
11		0		11		1		*
12		0		12		1		*
13		0		13		1		*
14		0		14		1		*
15		0		15		1		*
--------------------------------------------------------------------------------
Socket 0:		( 0 1 2 3 4 5 6 7 )
Socket 1:		( 8 9 10 11 12 13 14 15 )
--------------------------------------------------------------------------------
********************************************************************************
Cache Topology
********************************************************************************
Level:			1
Size:			32 kB
Cache groups:		( 0 ) ( 1 ) ( 2 ) ( 3 ) ( 4 ) ( 5 ) ( 6 ) ( 7 ) ( 8 ) ( 9 ) ( 10 ) ( 11 ) ( 12 ) ( 13 ) ( 14 ) ( 15 )
--------------------------------------------------------------------------------
Level:			2
Size:			256 kB
Cache groups:		( 0 ) ( 1 ) ( 2 ) ( 3 ) ( 4 ) ( 5 ) ( 6 ) ( 7 ) ( 8 ) ( 9 ) ( 10 ) ( 11 ) ( 12 ) ( 13 ) ( 14 ) ( 15 )
--------------------------------------------------------------------------------
Level:			3
Size:			20 MB
Cache groups:		( 0 1 2 3 4 5 6 7 ) ( 8 9 10 11 12 13 14 15 )
--------------------------------------------------------------------------------
********************************************************************************
NUMA Topology
********************************************************************************
NUMA domains:		2
--------------------------------------------------------------------------------
Domain:			0
Processors:		( 0 1 2 3 4 5 6 7 )
Distances:		10 21
Free memory:		31470 MB
Total memory:		32739.9 MB
--------------------------------------------------------------------------------
Domain:			1
Processors:		( 8 9 10 11 12 13 14 15 )
Distances:		21 10
Free memory:		31850.7 MB
Total memory:		32768 MB
--------------------------------------------------------------------------------


********************************************************************************
Graphical Topology
********************************************************************************
Socket 0:
+-----------------------------------------------------------------------------------------+
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| |    0   | |    1   | |    2   | |    3   | |    4   | |    5   | |    6   | |    7   | |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| |  32 kB | |  32 kB | |  32 kB | |  32 kB | |  32 kB | |  32 kB | |  32 kB | |  32 kB | |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| | 256 kB | | 256 kB | | 256 kB | | 256 kB | | 256 kB | | 256 kB | | 256 kB | | 256 kB | |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| +-------------------------------------------------------------------------------------+ |
| |                                        20 MB                                        | |
| +-------------------------------------------------------------------------------------+ |
+-----------------------------------------------------------------------------------------+
Socket 1:
+-----------------------------------------------------------------------------------------+
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| |    8   | |    9   | |   10   | |   11   | |   12   | |   13   | |   14   | |   15   | |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| |  32 kB | |  32 kB | |  32 kB | |  32 kB | |  32 kB | |  32 kB | |  32 kB | |  32 kB | |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| | 256 kB | | 256 kB | | 256 kB | | 256 kB | | 256 kB | | 256 kB | | 256 kB | | 256 kB | |
| +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ +--------+ |
| +-------------------------------------------------------------------------------------+ |
| |                                        20 MB                                        | |
| +-------------------------------------------------------------------------------------+ |
+-----------------------------------------------------------------------------------------+

Verantwortlich für die Redaktion: Dr.rer.nat. Ingo Schelter

Facebook Twitter Youtube-Kanal Instagram Blog Kontakt