Configuration of the VSC-2

• 1314 compute nodes
  • chassis: SlashFive (from Megware),
  • CPU: 2 x AMD Opteron Magny Cours 6132HE (8 Cores, 2.2 GHz)
  • RAM: 8 x 4 GB ECC DDR3
  • HD: 16 GB SSD
  • Network:
    • 2 x Gigabit Ethernet LAN
    • 1 x Infiniband QDR

• Total number of available processor cores: 21024
• Maximum available memory: 42.0 TB

• Power consumption (maximum load): 420 kW
• R_max: 135.6 TFlops
• R_peak: 185.0 TFlops

• Three login servers, two master nodes
  • chassis Megware Saxonide 6100 Dual Opteron
  • CPU: 2 x AMD Opteron Magny Cours 6132HE (8 Cores, 2,2 GHz)
  • RAM: 8 x 4 GB ECC DDR3
  • HD:  RAID 1 Verbund mit 300 GB
  • Netzwork:
    • 2 x Gigabit Ethernet LAN
    • 1 x Infiniband-QDR
  • redundant power supply

• High Performance Infiniband QDR Netzwerk
  • 80 Switches Voltaire Grid Director 4036
  • 36 ports per Switch
  • Fat-tree topology, two sub networks
  • 8 root switches (see diagram)
  • 12 spine switches in each sub network
  • 672 ports in each sub network, 1344 in total
  • possibility of extension by a third subnetwork with 672 ports
  • Diagram of the IB network structure

• two Gbit networks.
• Parallel file system (Fraunhofer FHGFS):
  • temporary file space for running jobs,
  • 12 storage servers with 12x2 TB file space each
  • 6000 MB/s for i/o operations.

• Operating System: Linux (Scientific Linux 6.0)
• Management software:
  • Oracle Grid Engine
  • ClustWare-Appliance (from Megware)
• Cooling: Knürr CoolTherm^® – Water cooled server rack with 17 kW cooling power each