The 200-petaflop system called Summit, is available to users through INCITE 2022 program. The Summit system has very powerful, large memory nodes that are most effective for those applications that effectively use the GPUs. The machine also has node-local, non-volatile memory that can be used to increase I/O bandwidth or provide expanded local storage for applications. The peak node performance is 42 teraflops per node with 512 gigabytes of DDR4 memory, 96 gigabytes of HBM2 memory, and 1,600 gigabytes of non-volatile memory.
|Summit System Configuration|
|Node:||2 IBM Power9 processors + 6 NVIDIA Volta GPUs|
|Compute Nodes:||4,608 hybrid nodes|
|Node performance:||42 TF|
|Memory/node:||512 GB DDR4 + 96 GB High Bandwidth Memory (HBM2)|
|Available NV memory per node:||1,600 GB|
|GPU link:||NVLink 2.0|
|Total system memory:||>10 PB (DDR4 + HBM2 + Non-volatile)|
|Interconnect:||Non-blocking Fat Tree|
(Node injection bandwidth):
|Dual Rail EDR-IB (25 GB/s)|
|File system:||250 PB, 2.5 TB/s, GPFS|
|Peak Speed:||200 PF|
Summit uses IBM’s Spectrum Scale™ file system. It will have 250 PB of capacity and bandwidth of up to 2.5 TB/second. In addition, each node has a 1.6 TB of non-volatile memory that provides high-speed local storage as well as serving as a burst buffer in front of the file system. All OLCF users will have access to the HPSS data archive, the Rhea and Eos pre- and post-processing clusters, and the EVEREST high-resolution visualization facility. All of these resources are available through high-performance networks including ESnet’s recently upgraded 100 gigabit per second links.
For more information about any of the OLCF resources, please visit https://www.olcf.ornl.gov/olcf-resources/Summit Website