At the OLCF, the 200-petaflop system called Summit is available to INCITE users in 2021. The Summit system has very powerful, large memory nodes that are most effective for those applications that utilize the GPUs efficiently. The machine also has node-local, non-volatile memory (NV) that can be used to increase I/O bandwidth or provide expanded local storage for applications. The peak node performance is 42 teraflops (TF) per node with 512 gigabytes (GiB) of DDR4 memory, 96 GiB of HBM2 memory, and 1,400 GiB of available non-volatile memory.
|Summit System Configuration|
|Node:||2 IBM Power9 processors + 6 NVIDIA Volta GPUs|
|Compute Nodes:||4,608 hybrid nodes|
|Node performance:||42 TF|
|Memory/node:||512 GiB DDR4 + 96 GiB High Bandwidth Memory (HBM2)|
|Available NV memory per node:||1,400 GiB|
|GPU link:||NVLink 2.0|
|Total system memory:||>10 PB (DDR4 + HBM2 + Non-volatile)|
|Interconnect:||Non-blocking Fat Tree|
(Node injection bandwidth):
|Dual Port EDR-IB (25 GB/second)|
|File system:||250 PB, 2.5 Terabytes/s, GPFS|
|Peak Speed:||200 PF|
Summit uses IBM’s Spectrum Scale™ file system. It has 250 petabytes (PB) of capacity and bandwidth of up to 2.5 terabytes/second (TB/s). In addition, each node has 1.4 TiB of available non-volatile memory that provides high-speed local storage as well as serving as a burst buffer in front of the file system. Also, all OLCF users have access to the HPSS data archive, the Rhea pre- and post-processing cluster and to the EVEREST high-resolution visualization facility. All of these resources are available through high-performance networks including ESnet’s recently upgraded 100 Gb/s links.
For more information about any of the OLCF resources, please visit https://www.olcf.ornl.gov/olcf-resources/Summit Website