Recent Trends in

Supercomputing
Architecture
Sanket Pandhare
 Outline
• HPC Global scenario
• Recent Trends in HPC
• HPC Systems at C-DAC

Centre for Development of Advanced Computing

HPC Global Scenario

Centre for Development of Advanced Computing

Performance Development
11/22 SUM=4.9EFlop/s

11/22 #1 =1.1EFlop/s

11/22 #500=1.7PFlop/s

Source: Top500.org

Centre for Development of Advanced Computing

Architecture

Source: Top500.org

Centre for Development of Advanced Computing

Countries Share

Source: Top500.org

Centre for Development of Advanced Computing

Processor Family/Systems

Source: Top500.org

Centre for Development of Advanced Computing

Interconnect Family

Source: Top500.org

Centre for Development of Advanced Computing

Operating systems family

Source: Top500.org

Centre for Development of Advanced Computing

Accelerator/Co-processor Family

Source: Top500.org

Centre for Development of Advanced Computing

Recent Trends In HPC

Centre for Development of Advanced Computing

 Top 10 Supercomputers in the world

https://www.top500.org/lists/top500/list/2023/11/

Centre for Development of Advanced Computing

 TOP 10 SUPERCOMPUTERS
INDIA
Rmax Rpeak
Rank Site Core/Processor/Socket/Nodes
(TFlops) (TFlops)
Centre for Development of Advanced 41664/42/236 compute nodes each with
1 Computing(C-DAC),Pune 40cores . 4619 5267.14
Indian Institute of Tropical 119232//Cray XC-40,3315 CPU,Intel Xeon
2 Meteorology(IITM),Pune Broadwell E5-2695 v4 CPU 3763.9 4006.19
National Centre for Medium Range 83592/2/Cray XC-40,2322 CPU,Intel Xeon
3 Weather Forecasting (NCMRWF),Noida Broadwell E5-2695 v4 CPU 2570.4 2808.7
4 PARAM Pravega,IISc,Bangalore 29952//624 1702 2565
Indian Institute of Technology
5 (IITK),Kharagpur 17280//432 Nodes total of 17280 . 935 1290.2
6 Sankhya Sutra Labs Ltd,Bangalore 32768//256 compute nodes 922.48 1179.65
National Atmospheric Research 18816//196 compute nodes constituting
7 Laboratory(NARL),Tirupati a total of 18816 CPU cores . 919.61 1384.85
Supercomputer Education and Research 36336C + 2880ICO + 126720G/1 CPU + 1
8 Centre (SERC), IISc,Bangalore GPU/CPU,Intel Xeon E5-2680 901.51 1244
9 Indian Institute of Technology(IIT),Kanpur 13834//292 851.3 1350
Indian Institute of Tropical
10 Meteorology,Pune 38016/16/117 719.2 790.7

Centre for Development of Advanced Computing

Importance of Multicore and Manycore Architecture

Centre for Development of Advanced Computing

 Multicore & ManyCore

3
0 1 0 1 2 3

7
Processor
0 1

10

11
8

9
2 3 4 5 6 7

12

13

14

15
Single core CPU Dual core CPU Quad core CPU Eight core CPU Sixteen core CPU

Many Core

Centre for Development of Advanced Computing

DDR comparison

Centre for Development of Advanced Computing

SATA vs SAS vs NVMe

Centre for Development of Advanced Computing

Memory Channels

Centre for Development of Advanced Computing

 Skylake

Centre for Development of Advanced Computing

 Skylake

Centre for Development of Advanced Computing

Skylake Architecture

Centre for Development of Advanced Computing

 Ice Lake

Centre for Development of Advanced Computing

Intel’s Tick Tock Development Model

Centre for Development of Advanced Computing

Intel Xeon Processor Roadmap

Centre for Development of Advanced Computing

NVIDIA GPU Roadmap

Centre for Development of Advanced Computing

NVIDIA A100

Centre for Development of Advanced Computing

GPU Roadmap

Centre for Development of Advanced Computing

AMD CPU Roadmap

Centre for Development of Advanced Computing

AMD EPYC Roadmap

Centre for Development of Advanced Computing

AMD Processor comparison

Centre for Development of Advanced Computing

3RD GEN EPYC Architecture

Centre for Development of Advanced Computing

INFINITY FABRIC

Centre for Development of Advanced Computing

HPC Systems @ C-DAC

Centre for Development of Advanced Computing

Evolution of PARAM Supercomputers

Centre for Development of Advanced Computing

 Indigenous Components in PARAM
PARAMNet-3 Card RC Accelerator

Switch Varada Software Stack

PARAM Yuva II
Industrial
Design

KSHIPRA
Communication
System & Application
Substrate
Software

Centre for Development of Advanced Computing

 About PARAM Yuva-II
• Enhanced version of PARAM Yuva
• Hybrid computing using Intel Xeon Phi accelerators

• 524TF peak, 388.4 TF sustained performance

• #172 Rank in TOP500 list (Jun’15),#131 Rank in (Nov’14),
#69 (Jun’13)
• Excels in power efficiency, #88 Rank in Green 500 (Jun’15)
and first rank in India
• Housed at National Param Supercomputing Facility (NPSF),
at CDAC, Pune

Centre for Development of Advanced Computing

 National HPC Facilities

BRAF at C-DAC, Pune

NPSF at C-DAC, Pune

CTSF at C-DAC, Bangalore

Centre for Development of Advanced Computing

 PARAM Siddhi

PARAM Siddhi System Specifications

Theoretical Peak Floating-Point Performance Total 210 PetaFlops (AI) and 5.2 PetaFlops (DP) – Peak Computing Power
(Rpeak)
Sustained Performance (Rmax) 4.6 PetaFlops
Base Specifications (Compute Nodes) NVIDIA DGX A100 with 8* NVIDIA A100 GPUs, AMD EPYC 7742 64 Core CPUs@
2.25GHZ, Mellanox HDR Infiniband (8 IB HDR rails for compute and 2 IB HDR
rails for storage)

Master/Service/Login Nodes 9 nos

GPU Compute Nodes 42 nos. (based on Nvidia A100 GPUs)
Total Memory 55.44 TB (GPU+CPU)
Interconnect 200 Gbps Mellanox HDR Infiniband Interconnect network 100% non-blocking,
fat tree topology
100 GbE network for orchestration and 10GbE and 1GbE Ethernet Network for
Management and monitoring
Storage Lustre based Primary Storage 10.5 PiB usable with 250 GB/sec throughput and
4 M IOPs

Centre for Development of Advanced Computing

NSM Systems Across India

• PARAM Shivay
• PARAM Brahma
• PARAM Shakti
• PARAM Yukti
• PARAM Sanganak
• PARAM Siddhi
• PARAM Seva
• PARAM Smriti
• PARAM PARAM
Pravega
• PARAM Utkarsh
• PARAM Ganga
• PARAM Ananta
• PARAM Porul
• PARAM Kamrupa
• PARAM Himalaya

Centre for Development of Advanced Computing

Thank You

Centre for Development of Advanced Computing