NVIDIA Grace CPU ?? ???: HPC? AI? ?? ??? ?????? ?? ?? NVIDIA

Reading Time: 6 minutes

NVIDIA Grace CPU? NVIDIA?? ???? ??? ??? ?? CPU???. ?? ??? ?? ??? ??? ??????.

NVIDIA Grace CPU? ??? ??? ??, ???? ??? ? ???, AI, ??? ???(HPC)? ???? ??? ?? ????? ??? ?? ??? ??? ??? ??? ??? ? ??? ??????, Arm Scalable Vector Extensions version two(SVE2) ??? ??? ???? Armv9 CPU ?? 72?? ??? ?? ?????. ??? ???? ?? ??? ??? S-EL2 ??? ??? ??? ??? ?????.

NVIDIA Grace CPU? ???? Arm ??? ??? ????.

RAS v1.1 Generic Interrupt Controller(GIC) v4.1
Memory Partitioning and Monitoring(MPAM)
System Memory Management Unit(SMMU) v3.1

Grace CPU? NVIDIA Hopper GPU? ????? ??? AI ??, ?? ? HPC? ??? NVIDIA Grace CPU ???? ??? ????, ?? HPC ? ???? ??? ????? ??? ?? ?? Grace CPU? ????? ??? CPU? ??? ???? ???????.

? ???? ???? Grace CPU? ?? ??? ?? ??? ?????.

NVLink-C2C? ?? ?? ?-?-? ?????

Grace Hopper ???? Grace ???? ??? ??? ?? ?? ??? ?? NVIDIA NVLink-C2C ?? ?-?-? ?????? ?? ?????.

NVLink-C2C? ???? ??? GPU? ??? ?, ??? NVLink Switch System?? ??? GPU ??? ??? ? ???? NVIDIA NVLink? ??? ????.

NVLink-C2C? ??? ?? ? ?? ??? ???? 900GB/s?? ??? PCIe Gen 5 x16 ??? ???(NVLink ?? ? NVIDIA Hopper GPU ??? ???? ???? ??)?? 7? ?? ?? ?? ??? ?? ????. ?? ??? ?? ???? ??? 1.3 ???? ???? PCIe Gen 5? ???? ? ??? ??? 5? ?? ????.

? ??? NVLink-C2C? ????? ??????? ??? Grace CPU ???? ??? ?? ????? CPU ???? ?????? ?, ??? Grace Hopper ???? ??? ??? ????? ??? ?????? ?? ???? ?????.

NVIDIA Grace CPU? ??? ?? ?? ???

NVIDIA Grace CPU ???? ????? ????? ?? ?? ???? ??? ???? ???????. Arm? Arm ?????? ???? ?? Arm SystemReady ?????? ?? ? ?? ??? ??? ?????.

Grace CPU? ?? ?? ?? ? ????? ??????? ???? ???? Arm ??? ??? ???? ????? ??? ???? NVIDIA Arm ????? ??? ?????.

?? Grace CPU? Arm Server Base System Architecture(SBSA)? ?? ?? ?? ???? ? ????? ?????? ?????. ???? Grace CPU ?? ????? ?? ?? ??? ??? ?? Arm Server Base Boot Requirements(SBBR)? ??? ? ??? ???????.

? ??? Grace CPU? ?? ? ??? ??? ??? ????? ???? Arm Memory Partitioning and Monitoring(MPAM)? ?????.

Grace CPU? Arm Performance Monitoring Units? ?? ???? CPU ?? ??? ??? SoC(System-on-a-Chip) ????? ?? ????? ???? ????? ? ????. ??? Linux perf ?? ?? ??? ??? ?? ??? ?????.

Grace Hopper ???? ?? ?? ???

Grace CPU? Hopper GPU? ??? NVIDIA Grace Hopper ???? CUDA 8.0?? ?? ??? CUDA Unified Memory ????? ??? ???? ???.

NVIDIA Grace Hopper ???? ??? Unified Memory?? ?? ??? ???? ???? ??? Grace CPU? Hopper GPU? ?? ?? ? ??? ????? CUDA ??????? ??? ? ????.

Hopper GPU ?? ???? ??? ??? ??? ???? ? ????. ??? Grace Hopper ???? ???? ?????? ??? ???? GPU ???? ??? ?? ??? malloc ??? ???? GPU? ??? ?? ????.

NVLink-C2C? Grace CPU? Hopper GPU ???? ??? ??? ???? ??? CUDA 10.2?? ?? ??? C++ ??? ??? ??? ??? ? ????.

NVIDIA Scalable Coherency Fabric

Grace CPU? NVIDIA Scalable Coherency Fabric(SCF)? ???????. NVIDIA?? ??? SCF? ??? ??? ??? ?? ?? ????? ??? ?? ????? ?? ?????. SCF? 3.2TB/s? ?? ???? ???? NVLink-C2C, CPU ??, ??? ? ??? IO ???? ??? ??? ??? ?????.

Grace CPU 1?? CPU ?? 72?? ?? 117MB? ????? SCF? ??? ??? ?? ??? ? ??? ???????. Grace CPU 2?? ???? Grace ???? ??? ??? ??? ?? 2?? ?? CPU ?? ?? 144?, L3 ??? 234MB? ???.

CPU ??? SCF ?? ???(SCC)? ?? ??? ?????. ?? ??? ??(CSN)? ???? ?? ???? ???? CPU ??? ?? ???, ??? ??? ??? ???? ????? ??? ?? ?? ??? ???? ?????.

??? ?? ? ????

Grace CPU? Memory System Resource Partitioning and Monitoring(MPAM) ??? ?????. ???? MPAM?? ??? ??? ??? ???? ?? ??? ? ?? Arm ??? ????.

MPAM? ?? ??? ID(PARTID)? ??? ?? ????? ?????. ?? ??, ??? ??? ?? ???? ? PARTID? ?? ????? ????? ? ?? ??? ??? ??? ????.

Grace CPU?? SCF ??? MPAM? ??? ?? ?? ??? ??? ??? ??? ?? ?????. ?? Performance Monitor Group(PMG)? ??? ??? ???? ?????? ?? ?????.

??? ?????? ?? ??? ? ??? ?? ??

Grace CPU? ??? ???? ??? ??? ?? 32?? LPDDR5X ??? ?????? ?????. ??? ??? ??? ?? 512GB? ???, ??? ???? ?? 546GB/s? ????.

?? GPU ???

Grace Hopper ????? ??? ? ?? ???? ?? GPU ???(EGM)? ????. ??? NVLink ?????? ??? Hopper GPU? Grace Hopper ???? Grace CPU? ??? LPDDR5X ???? ???? ? ?? ??? GPU? ??? ? ?? ??? ?? ?? ?????.

*?? 2. NVLink-C2C? ??? ?? ??? Grace CPU? ???? ???? ? ?? Hopper GPU*

Hopper GPU? NVLink Grace CPU ???? ?? ??? ???? ? ?? ??? GPU? ?? ???? NVLink? NVLink-C2C? ??? ???? ????? ?? ???? ?????.

???? ??? ??? ??? ???? LPDDR5X

Grace CPU? LPDDR5X? ??? ??? ??? AI ? HPC ????? ?? ???, ??? ??, ??, ?? ?? ????? ??? ???? ?? ?????.

4??? HBM2e ??? ?????? ?? ??? ???? ??? ??? ??? ????? DDR5 ?? LPDDR5X? ???? ? ?????? ??? 3?? ?????.

?? ??? ??? ??? 64GB? ???? LPDDR5X? ???? ? Grace CPU? ??? ? ?? ?? ??? 1/8? ??????.

? ??? ?? 8?? DDR5 ??? ???? Grace CPU LPDDR5X ??? ?????? ?? 53% ?? ???? ??? ?? ??? ??? ?????? ??? 1/8? ???? ?? ??? ???? ????.

*?? 3. HBM2e(4???), DDR5(8??), LPDDR5x(32??) ??? ??? ??, ???, ?? ? ??? ??? ??*

??? LPDDR5X? ??? ?? ?? ??? ? ?? ???? ?? ??? CPU ??, GPU ???? ??????(SM) ?? ??? ???? ??? ??? ? ????.

NVIDIA Grace CPU I/O

Grace CPU? ??? ??? ??? ??? ?? ?? I/O? ??? ? ?? ??? ???????. Grace CPU SoC? PCIe ?? ??? ?? 68???, ??? PCIe Gen 5 x16 ??? ?? 4??? ?????. ?? ? PCIe Gen 5 x16 ??? ?? 128GB/s? ??? ???? ????, ?? ?? ? PCIe Gen 5 x8 ?? 2?? ???? ?? ?????.

*Figure 4. Grace I/O features up to 68 lanes of PCIe, 12 lanes of coherent NVLINK, and NVLINK-C2C*

??? ?? ?? ??? NVLink-C2C ??? ??? Grace CPU? ?? Grace CPU ?? NVIDIA Hopper GPU? ???? ??? ????.

Grace CPU? ??? ?? ??? ?? ??? ??? ??? ?? ??? ??? ???? ??? ??? ? ?? ??? NVLink, NVLink-C2C, PCIe Gen 5? ??? ???? ?? ?????.

NVIDIA Grace CPU ??

NVIDIA Grace CPU? ?? ? ??? Grace ??? ???? ?? ??? ??? ??? ??? ? ??? ???? SPECrate2017_int_base ???? ?? 370?? 740??? ?????. ??? ??? ??(pre-silicon) ???? ??? ??? GNU Compiler Collection(GCC)? ??? ??? ?? ????.

*?? 5.* ?? Grace CPU(??)? Grace ???(???)? ? SPEC ?? ?? ??? *??: Pre-silicon estimated performance(??? ? ??).*

Grace CPU? ???? ??????? ??? ???? ???? ?????. Stream Benchmark ??? ?? ?? Grace CPU? ? ???? ?? 536GB/s? ??? ?? ?? ???? 98%? ??? ??? ?????.

*?? 6. MemRead, MemSet, MemCopy, MemTriad(???? ?????)? Grace CPU ??? ??? ??*

????? Grace Hopper ???? ??? ?????? Hopper GPU? Grace CPU ? ???? ?? ?????. GPU? CPU ? ??? ?? ? ?? ??? ?? 429GB/s? 407GB/s? NVLink-C2C? ?? ?? ??? ?? ??? 95%? 90%? ??? ??? ?????.

?? ?? ? ?? ??? 506GB/s? ?? NVIDIA Grace CPU SoC? ??? ? ?? ?? ?? ??? ???? 90%? ??? ??? ?????.

NVIDIA Grace CPU ???? ??

NVIDIA Grace CPU ???? ?? ? 144?? ??? ??? 1TB/s? ???? CPU ?? ??? ??? ??????? ??? ??? ?????. HPC ??????? ??? ????? ??? ?? ??? ???? ?? ?? ??? ??? ?? ?? ??? ???, ??? ??? ??? ??? ??? ?????.

NVIDIA? ??? HPC, ?? ???, ?????? ? ???? ??? ???? Grace CPU ???? ???? ????. Grace CPU ???? Grace Hopper ???? 2023? ???? ??? ?????.

NVIDIA Grace Hopper ???? NVIDIA Grace CPU ???? ?? ??? ?? ??? NVIDIA Grace CPU?? ??? ? ????.

? ???? ??? SDK? ???? ?? ???, ?? ???, ?? ??, ??, ?? ??, ???? NVIDIA ??? ???? ??? ??? ??? ??? ? ????. ?? ??? ???? NVIDIA? ?? ????? ???? ? ??? ??? ??? ?????? ???? ??? ??? ???.