NVIDIA A100 for PCIe, 80GB
Highest versatility for all workloads.
Manufacturer Part Number: 900-21010-0000-000
Features and Benefits:
The NVIDIA A100 Tensor Core GPU delivers unprecedented acceleration at every scale for AI, data analytics, and high-performance computing (HPC) to tackle the world’s toughest computing challenges. As the engine of the NVIDIA data center platform, A100 can efficiently scale to thousands of GPUs or, with NVIDIA Multi-Instance GPU (MIG) technology, be partitioned into seven GPU instances to accelerate workloads of all sizes. And third-generation Tensor Cores accelerate every precision for diverse workloads, speeding time to insight and time to market.
Product Specifications
| |
|
H100 NVL |
| FP64 |
|
30 teraFLOPs |
| FP64 Tensor Core |
|
60 teraFLOPs |
| FP32 |
|
60 teraFLOPs |
| TF32 Tensor Core* |
|
835 teraFLOPs |
| BFLOAT16 Tensor Core* |
|
1,671 teraFLOPS |
| FP16 Tensor Core* |
|
1,671 teraFLOPS |
| FP8 Tensor Core* |
|
3,341 teraFLOPS |
| INT8 Tensor Core* |
|
3,341 TOPS |
| GPU Memory |
|
94GB |
| GPU Memory Bandwidth |
|
3.9TB/s |
| Decoders |
|
7 NVDEC
7 JPEG |
| Max Thermal Design Power (TDP) |
|
350-400W (configurable) |
| Multi-Instance GPUs |
|
Up to 7 MIGS @ 12GB each |
| Form Factor |
|
PCIe
dual-slot air-cooled |
| Interconnect |
|
NVIDIA NVLink: 600GB/s
PCIe Gen5: 128GB/s |
| Server Options |
|
Partner and NVIDIA-Certified Systems with 1–8 GPUs |
| NVIDIA AI Enterprise |
|
Included |
point performance 2.91 Tflops (GPU Boost Clocks)
1.87 Tflops (Base Clocks) 1.66 Tflops (GPU Boost Clocks)
1.43 Tflops (Base Clocks)
Peak single precision floating
point performance 8.74 Tflops (GPU Boost Clocks)
5.6 Tflops (Base Clocks) 5 Tflops (GPU Boost Clocks)
4.29 Tflops (Base Clocks)
Memory bandwidth (ECC off)² 480 GB/sec (240 GB/sec per GPU) 288 GB/sec
Memory size (GDDR5) 24 GB (12GB per GPU) 12 GB
CUDA cores 4992 ( 2496 per GPU) 2880 - See more at: http://www.nvidia.com/object/tesla-servers.html#sthash.ZmsPP43F.dpuf
