Machine Performance Specs
Name | Generation | CUDA Cores | GPU Memory | Memory Bandwidth | Tensor Core1 | TFLOPS2 | vCPUs | RAM |
---|---|---|---|---|---|---|---|---|
GPU+ | Maxwell | 1,664 | 8 GB | 192 GB/sec | 2.6 | - | 8 | 30 |
P4000 | Pascal | 1,792 | 8 GB | 243 GB/sec | 5.3 | - | 8 | 30 |
P5000 | Pascal | 2,560 | 16 GB | 288 GB/sec | 9.0 | - | 8 | 30 |
P6000 | Pascal | 3,840 | 24 GB | 432 GB/sec | 12.0 | - | 8 | 30 |
V100 | Volta | 5,120 | 16 GB | 900 GB/sec | 14.0 | 112 TFLOPS (FP16) | 8 | 30 |
V100x32 | Volta | 5,120 | 32 GB | 900 GB/sec | 15.7 | 125 TFLOPS (FP16) | 8 | 30 |
RTX4000 | Turing | 2,304 | 8 GB | 416 GB/s | 7.1 | 57 TFLOPS (FP32) | 8 | 30 |
RTX5000 | Turing | 3,072 | 16 GB | 448 GB/s | 11.2 | 89 TFLOPS (FP32) | 8 | 30 |
A4000 | Ampere | 6,144 | 16 GB | 448 GB/s | 19.2 | 153 TFLOPS (FP16) | 8 | 45 |
A5000 | Ampere | 8,192 | 24 GB | 768 GB/s | 27.8 | 222 TFLOPS (FP16) | 8 | 45 |
A6000 | Ampere | 10,752 | 48 GB | 768 GB/s | 38.7 | 309 TFLOPS (FP16) | 8 | 45 |
A100 | Ampere | 6,912 | 40 GB HBM2 | 1,555 GB/s | 19.5 | 156 / 312 (FP32/16) TFLOPS | 12 | 90 |