NVIDIA H100 PCIe vs NVIDIA GeForce RTX 3090. Specifications, performance, tests

Comparison of basic technical data of graphics cards NVIDIA H100 PCIe and NVIDIA GeForce RTX 3090, chip, information processing units.

• Architecture
  Hopper Ampere
• Execution Units
  7296 82
• GPU Chip
  GH100 GA102-300-A1
• Render Output Units
  24 112
• Texture Units
  456 328
• CUDA Cores
  - 10496
• Shader
  - 10496

Video memory capacity, type, bus width and bandwidth describe different properties. These values alone do not determine graphics performance.

• Memory Bandwidth
  1,280 GB/s 936 GB/s
• Memory Bus
  5120 bit 384 bit
• Memory Clock
  1000 MHz 1219 MHz
• Memory Data Rate
  2 Gbps 19.5 Gbps
• Memory Size
  80 GB 24 GB
• Memory Type
  HBM2e GDDR6X

Published GPU clock frequencies describe different operating modes. Clock speed alone does not determine graphics performance.

• Base Clock
  1065 MHz 1400 MHz
• Boost Clock
  1650 MHz 1700 MHz

Graphics card power limits and recommended system power supply describe different specifications.

• System Power Supply
  750 W (PSU recommendation) 750 W (System power requirement)
• TDP
  350 W 350 W
• Graphics Card Power
  - 350 W
• Maximum GPU Temperature
  - 93 °C

Connectivity and connections.

• Max. Displays
  1 4
• PCIe Interface
  PCIe 5.0 x16 PCIe 4.0 x16
• Power Connectors
  8-pin EPS 2x PCIe 8-pin (adapter to 1x 12-pin included)
• DisplayPort Ports
  - 3 × DisplayPort
• HDCP Version
  - 2.3
• Other Display Outputs (unparsed)
  - HDMI

Technical data that is used to its full potential in computer games.

• CUDA
  9.0 -
• DirectX
  No 12_2
• OpenCL
  3.0 3.0
• OpenGL
  No 4.6
• Shader Model
  No 6.6
• Vulkan
  No 1.3
• Max. resolution
  - 7680 × 4320

Built-in support for video and image compression standards.

• AV1
  - Decode
• h264
  - Decode / Encode
• h265 / HEVC
  - Decode / Encode
• VP8
  - Decode
• VP9
  - Decode

Comparison of interfaces and release dates for GPU NVIDIA GeForce RTX 3090 and NVIDIA H100 PCIe.

• Process Technology
  4 nm 8 nm
• Release date
  Q2/2022 Q3/2020
• Manufacturer specification scope
  - NVIDIA Founders Edition/reference design. Clock specifications apply to gaming use. AIB shipping specifications and complete-system power needs may differ.

• FP16 (theoretical)
  96.31 TFLOPS 35.58 TFLOPS
• FP32 (theoretical)
  24.08 TFLOPS -
• FP64 (theoretical)
  12.04 TFLOPS -
• Pixel Rate
  39.60 GPixel/s 189.8 GPixel/s
• Texture Rate
  752.4 GTexel/s 556.0 GTexel/s