NVIDIA
NVIDIA GeForce RTX 4090
Ada Lovelace • 24GB GDDR6X • 450W TDP
10 Fair Value
AI Performance
SDXL 1024x1024 22 images/min
LLM 7B Inference 120 tokens/sec
LLM 13B Inference 68 tokens/sec
Max Model Size 30B parameters
Source: Tom's Hardware (2024-06-15)
Specifications
- Architecture
- Ada Lovelace
- VRAM
- 24GB GDDR6X
- Memory Bandwidth
- 1,008 GB/s
- CUDA Cores
- 16,384
- Tensor Cores
- 512
- Base Clock
- 2,235 MHz
- Boost Clock
- 2,520 MHz
- TDP
- 450W
- Release Date
- Oct 2022
- MSRP
- $1,599