GPU compute markets
GPU rental
H200 SXM
141 GB of memory per GPU. Rental prices from 15 providers, compared.
About this GPU
Its specification, and where each provider publishes its own prices.
| Maker | NVIDIA |
|---|---|
| Architecture | Hopper |
| Introduced | 2023 |
| Memory per GPU | 141 GB HBM3e |
| Power draw | Up to 700 W |
Providers listing it
Our own calculation, not a published figure. At each point in time it is the middle price among the cloud listings that have no line of their own (12 for this GPU), named in the table below the chart. Each listing counts once, whatever its capacity, so the line can move when a provider starts or stops listing this GPU. Spot prices are left out.
Clouds in the median
Best deal right now
$3.59/h
RunPod community · updated 2 min ago
$0.93/h (21%) less than the median, $4.41/h (55%) less than the dearest
Listings shown
19 of 19
provider and tier pairs
Per hour
US dollars per GPU over the last 7 days. Monthly prices assume 730 hours. Times are local.
| Listing | Latest | Lowest | Highest | Data points |
|---|---|---|---|---|
| Market median | $4.36 | $4.27 | $4.51 | 43 |
| RunPod secure | $5.29 | $5.29 | $5.29 | 43 |
| RunPod community | $3.59 | $3.59 | $3.59 | 43 |
| Vast.ai marketplace | $6.56 | $4.17 | $6.92 | 43 |
| Cloud median | $4.25 | $4.21 | $4.50 | 43 |
| AWS on-demand | $7.91 | $7.91 | $7.91 | 4 |
| Boost Run on-demand | $4.25 | $2.45 | $4.25 | 43 |
| DigitalOcean on-demand | $4.47 | $4.47 | $4.47 | 43 |
| Excess Supply on-demand | $4.00 | $2.25 | $4.00 | 43 |
| Fireworks AI on-demand | $8.00 | $8.00 | $8.00 | 1 |
| Horizon on-demand | $3.00 | $3.00 | $3.00 | 43 |
| Nebius on-demand | $4.52 | $4.52 | $4.52 | 43 |
| Replicate serverless | $5.49 | $5.49 | $5.49 | 9 |
| Runware serverless | $4.50 | $4.50 | $4.50 | 9 |
| Spheron on-demand | $5.51 | $4.80 | $7.09 | 43 |
| Together AI on-demand | $5.99 | $5.99 | $5.99 | 9 |
| Verda on-demand | $4.21 | $4.21 | $4.21 | 43 |
| Ornn index | $7.12 | $5.71 | $7.12 | 9 |
Listings right now
The latest price from every provider shown above, cheapest first.
| Provider | Tier | Per hour | Per month | Listed range | Supply | Updated | Via |
|---|---|---|---|---|---|---|---|
| AWS | spot | $0.88 | $642 | $0.88 to $8.30 | 1 h ago | SkyPilot catalog | |
| Together AI | spot | $2.99 | $2,183 | 4 h ago | Together AI | ||
| Horizonsold out | on-demand | $3.00 | $2,190 | Out of stock | 2 min ago | Shadeform | |
| Spheron | spot | $3.55 | $2,592 | $3.55 to $4.83 | In stock | 2 min ago | Spheron |
| RunPod | community | $3.59 | $2,621 | Low | 2 min ago | RunPod | |
| Excess Supplysold out | on-demand | $4.00 | $2,920 | $4.00 to $4.63 | Out of stock | 2 min ago | Shadeform |
| Verdasold out | on-demand | $4.21 | $3,070 | $4.21 to $4.62 | Out of stock | 2 min ago | Shadeform |
| Boost Runsold out | on-demand | $4.25 | $3,102 | Out of stock | 2 min ago | Shadeform | |
| DigitalOceansold out | on-demand | $4.47 | $3,263 | Out of stock | 2 min ago | Shadeform | |
| Runware | serverless | $4.50 | $3,285 | 4 h ago | Runware | ||
| Nebiussold out | on-demand | $4.52 | $3,297 | $4.52 to $4.63 | Out of stock | 2 min ago | Shadeform |
| RunPod | secure | $5.29 | $3,862 | Low | 2 min ago | RunPod | |
| Replicate | serverless | $5.49 | $4,008 | 4 h ago | Replicate | ||
| Spheron | on-demand | $5.51 | $4,024 | $5.51 to $5.68 | In stock | 2 min ago | Spheron |
| Together AI | on-demand | $5.99 | $4,373 | 4 h ago | Together AI | ||
| Vast.ai | marketplace | $6.82 | $4,979 | $3.48 to $6.82 | 28 of 205 free | 2 min ago | Vast.ai |
| Ornn | index | $7.12 | $5,198 | 4 h ago | Ornn | ||
| AWS | on-demand | $7.91 | $5,776 | $7.91 to $10.29 | 1 h ago | SkyPilot catalog | |
| Fireworks AI | on-demand | $8.00 | $5,840 | 1 h ago | Fireworks AI |
Machines
Whole machines from sources that describe them: Shadeform's clouds, Spheron, AWS and Azure. A machine sold in several regions of one area shows once, at its cheapest.
45 of 45 machines, cheapest per GPU first
| Provider | Tier | GPUs | vCPUs | RAM | Disk | Region | Per GPU | Machine |
|---|---|---|---|---|---|---|---|---|
| AWS | spot | 8 | 192 | 2048 GB | eu-north-1 +2 more | $0.88/h | $7.04/h | |
| AWS | spot | 8 | 192 | 2048 GB | eu-west-2 | $2.46/h | $19.65/h | |
| AWS | spot | 8 | 192 | 2048 GB | ap-southeast-3 +5 more | $2.85/h | $22.82/h | |
| Horizon | on-demand | 8 | 160 | 1536 GB | 17000 GB | IS, Blonduos 3 · none free | $3.00/h | $24.00/h |
| AWS | spot | 8 | 192 | 2048 GB | us-east-2 +5 more | $3.46/h | $27.64/h | |
| Spheron | spot | 1 | 16 | 200 GB | 256 GB | US Central 1 | $3.55/h | $3.55/h |
| Excess Supply | on-demand | 8 | 148 | 1904 GB | 15324 GB | JP, Fukushima · none free | $4.00/h | $32.00/h |
| Excess Supply | on-demand | 8 | 208 | 1904 GB | 30000 GB | JP, Kagawa · none free | $4.00/h | $32.00/h |
| Excess Supply | spot | 8 | 208 | 1904 GB | 30000 GB | JP, Kagawa · none free | $4.00/h | $32.00/h |
| Verda | on-demand | 4 | 176 | 740 GB | 3000 GB | FI, Central +1 more · none free | $4.21/h | $16.82/h |
| Verda | on-demand | 8 | 176 | 1450 GB | 6000 GB | FI, Central +1 more · none free | $4.21/h | $33.64/h |
| Boost Run | on-demand | 8 | 96 | 2048 GB | 30720 GB | US, Raleigh, NC +1 more · none free | $4.25/h | $34.00/h |
| Excess Supply | on-demand | 8 | 96 | 2048 GB | 30720 GB | US, Raleigh, NC +1 more · none free | $4.25/h | $34.00/h |
| Verda | on-demand | 1 | 44 | 185 GB | 1500 GB | FI, Central +1 more · none free | $4.41/h | $4.41/h |
| DigitalOcean | on-demand | 1 | 24 | 240 GB | 720 GB | US, New York, NY +1 more · none free | $4.47/h | $4.47/h |
| DigitalOcean | on-demand | 8 | 192 | 1920 GB | 2000 GB | US, New York, NY +1 more · none free | $4.47/h | $35.76/h |
| Excess Supply | on-demand | 8 | 128 | 1600 GB | 6000 GB | FI, Helsinki +3 more · none free | $4.52/h | $36.13/h |
| Excess Supply | on-demand | 8 | 128 | 1600 GB | 6000 GB | US, Kansas City, MO +1 more · none free | $4.52/h | $36.13/h |
| Nebius | on-demand | 8 | 128 | 1600 GB | 1953 GB | FR, Paris +1 more · none free | $4.52/h | $36.13/h |
| Nebius | on-demand | 8 | 128 | 1600 GB | 1953 GB | US, Kansas City, MO · none free | $4.52/h | $36.13/h |
| Nebius | spot | 8 | 128 | 1600 GB | 1953 GB | FI, Helsinki · none free | $4.52/h | $36.13/h |
| Verda | on-demand | 2 | 88 | 370 GB | 4500 GB | FI, Central +1 more · none free | $4.62/h | $9.23/h |
| Excess Supply | on-demand | 1 | 16 | 200 GB | 465 GB | FR, Paris +3 more · none free | $4.63/h | $4.63/h |
| Excess Supply | on-demand | 1 | 16 | 200 GB | 465 GB | US, Kansas City, MO +1 more · none free | $4.63/h | $4.63/h |
| Nebius | on-demand | 1 | 16 | 200 GB | 465 GB | FR, Paris +1 more · none free | $4.63/h | $4.63/h |