GPU compute markets
GPU rental
A100 SXM
80 GB of memory per GPU. Rental prices from 19 providers, compared.
About this GPU
Its specification, and where each provider publishes its own prices.
| Maker | NVIDIA |
|---|---|
| Architecture | Ampere |
| Introduced | 2020 |
| Memory per GPU | 80 GB HBM2 (40 GB) or HBM2e (80 GB) |
| Power draw | 400 W (SXM) or 250 to 300 W (PCIe) |
Providers listing it
Our own calculation, not a published figure. At each point in time it is the middle price among the cloud listings that have no line of their own (14 for this GPU), named in the table below the chart. Each listing counts once, whatever its capacity, so the line can move when a provider starts or stops listing this GPU. Spot prices are left out.
Clouds in the median
Best deal right now
$0.94/h
Vast.ai marketplace · updated 2 min ago
$0.77/h (45%) less than the median, $4.10/h (81%) less than the dearest
Listings shown
25 of 25
provider and tier pairs
Per hour
US dollars per GPU over the last 7 days. Monthly prices assume 730 hours. Times are local.
| Listing | Latest | Lowest | Highest | Data points |
|---|---|---|---|---|
| Market median | $1.62 | $1.50 | $1.74 | 42 |
| RunPod secure | $1.79 | $1.79 | $1.79 | 42 |
| RunPod community | $1.39 | $1.39 | $1.39 | 42 |
| Akash marketplace | $1.49 | $1.49 | $1.49 | 42 |
| Vast.ai marketplace | $0.94 | $0.70 | $1.09 | 42 |
| Nosana premium | $0.90 | $0.90 | $0.90 | 42 |
| Nosana community | $0.68 | $0.68 | $0.68 | 42 |
| Cloud median | $2.00 | $1.74 | $2.30 | 42 |
| AWS on-demand | $3.43 | $3.43 | $3.43 | 4 |
| Azure on-demand | $3.67 | $3.67 | $3.67 | 4 |
| Crusoe on-demand | $2.00 | $2.00 | $2.00 | 42 |
| Denvr on-demand | $1.50 | $1.50 | $1.50 | 42 |
| Excess Supply on-demand | $1.35 | $1.35 | $1.35 | 42 |
| Google Cloud on-demand | $5.03 | $5.03 | $5.03 | 4 |
| Hyperstack on-demand | $1.35 | $1.35 | $1.35 | 42 |
| Lambda on-demand | $2.79 | $2.79 | $2.79 | 42 |
| Massed Compute on-demand | $1.35 | $1.35 | $1.35 | 42 |
| Paperspace on-demand | $3.22 | $3.22 | $3.22 | 42 |
| Replicate serverless | $5.04 | $5.04 | $5.04 | 9 |
| Spheron on-demand | $1.62 | $1.62 | $1.69 | 42 |
| Verda on-demand | $1.85 | $1.85 | $1.85 | 42 |
| Vultr on-demand | $2.60 | $2.60 | $2.60 | 42 |
| Ornn index | $1.08 | $1.06 | $1.10 | 9 |
Listings right now
The latest price from every provider shown above, cheapest first.
| Provider | Tier | Per hour | Per month | Listed range | Supply | Updated | Via |
|---|---|---|---|---|---|---|---|
| Azure | spot | $0.40 | $295 | $0.40 to $0.65 | 24 min ago | SkyPilot catalog | |
| Nosanasold out | community | $0.68 | $493 | 0 of 1 free | 2 min ago | Nosana | |
| Nosanasold out | premium | $0.90 | $657 | 0 of 13 free | 2 min ago | Nosana | |
| Vast.ai | marketplace | $0.94 | $686 | $0.40 to $1.50 | 96 of 430 free | 2 min ago | Vast.ai |
| Ornn | index | $1.08 | $788 | 3 h ago | Ornn | ||
| Excess Supply | on-demand | $1.35 | $986 | $1.35 to $3.00 | In stock | 2 min ago | Shadeform |
| Hyperstack | on-demand | $1.35 | $986 | $1.35 to $1.40 | In stock | 2 min ago | Shadeform |
| Massed Compute | on-demand | $1.35 | $986 | $1.35 to $1.38 | In stock | 2 min ago | Shadeform |
| RunPod | community | $1.39 | $1,015 | 2 min ago | RunPod | ||
| Spheron | spot | $1.43 | $1,042 | In stock | 2 min ago | Spheron | |
| Akash | marketplace | $1.49 | $1,088 | $1.07 to $1.91 | 34 of 200 free | 2 min ago | Akash |
| Denvr | on-demand | $1.50 | $1,095 | $1.50 to $1.52 | In stock | 2 min ago | Shadeform |
| Spheron | on-demand | $1.62 | $1,183 | $1.62 to $3.94 | In stock | 2 min ago | Spheron |
| AWS | spot | $1.76 | $1,283 | $1.76 to $4.48 | 24 min ago | SkyPilot catalog | |
| RunPod | secure | $1.79 | $1,307 | 2 min ago | RunPod | ||
| Verda | on-demand | $1.85 | $1,350 | $1.85 to $1.86 | In stock | 2 min ago | Shadeform |
| Google Cloud | spot | $1.86 | $1,356 | $1.86 to $3.59 | 24 min ago | SkyPilot catalog | |
| Crusoe | on-demand | $2.00 | $1,460 | $2.00 to $2.30 | In stock | 2 min ago | Shadeform |
| Vultr | on-demand | $2.60 | $1,898 | In stock | 2 min ago | Shadeform | |
| Lambdasold out | on-demand | $2.79 | $2,037 | Out of stock | 2 min ago | Shadeform | |
| Paperspace | on-demand | $3.22 | $2,351 | $3.22 to $3.28 | In stock | 2 min ago | Shadeform |
| AWS | on-demand | $3.43 | $2,505 | $3.43 to $4.70 | 24 min ago | SkyPilot catalog | |
| Azure | on-demand | $3.67 | $2,681 | $3.67 to $4.78 | 24 min ago | SkyPilot catalog | |
| Google Cloud | on-demand | $5.03 | $3,670 | $5.03 to $6.20 | 24 min ago | SkyPilot catalog | |
| Replicate | serverless | $5.04 | $3,679 | 3 h ago | Replicate |
Machines
Whole machines from sources that describe them: Shadeform's clouds, Spheron, AWS and Azure. A machine sold in several regions of one area shows once, at its cheapest.
62 of 62 machines, cheapest per GPU first
| Provider | Tier | GPUs | vCPUs | RAM | Disk | Region | Per GPU | Machine |
|---|---|---|---|---|---|---|---|---|
| Azure | spot | 1 | 24 | 220 GB | westus3 +6 more | $0.40/h | $0.40/h | |
| Azure | spot | 2 | 48 | 440 GB | westus3 +6 more | $0.40/h | $0.81/h | |
| Azure | spot | 4 | 96 | 880 GB | westus3 +6 more | $0.40/h | $1.62/h | |
| Azure | spot | 8 | 96 | 1800 GB | eastus +2 more | $0.45/h | $3.60/h | |
| Hyperstack | on-demand | 1 | 28 | 120 GB | 850 GB | CA, Montreal | $1.35/h | $1.35/h |
| Massed Compute | on-demand | 1 | 12 | 64 GB | 256 GB | US, Wichita, KS +2 more · none free | $1.35/h | $1.35/h |
| Hyperstack | on-demand | 2 | 60 | 240 GB | 1600 GB | CA, Montreal | $1.35/h | $2.70/h |
| Massed Compute | on-demand | 2 | 30 | 128 GB | 512 GB | US, Wichita, KS +3 more · none free | $1.35/h | $2.70/h |
| Hyperstack | on-demand | 4 | 124 | 480 GB | 3300 GB | NO, Oslo · none free | $1.35/h | $5.40/h |
| Hyperstack | on-demand | 4 | 124 | 480 GB | 3300 GB | CA, Montreal · none free | $1.35/h | $5.40/h |
| Massed Compute | on-demand | 4 | 54 | 256 GB | 1024 GB | US, Wichita, KS +3 more · none free | $1.35/h | $5.40/h |
| Excess Supply | on-demand | 8 | 240 | 1280 GB | 9578 GB | US, Omaha, NB +1 more | $1.35/h | $10.80/h |
| Hyperstack | on-demand | 8 | 252 | 1440 GB | 6600 GB | CA, Montreal · none free | $1.35/h | $10.80/h |
| Massed Compute | on-demand | 8 | 110 | 512 GB | 2560 GB | US, Des Moines, IA +3 more · none free | $1.35/h | $10.80/h |
| Massed Compute | on-demand | 1 | 14 | 100 GB | 625 GB | US, Des Moines, IA +1 more | $1.38/h | $1.38/h |
| Massed Compute | on-demand | 1 | 16 | 160 GB | 1000 GB | US, Des Moines, IA +4 more | $1.38/h | $1.38/h |
| Massed Compute | on-demand | 8 | 120 | 1896 GB | 10000 GB | US, Des Moines, IA +4 more | $1.38/h | $11.04/h |
| Massed Compute | on-demand | 8 | 126 | 1500 GB | 10000 GB | US, Des Moines, IA +1 more · none free | $1.38/h | $11.04/h |
| Hyperstack | on-demand | 8 | 252 | 960 GB | 6600 GB | CA, Montreal · none free | $1.40/h | $11.20/h |
| Spheron | spot | 8 | 176 | 960 GB | 200 GB | Finland 2 | $1.43/h | $11.42/h |
| Denvr | on-demand | 1 | 24 | 116 GB | 2125 GB | US, Houston, TX | $1.50/h | $1.50/h |
| Denvr | on-demand | 8 | 200 | 940 GB | 17000 GB | US, Houston, TX | $1.52/h | $12.20/h |
| Spheron | on-demand | 8 | 240 | 1280 GB | 9578 GB | ce32df2f:omaha-usa-2 | $1.62/h | $12.96/h |
| AWS | spot | 8 | 96 | 1152 GB | eu-central-1 | $1.76/h | $14.06/h | |
| Spheron | on-demand | 1 | 24 | 116 GB | 2125 GB | e6260a61:houston-usa-1 | $1.80/h | $1.80/h |