GPU compute markets
GPU rental
A100 SXM
40 GB of memory per GPU. Rental prices from 11 providers, compared.
About this GPU
Its specification, and where each provider publishes its own prices.
| Maker | NVIDIA |
|---|---|
| Architecture | Ampere |
| Introduced | 2020 |
| Memory per GPU | 40 GB HBM2 (40 GB) or HBM2e (80 GB) |
| Power draw | 400 W (SXM) or 250 to 300 W (PCIe) |
Our own calculation, not a published figure. At each point in time it is the middle price among the cloud listings that have no line of their own (9 for this GPU), named in the table below the chart. Each listing counts once, whatever its capacity, so the line can move when a provider starts or stops listing this GPU. Spot prices are left out.
Clouds in the median
Best deal right now
$1.00/h
RunPod community · updated 1 min ago
$0.56/h (36%) less than the median, $2.67/h (73%) less than the dearest
Listings shown
16 of 16
provider and tier pairs
Per hour
US dollars per GPU over the last 7 days. Monthly prices assume 730 hours. Times are local.
| Listing | Latest | Lowest | Highest | Data points |
|---|---|---|---|---|
| Market median | $1.40 | $1.40 | $1.56 | 43 |
| RunPod community | $1.00 | $1.00 | $1.00 | 43 |
| Nosana premium | $0.61 | $0.61 | $0.61 | 43 |
| Nosana community | $0.46 | $0.46 | $0.46 | 43 |
| Cloud median | $1.56 | $1.56 | $2.37 | 43 |
| AWS on-demand | $2.74 | $2.74 | $2.74 | 4 |
| Azure on-demand | $3.40 | $3.40 | $3.40 | 4 |
| Crusoe on-demand | $1.45 | $1.45 | $1.45 | 43 |
| Denvr on-demand | $1.40 | $1.40 | $1.40 | 43 |
| Google Cloud on-demand | $3.67 | $3.67 | $3.67 | 4 |
| Lambda on-demand | $1.99 | $1.99 | $1.99 | 43 |
| Paperspace on-demand | $3.11 | $3.11 | $3.11 | 43 |
| Spheron on-demand | $1.68 | $1.68 | $2.39 | 42 |
| Verda on-demand | $1.36 | $1.36 | $1.36 | 43 |
Listings right now
The latest price from every provider shown above, cheapest first.
| Provider | Tier | Per hour | Per month | Listed range | Supply | Updated | Via |
|---|---|---|---|---|---|---|---|
| AWS | spot | $0.35 | $255 | $0.35 to $3.76 | 1 h ago | SkyPilot catalog | |
| Azure | spot | $0.37 | $273 | $0.37 to $0.45 | 1 h ago | SkyPilot catalog | |
| Nosanasold outunusually low | community | $0.46 | $334 | 0 of 10 free | 1 min ago | Nosana | |
| Nosanasold out | premium | $0.61 | $445 | 0 of 0 free | 1 min ago | Nosana | |
| RunPod | community | $1.00 | $730 | 1 min ago | RunPod | ||
| Spheron | spot | $1.08 | $792 | In stock | 1 min ago | Spheron | |
| Verdasold out | on-demand | $1.36 | $993 | Out of stock | 1 min ago | Shadeform | |
| Denvr | on-demand | $1.40 | $1,022 | In stock | 1 min ago | Shadeform | |
| Crusoesold out | on-demand | $1.45 | $1,058 | Out of stock | 1 min ago | Shadeform | |
| Spheron | on-demand | $1.68 | $1,226 | $1.68 to $2.39 | In stock | 1 min ago | Spheron |
| Google Cloud | spot | $1.74 | $1,270 | $1.74 to $2.42 | 1 h ago | SkyPilot catalog | |
| Lambda | on-demand | $1.99 | $1,453 | In stock | 1 min ago | Shadeform | |
| AWS | on-demand | $2.74 | $2,004 | $2.74 to $3.80 | 1 h ago | SkyPilot catalog | |
| Paperspace | on-demand | $3.11 | $2,270 | $3.11 to $3.19 | In stock | 1 min ago | Shadeform |
| Azure | on-demand | $3.40 | $2,482 | $3.40 to $4.08 | 1 h ago | SkyPilot catalog | |
| Google Cloud | on-demand | $3.67 | $2,682 | $3.67 to $4.33 | 1 h ago | SkyPilot catalog |
Machines
Whole machines from sources that describe them: Shadeform's clouds, Spheron, AWS and Azure. A machine sold in several regions of one area shows once, at its cheapest.
40 of 40 machines, cheapest per GPU first
| Provider | Tier | GPUs | vCPUs | RAM | Disk | Region | Per GPU | Machine |
|---|---|---|---|---|---|---|---|---|
| AWS | spot | 8 | 96 | 1152 GB | us-east-2 +3 more | $0.35/h | $2.79/h | |
| Azure | spot | 8 | 96 | 900 GB | eastus +2 more | $0.37/h | $2.99/h | |
| AWS | spot | 8 | 96 | 1152 GB | eu-north-1 +2 more | $0.76/h | $6.09/h | |
| AWS | spot | 8 | 96 | 1152 GB | eu-west-2 | $1.02/h | $8.19/h | |
| Spheron | spot | 1 | 22 | 120 GB | 200 GB | Finland 1 | $1.08/h | $1.08/h |
| AWS | spot | 8 | 96 | 1152 GB | ap-northeast-2 +3 more | $1.29/h | $10.33/h | |
| Verda | on-demand | 1 | 22 | 120 GB | 250 GB | FI, Central +1 more · none free | $1.36/h | $1.36/h |
| Verda | on-demand | 8 | 176 | 960 GB | 2000 GB | FI, Central · none free | $1.36/h | $10.88/h |
| Denvr | on-demand | 1 | 14 | 117 GB | 1700 GB | CA, Calgary | $1.40/h | $1.40/h |
| Denvr | on-demand | 8 | 120 | 940 GB | 13600 GB | CA, Calgary | $1.40/h | $11.20/h |
| Crusoe | on-demand | 1 | 12 | 120 GB | 1088 GB | US, Fairview, OH · none free | $1.45/h | $1.45/h |
| Crusoe | on-demand | 2 | 24 | 240 GB | 3968 GB | US, Fairview, OH · none free | $1.45/h | $2.90/h |
| Crusoe | on-demand | 4 | 48 | 480 GB | 2048 GB | US, Fairview, OH · none free | $1.45/h | $5.80/h |
| Crusoe | on-demand | 8 | 96 | 960 GB | 7808 GB | US, Fairview, OH · none free | $1.45/h | $11.60/h |
| Spheron | on-demand | 1 | 14 | 117 GB | 1700 GB | e6260a61:calgary-canada-1 | $1.68/h | $1.68/h |
| Spheron | on-demand | 8 | 120 | 940 GB | 13600 GB | e6260a61:calgary-canada-1 | $1.68/h | $13.44/h |
| Lambda | on-demand | 1 | 30 | 200 GB | 512 GB | JP, Osaka +2 more · none free | $1.99/h | $1.99/h |
| Lambda | on-demand | 1 | 30 | 200 GB | 512 GB | US, Chicago, IL +11 more | $1.99/h | $1.99/h |
| Lambda | on-demand | 2 | 60 | 400 GB | 1024 GB | IN, Mumbai · none free | $1.99/h | $3.98/h |
| Lambda | on-demand | 2 | 60 | 400 GB | 1024 GB | US, Chicago, IL +5 more · none free | $1.99/h | $3.98/h |
| Lambda | on-demand | 4 | 120 | 800 GB | 1024 GB | IN, Mumbai · none free | $1.99/h | $7.96/h |
| Lambda | on-demand | 4 | 120 | 800 GB | 1024 GB | US, Chicago, IL +5 more · none free | $1.99/h | $7.96/h |
| Lambda | on-demand | 8 | 124 | 1800 GB | 6144 GB | IN, Mumbai +2 more · none free | $1.99/h | $15.92/h |
| Lambda | on-demand | 8 | 124 | 1800 GB | 6144 GB | DE, Frankfurt · none free | $1.99/h | $15.92/h |
| Lambda | on-demand | 8 | 124 | 1800 GB | 6144 GB | US, Chicago, IL +5 more · none free | $1.99/h | $15.92/h |