GPU compute markets
GPU rental
A100 PCIe
80 GB of memory per GPU. Rental prices from 3 providers, compared.
About this GPU
Its specification, and where each provider publishes its own prices.
| Maker | NVIDIA |
|---|---|
| Architecture | Ampere |
| Introduced | 2020 |
| Memory per GPU | 80 GB HBM2 (40 GB) or HBM2e (80 GB) |
| Power draw | 400 W (SXM) or 250 to 300 W (PCIe) |
Our own calculation, not a published figure. At each point in time it is the middle price among the cloud listings that have no line of their own (1 for this GPU), named in the table below the chart. Each listing counts once, whatever its capacity, so the line can move when a provider starts or stops listing this GPU. Spot prices are left out.
Clouds in the median
Best deal right now
$0.60/h
Vast.ai marketplace · updated just now
$0.71/h (54%) less than the median, $1.19/h (66%) less than the dearest
Listings shown
5 of 5
provider and tier pairs
Per hour
US dollars per GPU over the last 7 days. Monthly prices assume 730 hours. Times are local.
| Listing | Latest | Lowest | Highest | Data points |
|---|---|---|---|---|
| Market median | $1.31 | $1.31 | $1.34 | 43 |
| RunPod secure | $1.79 | $1.79 | $1.79 | 43 |
| RunPod community | $1.19 | $1.19 | $1.19 | 43 |
| Vast.ai marketplace | $0.59 | $0.53 | $0.80 | 43 |
| Cloud median | $1.43 | $1.43 | $1.50 | 43 |
| Spheron on-demand | $1.43 | $1.43 | $1.50 | 43 |
Listings right now
The latest price from every provider shown above, cheapest first.
| Provider | Tier | Per hour | Per month | Listed range | Supply | Updated | Via |
|---|---|---|---|---|---|---|---|
| Vast.ai | marketplace | $0.60 | $438 | $0.42 to $1.00 | 50 of 221 free | just now | Vast.ai |
| Spheron | spot | $1.19 | $869 | $1.19 to $1.20 | In stock | just now | Spheron |
| RunPod | community | $1.19 | $869 | just now | RunPod | ||
| Spheron | on-demand | $1.43 | $1,046 | $1.43 to $3.12 | In stock | just now | Spheron |
| RunPod | secure | $1.79 | $1,307 | just now | RunPod |
Machines
Whole machines from sources that describe them: Shadeform's clouds, Spheron, AWS and Azure. A machine sold in several regions of one area shows once, at its cheapest.
10 of 10 machines, cheapest per GPU first
| Provider | Tier | GPUs | vCPUs | RAM | Disk | Region | Per GPU | Machine |
|---|---|---|---|---|---|---|---|---|
| Spheron | spot | 4 | 124 | 480 GB | 3300 GB | CANADA-1 | $1.19/h | $4.76/h |
| Spheron | spot | 2 | 60 | 240 GB | 1600 GB | CANADA-1 | $1.19/h | $2.38/h |
| Spheron | spot | 1 | 28 | 120 GB | 850 GB | CANADA-1 | $1.20/h | $1.20/h |
| Spheron | on-demand | 1 | 28 | 120 GB | 850 GB | CANADA-1 +1 more | $1.43/h | $1.43/h |
| Spheron | on-demand | 1 | 14 | 100 GB | 625 GB | us-central-3 | $1.48/h | $1.48/h |
| Spheron | on-demand | 1 | 16 | 120 GB | 1000 GB | us-central-2 +1 more | $1.50/h | $1.50/h |
| Spheron | on-demand | 8 | 120 | 1800 GB | 9000 GB | us-east-1 | $1.50/h | $12.00/h |
| Spheron | on-demand | 8 | 126 | 800 GB | 5000 GB | us-central-3 | $1.50/h | $12.00/h |
| Spheron | on-demand | 1 | 12 | 120 GB | 1088 GB | 166e655a:culpeper-usa-1 | $2.40/h | $2.40/h |
| Spheron | on-demand | 1 | 12 | 120 GB | 1400 GB | f242254c:newark-usa-1 | $3.12/h | $3.12/h |