GPU compute markets
GPU rental
T4
16 GB of memory per GPU. Rental prices from 5 providers, compared.
About this GPU
Its specification, and where each provider publishes its own prices.
| Maker | NVIDIA |
|---|---|
| Architecture | Turing |
| Introduced | 2018 |
| Memory per GPU | 16 GB GDDR6 |
| Power draw | 70 W |
Our own calculation, not a published figure. At each point in time it is the middle price among the cloud listings that have no line of their own (3 for this GPU), named in the table below the chart. Each listing counts once, whatever its capacity, so the line can move when a provider starts or stops listing this GPU. Spot prices are left out.
Clouds in the median
Best deal right now
$0.14/h
Akash marketplace · updated 14 min ago
$0.28/h (67%) less than the median, $0.67/h (83%) less than the dearest
Listings shown
7 of 7
provider and tier pairs
Per hour
US dollars per GPU over the last 7 days. Monthly prices assume 730 hours. Times are local.
| Listing | Latest | Lowest | Highest | Data points |
|---|---|---|---|---|
| Market median | $0.14 | $0.14 | $0.42 | 43 |
| Akash marketplace | $0.14 | $0.13 | $0.16 | 43 |
| Vast.ai marketplace | $0.14 | $0.14 | $0.14 | 43 |
| Cloud median | $0.47 | $0.47 | $0.81 | 10 |
| AWS on-demand | $0.42 | $0.42 | $0.42 | 4 |
| Azure on-demand | $0.53 | $0.53 | $0.53 | 4 |
| Replicate serverless | $0.81 | $0.81 | $0.81 | 9 |
Listings right now
The latest price from every provider shown above, cheapest first.
| Provider | Tier | Per hour | Per month | Listed range | Supply | Updated | Via |
|---|---|---|---|---|---|---|---|
| Azure | spot | $0.06 | $42 | $0.06 to $0.07 | 1 h ago | SkyPilot catalog | |
| AWS | spot | $0.09 | $63 | $0.09 to $0.48 | 1 h ago | SkyPilot catalog | |
| Akash | marketplace | $0.14 | $102 | $0.11 to $0.16 | 1 of 2 free | 14 min ago | Akash |
| Vast.ai | marketplace | $0.14 | $102 | $0.12 to $1.33 | 18 of 38 free | 14 min ago | Vast.ai |
| AWS | on-demand | $0.42 | $307 | $0.42 to $0.59 | 1 h ago | SkyPilot catalog | |
| Azure | on-demand | $0.53 | $384 | $0.53 to $0.63 | 1 h ago | SkyPilot catalog | |
| Replicate | serverless | $0.81 | $591 | 4 h ago | Replicate |
Machines
Whole machines from sources that describe them: Shadeform's clouds, Spheron, AWS and Azure. A machine sold in several regions of one area shows once, at its cheapest.
108 of 108 machines, cheapest per GPU first
| Provider | Tier | GPUs | vCPUs | RAM | Disk | Region | Per GPU | Machine |
|---|---|---|---|---|---|---|---|---|
| Azure | spot | 1 | 4 | 28 GB | eastus2 +7 more | $0.06/h | $0.06/h | |
| Azure | spot | 1 | 8 | 56 GB | eastus2 +7 more | $0.08/h | $0.08/h | |
| AWS | spot | 1 | 4 | 16 GB | us-west-2 +4 more | $0.09/h | $0.09/h | |
| AWS | spot | 1 | 16 | 32 GB | eu-south-2 +1 more | $0.09/h | $0.09/h | |
| AWS | spot | 1 | 8 | 32 GB | eu-north-1 +4 more | $0.10/h | $0.10/h | |
| AWS | spot | 1 | 4 | 8 GB | us-west-2 +1 more | $0.11/h | $0.11/h | |
| AWS | spot | 1 | 4 | 16 GB | eu-north-1 +4 more | $0.11/h | $0.11/h | |
| Azure | spot | 4 | 64 | 440 GB | eastus2 +7 more | $0.12/h | $0.48/h | |
| AWS | spot | 1 | 4 | 8 GB | eu-south-2 +1 more | $0.12/h | $0.12/h | |
| AWS | spot | 1 | 4 | 16 GB | ap-east-1 +6 more | $0.13/h | $0.13/h | |
| Azure | spot | 1 | 16 | 110 GB | eastus2 +7 more | $0.13/h | $0.13/h | |
| AWS | spot | 1 | 8 | 32 GB | us-west-2 +4 more | $0.14/h | $0.14/h | |
| AWS | spot | 1 | 8 | 16 GB | eu-south-2 +1 more | $0.14/h | $0.14/h | |
| AWS | spot | 8 | 96 | 384 GB | ap-east-1 +6 more | $0.15/h | $1.20/h | |
| AWS | spot | 1 | 32 | 64 GB | eu-south-2 +1 more | $0.15/h | $0.15/h | |
| AWS | spot | 2 | 64 | 128 GB | eu-south-2 +3 more | $0.15/h | $0.31/h | |
| AWS | spot | 1 | 16 | 64 GB | us-west-2 +4 more | $0.16/h | $0.16/h | |
| AWS | spot | 8 | 96 | 384 GB | us-west-1 +4 more | $0.17/h | $1.34/h | |
| AWS | spot | 8 | 96 | 384 GB | eu-south-1 +4 more | $0.18/h | $1.43/h | |
| AWS | spot | 1 | 4 | 16 GB | eu-west-2 | $0.18/h | $0.18/h | |
| AWS | spot | 4 | 48 | 192 GB | eu-north-1 +4 more | $0.19/h | $0.74/h | |
| AWS | spot | 2 | 64 | 128 GB | ap-southeast-3 +6 more | $0.19/h | $0.38/h | |
| AWS | spot | 4 | 48 | 192 GB | af-south-1 | $0.20/h | $0.81/h | |
| AWS | spot | 8 | 96 | 384 GB | eu-west-2 | $0.21/h | $1.64/h | |
| AWS | spot | 1 | 8 | 16 GB | us-east-1 +1 more | $0.21/h | $0.21/h |