GPU compute markets
Providers
Azure
Hyperscaler. 7 GPU models listed right now, via SkyPilot catalog.
GPUs listed
US dollars per GPU-hour, against each GPU's median across every provider. Largest memory first.
| GPU | VRAM | Tier | Price | Market median | Against it | Supply | Updated |
|---|---|---|---|---|---|---|---|
| A100 SXM | 80 GB | spot | $0.40/h | 2 h ago | |||
| A100 SXM | 80 GB | on-demand | $3.67/h | $1.71/h | +115% | 2 h ago | |
| H100 SXM | 80 GB | on-demand | $6.98/h | $3.30/h | +111% | 2 h ago | |
| H100 SXM | 80 GB | spot | $6.98/h | 2 h ago | |||
| A100 SXM | 40 GB | spot | $0.37/h | 2 h ago | |||
| A100 SXM | 40 GB | on-demand | $3.40/h | $1.56/h | +117% | 2 h ago | |
| V100 PCIe | 32 GB | spot | $0.30/h | 2 h ago | |||
| V100 PCIe | 32 GB | on-demand | $2.75/h | $2.55/h | +8% | 2 h ago | |
| A10 | 24 GB | spot | $0.80/h | 2 h ago | |||
| A10 | 24 GB | on-demand | $3.20/h | $1.42/h | +126% | 2 h ago | |
| T4 | 16 GB | spot | $0.06/h | 2 h ago | |||
| T4 | 16 GB | on-demand | $0.53/h | $0.42/h | +25% | 2 h ago | |
| V100 PCIe | 16 GB | spot | $0.34/h | 2 h ago | |||
| V100 PCIe | 16 GB | on-demand | $3.06/h | $1.56/h | +96% | 2 h ago |
Machines
38 whole machines, cheapest per GPU first. A machine sold in several regions of one area shows once, at its cheapest.
| GPU | Tier | GPUs | vCPUs | RAM | Region | Per GPU | Machine |
|---|---|---|---|---|---|---|---|
| T4 | spot | 1 | 4 | 28 GB | eastus2 +7 more | $0.06/h | $0.06/h |
| T4 | spot | 1 | 8 | 56 GB | eastus2 +7 more | $0.08/h | $0.08/h |
| T4 | spot | 4 | 64 | 440 GB | eastus2 +7 more | $0.12/h | $0.48/h |
| T4 | spot | 1 | 16 | 110 GB | eastus2 +7 more | $0.13/h | $0.13/h |
| V100 PCIe | spot | 8 | 40 | 672 GB | eastus +2 more | $0.30/h | $2.42/h |
| V100 PCIe | spot | 1 | 6 | 112 GB | westus3 +6 more | $0.34/h | $0.34/h |
| V100 PCIe | spot | 2 | 12 | 224 GB | westus3 +6 more | $0.34/h | $0.67/h |
| V100 PCIe | spot | 4 | 24 | 448 GB | westus3 +13 more | $0.34/h | $1.35/h |
| A100 SXM | spot | 8 | 96 | 900 GB | eastus +2 more | $0.37/h | $2.99/h |
| A100 SXM | spot | 1 | 24 | 220 GB | westus3 +6 more | $0.40/h | $0.40/h |
| A100 SXM | spot | 2 | 48 | 440 GB | westus3 +6 more | $0.40/h | $0.81/h |
| A100 SXM | spot | 4 | 96 | 880 GB | westus3 +6 more | $0.40/h | $1.62/h |
| A100 SXM | spot | 8 | 96 | 1800 GB | eastus +2 more | $0.45/h | $3.60/h |
| T4 | on-demand | 1 | 4 | 28 GB | eastus +7 more | $0.53/h | $0.53/h |
| T4 | on-demand | 1 | 8 | 56 GB | eastus +7 more | $0.75/h | $0.75/h |
| A10 | spot | 1 | 36 | 440 GB | eastus +6 more | $0.80/h | $0.80/h |
| A10 | spot | 2 | 72 | 880 GB | eastus +6 more | $0.81/h | $1.63/h |
| T4 | on-demand | 4 | 64 | 440 GB | eastus +7 more | $1.09/h | $4.35/h |
| A10 | spot | 1 | 36 | 880 GB | eastus +6 more | $1.13/h | $1.13/h |
| T4 | on-demand | 1 | 16 | 110 GB | eastus +7 more | $1.20/h | $1.20/h |
| V100 PCIe | on-demand | 8 | 40 | 672 GB | eastus +2 more | $2.75/h | $22.03/h |
| V100 PCIe | on-demand | 1 | 6 | 112 GB | eastus +6 more | $3.06/h | $3.06/h |
| V100 PCIe | on-demand | 2 | 12 | 224 GB | eastus +6 more | $3.06/h | $6.12/h |
| V100 PCIe | on-demand | 4 | 24 | 448 GB | eastus +13 more | $3.06/h | $12.24/h |
| A10 | on-demand | 1 | 36 | 440 GB | eastus +6 more | $3.20/h | $3.20/h |
| A10 | on-demand | 2 | 72 | 880 GB | eastus +6 more | $3.26/h | $6.52/h |
| A100 SXM | on-demand | 8 | 96 | 900 GB | eastus +2 more | $3.40/h | $27.20/h |
| A100 SXM | on-demand | 1 | 24 | 220 GB | eastus +6 more | $3.67/h | $3.67/h |
| A100 SXM | on-demand | 2 | 48 | 440 GB | eastus +6 more | $3.67/h | $7.35/h |
| A100 SXM | on-demand | 4 | 96 | 880 GB | eastus +6 more | $3.67/h | $14.69/h |
| A100 SXM | on-demand | 8 | 96 | 1800 GB | eastus +2 more | $4.10/h | $32.77/h |
| A10 | on-demand | 1 | 36 | 880 GB | eastus +6 more | $4.52/h | $4.52/h |
| H100 SXM | on-demand | 1 | 40 | 320 GB | eastus +3 more | $6.98/h | $6.98/h |
| H100 SXM | spot | 1 | 40 | 320 GB | eastus +3 more | $6.98/h | $6.98/h |
| H100 SXM | on-demand | 2 | 80 | 640 GB | eastus +3 more | $6.98/h | $13.96/h |
| H100 SXM | spot | 2 | 80 | 640 GB | eastus +3 more | $6.98/h | $13.96/h |
| H100 SXM | on-demand | 12 | 96 | 1900 GB | eastus +2 more | $8.19/h | $98.32/h |
| H100 SXM | spot | 12 | 96 | 1900 GB | eastus +2 more | $8.19/h | $98.32/h |