What an AI GPU costs to rent, now and since 2023
Rental prices are the clearest read on whether AI compute is scarce. Rising rents, especially for older chips like the H100 and A100, mean demand still exceeds supply. Falling rents mean new capacity has caught up, which matters for neoclouds (CoreWeave, Nebius, IREN), GPU-backed lending and how long GPUs keep their value.
Today's prices, per GPU-hour
| GPU | On-demand median | Providers | Spot median | Cheapest on-demand | 7D | 30D |
|---|---|---|---|---|---|---|
| B300 | $8.70 | 4 | $5.40 | $6.00 hyperstack | +5.2% | +20.1% |
| B200 | $8.44 | 5 | $4.26 | $5.43 massedcompute | +4.6% | +23.8% |
| H200 | $5.95 | 3 | $2.97 | $4.59 vast | +5.1% | +9.2% |
| H100 SXM | $3.99 | 9 | $2.37 | $1.73 vast | −3.6% | +1.5% |
| H100 PCIe | $2.60 | 3 | $1.67 | $2.60 hyperstack | 0.0% | −5.3% |
| A100 80GB | $2.15 | 7 | $1.06 | $1.13 vast | +4.0% | +16.2% |
| AMD MI300X | $2.99 | 1 | — | $2.99 hotaisle | 0.0% | +11.2% |
| L40S | $1.74 | 6 | $0.90 | $0.80 vast | +0.8% | +9.0% |
| RTX PRO 6000 | $2.35 | 4 | $1.23 | $1.73 vast | −2.1% | +7.1% |
| RTX 5090 | $0.93 | 1 | $0.60 | $1.00 vast | +7.7% | −5.7% |
On-demand price history since 2023 ($/GPU-hour, weekly)
How to read it: H100 and A100 records go back to 2023. Early points are occasional price checks, and since August 2026 there is a reading every day. H200, B200 and B300 start in August 2026. Data: Price of Compute — priceofcompute.com.
Market-wide median, every provider (weekly)
88 providersMedian on-demand price across all listed providers each week, May 2025 to today. Source: GetDeploying, GPU rental price history, CC BY 4.0 (licence).
H100: on-demand vs spot vs 12-month reserved
When reserved prices rise toward on-demand, buyers are paying up to lock in capacity, which signals a tightening market. Source: GetDeploying, GPU rental price history, CC BY 4.0.
Price of Compute Index (daily)
Base 100 = Aug 10 2026How many GPUs are free to rent right now
Our daily check| GPU | GPUs listed (Vast.ai) | Marketplace median | Cheapest ask | RunPod list |
|---|---|---|---|---|
| NVIDIA B300 | 1 | $5.90 | $5.90 | $8.99 |
| NVIDIA B200 | 41 | $10.25 | $7.50 | $7.99 |
| NVIDIA H200 | 68 | $4.00 | $2.76 | $5.29 |
| NVIDIA H100 SXM | 25 | $2.40 | $1.79 | $3.99 |
| NVIDIA H100 PCIe/NVL | 16 | $2.87 | $2.00 | $2.89 |
| AMD MI300X | 0 | — | — | $2.39 |
| NVIDIA A100 80GB | 144 | $0.74 | $0.35 | $1.79 |
| NVIDIA L40S | 47 | $0.64 | $0.42 | $1.09 |
| RTX PRO 6000 | 175 | $1.54 | $1.00 | $2.49 |
| RTX 5090 | 116 | $0.67 | $0.45 | $1.19 |
| RTX 4090 | 98 | $0.57 | $0.36 | $0.89 |
Few spare GPUs listed on open marketplaces means capacity is tight. Checked each weekday from the public Vast.ai marketplace and RunPod price list.
Have spare GPUs, or need some?
Post it on the capacity exchange. We introduce buyers and sellers privately.
Sources: Data: Price of Compute — priceofcompute.com (live prices, history and index; refreshed hourly) · GetDeploying GPU rental price history, CC BY 4.0 (weekly market medians) · Vast.ai and RunPod public prices (availability). Listed prices are not guaranteed availability; large contracts usually price lower. Not investment advice.