Guide
How GPU reservations are billed, and where the hours go
Committed capacity lowers the hourly price. It also changes what an idle hour costs you.
By the C-Gen.AI engineering team
You pay for every hour
Reservations and committed-use contracts trade flexibility for a lower rate, and the commitment is billed whether the GPUs are busy or not. It’s use-it-or-lose-it: an hour nobody used doesn’t roll over to next month.
Where reserved hours get lost
The usual suspects are capacity sized for one workload’s peak, GPUs waiting between experiments, nodes out of service with a hardware fault, and separate pools for training and inference that each keep their own spare capacity. Most of these losses stay invisible until someone measures them.
Measure before you renew
Before renewing or expanding a commitment, gather three numbers: average and peak utilization for each pool, GPU hours by team or project, and hours lost to faulty hardware. They turn “we need more GPUs” into a question you can answer: more GPUs, or more use of the ones you have?
Read the terms before you commit
Check which GPU types and regions the commitment covers, whether it can be exchanged or resized, and what happens when the term ends. Those details decide how much room you have later, when your models, your traffic or the GPUs on the market change.

