Inference Cost

Inference cost is the compute cost of running a trained AI model to produce an output, as distinct from the one-time cost of training it.

For deployed agents, inference cost recurs with every task and is a major component of the price of AI labor.

Like token cost, it is an input metric; benchmarking on outcomes captures inference cost without forcing buyers to model it directly.