Glossary · AI
Inference Cost
The compute cost of running an LLM to produce a response.
What is Inference Cost?
Inference cost is what it costs to run the model for each request, typically driven by token counts and model size.
Because every session — paying or not — incurs inference cost, monetizing free usage is central to a sustainable AI app.
Inference Cost in context
To understand Inference Cost fully, it helps to know the concepts around it. Usage-Based Billing, charging in proportion to consumption, such as per token or request. Large Language Model (LLM), a neural network trained on large text corpora to generate and understand language. ARPU, average revenue per user over a period.
Together these describe how ai works in practice for an AI app, and where Inference Cost fits among them.
Frequently asked questions
Start monetizing in about 5 minutes
Wrap your existing LLM response stream with the Monetzly SDK and earn on every session, no paywall required.