Prompt caching AI models: send the same prefix twice, pay once
| # | AI model | Capabilities | API $/1M (in / out) | Context window | Price / mo | Output $/1M | Overview | Visit site |
|---|---|---|---|---|---|---|---|---|
| 141 | Aion 3.5 Mini Aion Labs | $0.7 / $1.4 | 256K tokens | API only | 1.4 | View | ||
| 142 | Solar Mini 4 Upstage | $0.1 / $0.4 | 512K tokens | API only | 0.4 | View | ||
| 143 | Perceptron Mk1.5 Perceptron | $0.15 / $1.5 | 36.9K tokens | API only | 1.5 | View | ||
| 144 | Ling 3.0 Flash VL InclusionAI | $0.02 / $0.059 | 256K tokens | API only | 0.059 | View | ||
| 145 | Pareto Unbiased | $0.8 / $3.2 | API only | 3.2 | View | |||
| 146 | Schematron V2 Turbo Inference.net | $0.03 / $0.15 | 125K tokens | API only | 0.15 | View | ||
| 147 | Schematron V2 Small Inference.net | $0.05 / $0.23 | 125K tokens | API only | 0.23 | View |
Browse by need
Prompt caching stores an identical prompt prefix between calls, so repeated context is charged at a fraction of the base input rate - typically 10%, and as little as 2.5% on Claude Fable 5.1. If your application sends the same lengthy system prompt with every request, this is usually the biggest saving available to you.
147 models support it. The saving applies to input only, so the effect is largest where prompts are long and answers are short - support bots with detailed instructions, agents with big tool catalogues, RAG systems that resend the same corpus. Cache entries expire, so the economics favour high request frequency against a stable prefix.
Models with this capability
The 147 models below all support this capability. Prices are input and output per 1M tokens from the vendor official price list; for dirhams multiply by 3.6725. Tap a card to open the model page.
How to choose
- Put everything stable at the very front: system prompt, tool definitions, reference documents.
- Keep user-specific content after the cached prefix.
- Check the cache lifetime — short TTLs punish low-traffic applications.
- Account for write cost: some vendors charge a premium to create the entry.
Common mistakes
Who this suits
Related filters
Frequently asked questions
How much does caching save?
What has to stay identical?
When is caching pointless?
How much can I realistically save?
Does caching change answers?
Frequently searched
Rate this page
Help us improve