Prompt Caching in the API

1 year ago 8
Add to circle
Offering automatic discounts on inputs that the model has recently seen
Read Entire Article
  1. Homepage
  2. Technology
  3. Prompt Caching in the API

Related

Poolside launches Laguna S 2.1, an 118B open-weight model built for agentic coding and long-horizon work, that it says competes with larger open models (Iain Martin/Forbes)

Poolside launches Laguna S 2.1, an 118B open-weight model bu...

9 minutes ago 0
This Hidden Pattern in the Sun Could Predict Solar Storms Years in Advance

This Hidden Pattern in the Sun Could Predict Solar Storms Ye...

13 minutes ago 0
Nintendo customers have no legal right to tariff refunds, company tells judge

Nintendo customers have no legal right to tariff refunds, co...

15 minutes ago 0