telexed ~ c / afdd4e78-a1eradar:40 · otherLIVE
← back
NO.
#afdd4e78
Topic
OTHER
Source
Simon Willison
Published
2026-05-15 00:42:09
Importance
★ 4/10 — radar 40

`datasette-llm-limits` `0.1a0` adds per-user LLM spend caps

LLM usage inside Datasette can now be hard-capped by user or globally with rolling windows and USD limits. Useful if you expose prompts to users; otherwise the impact is narrow but the cost-control pattern is worth copying.

[ KEY POINTS ]
  1. Works with datasette-llm and datasette-llm-accountant, so enforcement sits on top of existing usage tracking.
  2. Config supports per-user or global limits, with windows like rolling-24h and explicit amount_usd caps.
  3. Example policy sets $1.00 per actor over 24 hours, which is a clean template for metered AI features.
  4. Best fit is multi-user internal tools or lightweight SaaS surfaces where prompt access needs a hard budget guardrail.
Originalsimonwillison.net/2026/May/15/datasette-llm-limits/#atom-everythingRead original →

// related