Products

Tools people can use

Small, focused tools for working with data and AI. Each one is built on public data and open methods, and says plainly what it does and doesn't tell you.

Calibration CheckLive

Is your AI's 90% really 90%?

Give it labeled examples and a model's probabilities. See whether its confidence can be trusted, fix it with one number, and pick the cut-off that costs least. Runs in your browser; your file never leaves the page.

  • Calibration error, Brier score, log loss and AUC, against a baseline
  • Two fixes compared on held-out cases: temperature and isotonic
  • The cost of every cut-off, and the most confident mistakes
Open Calibration Check →
llmledgerIn development

Track AI model prices over time.

A running record of a public catalogue of AI models and their prices: what changed and when, whether each price record is complete, and how long prices and models tend to last before they change or are retired.

  • The change history of every model in the catalogue
  • Completeness checks that fit each kind of model, such as chat or image
  • How long a price, and a model, usually lasts, with error bars

Coming soon to this site.