Connect your model endpoint or upload a CSV of prompts. Every evaluation is tied to a version of your reference answers.
- Works with your own API, Ollama, or OpenAI-compatible servers
- Import live prompts by webhook
- Per-project API keys, all logged
Six steps, one audit trail. No outside workforce and no stitched-together tools.
Connect your model endpoint or upload a CSV of prompts. Every evaluation is tied to a version of your reference answers.
Testers and annotators join with a single-use invite link. Each role sees only what it should.
Testers work through a simple queue in the format that fits: rubric, chat, quiz, media, API, or collection.
Annotators approve, reject, or correct each submission, so bad data never ships.
Repeated fixes and flags become suggested rules, examples, and terms. You approve them, and your model pulls them by API.
Download training data as JSON or CSV, or stream results into your retraining pipeline.
Each result records its reference version, the tester who submitted it, and the annotator who checked it.