How it works

Model → testers → reviewers → context layer.All in one private workspace.

Six steps, one audit trail. No outside workforce and no stitched-together tools.

STEP 01
Connect

Connect your model endpoint or upload a CSV of prompts. Every evaluation is tied to a version of your reference answers.

  • Works with your own API, Ollama, or OpenAI-compatible servers
  • Import live prompts by webhook
  • Per-project API keys, all logged
STEP 02
Invite

Testers and annotators join with a single-use invite link. Each role sees only what it should.

  • Testers join by invite only
  • SSO on the Scale tier
  • Assign testers per project
STEP 03
Evaluate

Testers work through a simple queue in the format that fits: rubric, chat, quiz, media, API, or collection.

  • Pick-best and pairwise comparisons
  • Flag edge cases on any submission
  • Autosave and resume
STEP 04
Review

Annotators approve, reject, or correct each submission, so bad data never ships.

  • Blind review for sensitive projects
  • Corrections stay attached in exports
  • Flagged items are prioritised automatically
STEP 05
Learn

Repeated fixes and flags become suggested rules, examples, and terms. You approve them, and your model pulls them by API.

  • See the feedback behind every suggestion
  • Edit anything before you approve it
  • Markdown, JSON, YAML, XML, JSONL, or chat messages
STEP 06
Export

Download training data as JSON or CSV, or stream results into your retraining pipeline.

  • Versioned snapshots for repeatable training runs
  • Token-secured webhook for live sync
  • Every pull is logged
Built for compliance

Trace every example back to its source.

Each result records its reference version, the tester who submitted it, and the annotator who checked it.