Set the standard your AI has to meet. Then teach it what your experts know.

Eben Green records a baseline for every model, holds it to your standard before a person sees it, and turns expert feedback into approved context.

14-day free trial, cancel anytime
Ground truth · Care note assistant
Locked for fine-tune v3
Passed
83%passed
5 of 6 cases
Pass mark 80%
  1. Fall with ER transport2.1 s
  2. Medication refusal1.8 s
  3. Shorthand input2.4 s
  4. Unverified diagnosis1.6 s
  5. Behavior incident2.0 s
  6. Morning hygiene1.4 s
MR
Maria, care lead
Tester · Shorthand input
Accuracy 2/5

“It guessed what ‘pt refused AM meds’ meant. It should ask, or quote the staff member’s words.”

Reject Approved
Saved to context
When a note is shorthand, quote the staff member’s words instead of guessing.
Rule · from 1 reviewContext v13
With context 84%, +13 against ground truth
Sample data

Works with your model, your docs and your pipeline

Your own APIOpenAI-compatible serversOllamaYour CIPDFWordConfluence pagespromptfooOpenAI fine-tuningAxolotlTRLMMLUGSM8KIFEvalBFCL function calling

Who checks your AI before your customers do?

Most teams learn what their AI gets wrong from the people they built it for. Eben Green holds every model to your standard first, puts your own experts in front of it next, and keeps a record of who checked what, and why it passed.

Teams use Eben Green to

See how it works
  1. Lock a ground truth for every model
  2. Gate models before experts see them
  3. Let experts review on your own rubric
  4. Give your app approved context
  5. Prove the lift against ground truth

Everything between your model and your customers.

Expert review, eval suites and benchmarks in one private workspace, with a record behind every score.

A locked ground truth

Every model gets a baseline: each eval tried a few times at fixed settings, kept with its spread. Run it from your CI, next to benchmarks like MMLU and BFCL function calling.

Suite Ground truthWith context
Care notes71% ± 384% ± 2
Refund policy64% ± 470% ± 3
Shorthand input58% ± 561% ± 4

Locked per model. Three tries per eval, temperature 0.

A gate from the docs you have

Turn a PDF, Word file, Confluence page or promptfoo config into your standard. A model below the pass mark never reaches your experts.

support-bot-evals.pdf
24 cases found · pass mark 90%
Read
Case 3 · Refund after the window
Under 120 words
At most 119 words
Must mention "Settings"
Must include "Settings"
Never promise a refund date
Judge scores it, passes at 4 of 5
Never say "guarantee"
Must not include "guarantee"
Replies within 3 seconds
Reply time under 3 s

Experts review on your rubric

Testers join by invite and rate each reply under your brand. Reviewers approve, reject or correct every one.

Model reply

Refunds are available for 30 days after purchase. Your order is 45 days old, so I can offer store credit instead.

Accuracy
Helpfulness
Tone
Submitted

Approved context, by API

Repeated fixes become suggested rules, each linked to the reviews behind it. You approve them, and your app pulls them with one call.

Suggestions to review0
Offer store credit after 30 days
From 4 corrections
Added
Never name a delivery date
From a failing check
Added
Your app pulls
14 active rules
GET /v1/context

Prove the lift

Re-run with context on, the same tries as the baseline. A lift only counts when it clears the baseline's spread, and evals that flip are reported on their own. Compare a fine-tune the same way.

Ground truth71% ± 3
With context84% ± 2
+13, outside baseline variation. 2 unstable evals are reported on their own.

Also train your own model

Corrections export as fine-tuning rows and preference pairs, ready for OpenAI, Axolotl or TRL.

12
Failed evals
12
In review
9
Corrected
Fine-tuning rows214
Preference pairs96
OpenAIAxolotlTRL

Six steps, one audit trail.

The full walkthrough
  1. 01Connect

    Point Eben Green at your model, or run everything from your own code with one API key.

  2. 02Ground truth

    Record a locked baseline for every model: each eval tried a few times at fixed settings.

  3. 03Gate

    Hold each model to your pass mark. Below it, nothing reaches your experts.

  4. 04Review

    Experts join by invite and rate real replies. Reviewers approve, reject or correct each one.

  5. 05Learn

    Repeated fixes become suggested rules. You approve them, and your app pulls them by API.

  6. 06Prove

    Re-run with context on. A lift counts only when it clears the baseline's spread.

Built for the fields where AI has to be right, and the teams shipping it.

Healthcare, finance, legal and other expert fields

The people who know the work decide what good looks like, and you keep the record of who signed off.

  • A record of who reviewed, corrected and approved every reply
  • Each workspace keeps its data separate, and people join by invite only
  • Role checks on every page, API call and data query
  • Your model and judge run on your keys, encrypted at rest
  • Your logo, colors and address for every tester

Teams shipping AI

Know a change is better before customers do.

  • Six ways to test: prompt and rubric, chat, quiz, media, API and collection
  • Exact checks on every reply, and your own judge model where it takes judgment
  • Unlimited evaluations on every plan

See your AI through your experts’ eyes.

Book a 30-minute demo, or start a workspace and set your model’s ground truth today.

Eben Green: test your AI with your own experts