Evaluation Run 20261014T190005
Rubric 2026-09-23b · typesafe/jev-1.13 · 1 of 1 answered · 0.2s · $0.0001
No entry file was written. Results live in this run's ledger until Phase 4 adds the write path, after calibration sets the thresholds.
Per-dimension distribution
| Dimension | Type | Distribution | Mean confidence | Agrees |
|---|---|---|---|---|
answer_key_correct | noul | mean 0.92 · level 1 holds 1/1 FLAT | — | — |
difficulty | score | mean 1.50 · level 2 holds 1/1 FLAT | 0.02 | 0/1 |
distractor_pull | score | mean 1.77 · level 2 holds 1/1 FLAT | 0.67 | — |
engagement | score | mean 1.45 · level 1 holds 1/1 FLAT | 0.17 | — |
one_defensible_answer | noul | mean 0.80 · level 1 holds 1/1 FLAT | — | — |
options_scan_clean | score | mean 0.87 · level 1 holds 1/1 FLAT | 0.00 | — |
passage_realism | score | mean 1.02 · level 1 holds 1/1 FLAT | 0.70 | — |
reads_in_one_pass | score | mean 1.66 · level 2 holds 1/1 FLAT | 0.49 | — |
sat_choice_conventions | score | mean 1.23 · level 1 holds 1/1 FLAT | 0.62 | — |
sat_stem_conventions | score | mean 1.88 · level 2 holds 1/1 FLAT | 0.82 | — |
section | choice | writing 1/1 | 1.00 | 1/1 |
single_move | noul | mean 0.81 · level 1 holds 1/1 FLAT | — | — |
skill_code | choice | standard-english 1/1 | 0.92 | 1/1 |
stem_self_contained | noul | mean 0.93 · level 1 holds 1/1 FLAT | — | — |
survives_speed | noul | mean 0.56 · level 1 holds 1/1 FLAT | — | — |
tested_construct_is_sat | noul | mean 0.96 · level 1 holds 1/1 FLAT | — | — |
A dimension marked FLAT holds more than 80% of the run on one level. That is either a clean bank or a dimension reporting a constant, and only a negative control tells them apart.
Run
| Served by | {'typesafe/jev-1.13-20260917 via TypeSafe': 1} |
| Input tokens | 2,340 |
| Failed | 0 |
| Preflight notes | 0 |
| Skipped entries | 0 |