Write vs decide — the same question, two machines
Ask both the same question: "Is this email urgent?" The LLM streams tokens — a sentence of reasoning, then finally a "yes." Jev never writes a word: it emits a typed decision {urgent: true, p: 0.91} the instant you hit run. Press the button and watch the two clocks. The LLM's answer is buried in prose you have to parse; Jev's is already a boolean your code can branch on.
The LLM has to generate ~40 tokens before the answer appears; Jev does one forward pass and returns the class + confidence. Same decision, ~200× the latency gap.
How it works — one pass, not a loop
Here's the whole trick. An LLM is a loop: it predicts one token, sticks it on the end, feeds the whole thing back in, and predicts the next — dozens of sequential passes to spell out an answer. Jev is not autoregressive. TypeSafe's architecture uses a parallel sampler that reads off the entire answer in a single forward pass — no token-by-token decoding loop at all. That one structural change is where ~200× of the speed comes from. Press run and watch the LLM crank its loop while Jev answers in one shot.
Three output types, all typed. Jev only ever returns one of three schema-locked shapes — Choice (pick one of N, each with a probability), Score (a number in a range, with a probability), or Null (a single 0–1 probability, i.e. a calibrated yes/no). It literally cannot emit free text — which is also why it can't hallucinate a paragraph or drift off-schema.
Why the probability is trustworthy: RLCD. Normal chat models are tuned with RLHF — optimized for what humans like, which quietly rewards confident-sounding prose and overconfidence. Jev is trained with Reinforcement Learning for Calibrated Decisions (RLCD): it's rewarded for being calibrated, so its 0.90 means "right ~90% of the time," not "sounds sure." Confidence comes from the shape of the output distribution (sharp vs spread), not a made-up certainty score.
The 400× bill — decisions at scale
A decision that's cheap once is a budget when you run it a million times a day: every email classified, every message triaged, every agent step evaluated. Drag the volume. Watch the LLM bar climb into real money while the Jev bar barely leaves the floor.
Calibrated confidence — a number you can trust
An LLM saying "I'm 90% sure" is just more generated text — it means nothing. Jev returns a real probability, and it's calibrated: of all the times it says 0.90, about 90% actually turn out right. Drag the confidence threshold. Below it, Jev auto-answers; above it, it flags for a human. A trustworthy number lets you set that line on purpose.
The router — Jev up front, the LLM in reserve
The real pattern isn't Jev instead of the LLM — it's Jev in front of it. A stream of tasks arrives. Jev instantly handles the easy, confident majority for a fraction of a cent; only the hard, low-confidence tail gets escalated to a slow, expensive LLM. Drag how confident Jev has to be before it dares decide alone, and watch throughput and cost move against each other.