Quaedra Research

Jet

A typed decision model. Give it a state and named questions; it returns choices, scores and probabilities, never free-form text.

v6.2Latest release
Qwen3.5-4BBase model, rank-16 LoRA
40.0Decision Index 0.3, #52 of 113

How it works

Each answer option maps to a single label token. Jet reads the next-token logits for those labels only, divides by a temperature fitted on held-out data, and applies softmax. One forward pass per question, no sampling. Answers always follow the requested type, but decisions can still be wrong.

TypeCriteriaAnswer
choice2–255 named optionsSelected key, probability per key
score2–10 ordered levelsFractional score, level, probabilities
noulNoneProbability that the answer is yes

Benchmarks

Decision Index 0.3

The official leaderboard, run by its maintainers on the full suite: 110,201 requests across 42 benchmarks, published October 7, 2026. Qwen3.5-4B models shown; Jet v6.2 scores 40.01, rank 52 of 113.

The index weights public benchmarks 20%, same skills 50% and new domains 30%, after equating each part across models. Scores within 0.9 points are tied, as Jet is with its neighbors. Jet answered 109,958 requests; 243 exceed its 16,384-token prompt limit. Details · Leaderboard

Show as table

Jet v6.2 by area

Decision Index skill score per area.

Strongest at tools and retrieval, weakest at knowledge and reasoning. Calibration: 66% accurate at 80% mean confidence (ECE 0.14), so confidences run high.

v6.1 → v6.2 on the local holdout

914 fixed cases, full merged BF16 weights.

Jet v6.1Jet v6.2

Small changes; not statistically significant. Financial sentiment measures SEntFiN transfer, not FinEntity.

Examples

Real outputs recorded in the model's reference file (Jet V5, Qwen3-0.6B, calibrated). Pick a case to see the request and the typed answer.

Response JSON

For live inference, run the model locally; see Run it.

Run it

The v6.2 release is self-contained: merged bf16 weights plus the CUDA runtime.

hf download michaljach/jet --revision v6.2.0 --local-dir jet
cd jet && python -m pip install -r requirements.txt
echo '{"state":"I was charged twice this month.",
  "questions":{"billing":{"type":"noul",
  "instructions":"Is this a billing issue?"}}}' | python jet.py