Decision models experiments
System One decision models, data and benchmarks used in https://github.com/baobab-tech/decision-models-experiments
Updated • 95Note Our evaluation set: 1,420 development evaluation reports. Document labels (silver: GLM-5.3-Flash; plus pipeline labels) and 190k tagged excerpts. Used by experiments 01 and 02.
Jev Decision Index
🔬472Benchmarks and news on various repros of TypeSafe's Jev
Note Decision Index: community leaderboard scoring open decision models and Jev on one suite.
LocalLLaMA/typed-decisions
Viewer • Updated • 3.2k • 28.9k • 115Note typed-decisions benchmark: Choice/Score/Noul items with Decider 1, d1 and Jev results.
fastino/fast-decisions
Viewer • Updated • 1.7k • 1.6k • 23Note Fastino's 17-domain decision suite (dev split public).
deepseek-ai/DeepSeek-V4.1-Flash
Image-Text-to-Text • 763B • Updated • 1.16M • • 4.18kNote LLM baseline and judge in experiment 01, via HF Inference Providers.
fastino/GLiNER2.5-Decide
Token Classification • 0.5B • Updated • 68.4k • 380Note DeBERTa-v3 encoder, 340M, Apache-2.0. Native multi-label; runs on CPU.
convaiinnovations/laya
Text Classification • 0.4B • Updated • 20.4k • 5.28kNote Laya: ModernBERT decision model, 421M (322M multilingual).
heman10x/rlcd-modernbert-151m
Text Classification • 0.2B • Updated • 29k • 38Note openJev Verdict: ModernBERT-base, 151M; trains on Apple MPS.
MaziyarPanahi/ModernJEV-Decide-Preview
Text Classification • 0.1B • Updated • 158 • 13Note ModernBERT-base, 150M, trained on 60k agent decisions.
wfzyx/von
Zero-Shot Classification • 0.4B • Updated • 90.7k • 57Note Von: ModernBERT-large decision head, 395M.
hotchpotch/bekko-system-one-v0-400m
Updated • 7Note bekko: small encoder decision model (17M–395M family).
BarraHome/Decision-Jef-0.1
Text Classification • 0.3B • Updated • 491 • 2Note Decision-Jef: 307M encoder decision model.
jaredpalmer/kev-0.8b
Text Classification • Updated • 14.2k • 40Note Kev: Qwen3.5 + LoRA + pointer head, Jev-compatible server; MLX on Mac.
jaredpalmer/kev-4b
Text Classification • Updated • 18.1k • 107Note Kev-4B: Qwen3.5-4B, Jev-compatible, MLX on Mac.
jaredpalmer/kev-9b
Text Classification • Updated • 4.78k • 68Note Kev-9B: Qwen3.5-9B.
jaredpalmer/kev-27b
Text Classification • 26B • Updated • 1.2k • 34Note Kev-27B v2: full fine-tune of Qwen3.8-27B.
alibiserikbay/JevK5
Text Generation • 4B • Updated • 10.4k • 18Note JevK5: Qwen3.5-4B with LoRA; near Jev on JevBench.
alibiserikbay/JevK5-GGUF
2B • Updated • 13.6k • 2Note JevK5 GGUF for llama.cpp (Metal).
Mapika/decider-2b
Text Classification • 2B • Updated • 315k • 102Note decider: Qwen3.5 Base decision models, 0.8B–35B.
Mapika/decider-4b
Text Classification • 4B • Updated • 24.2k • 21Note decider-4b: ranks near Jev on JevBench.
togethercomputer/Tev1-4B-experimental
Text Generation • 5B • Updated • 3.76k • 30Note Tev1: Together's Qwen3.5-4B decision model; up to ~24 options.
internlm/Intern-Decision-4B
Image-Text-to-Text • 5B • Updated • 2.43k • 77Note Intern-Decision: Qwen3.5-4B decision model.
Contrastive-LM/CLM-v0.1-8B
Text Ranking • Updated • 3.9k • 743Note CLM-8B: contrastive dual encoder on Qwen3-8B; cached option embeddings.
autotrust/JEV-27B
Text Classification • 27B • Updated • 168k • 55Note autotrust JEV-27B: Qwen3.8-27B decision model.
StrandsAgents/strands-decider-2B-hobson-v19
Text Classification • Updated • 59Note Strands Decider: 2B decision model for agent tool calls.
dwidlee/systemone-lite-0.5b
Text Generation • 0.5B • Updated • 1.91kNote systemone-lite: Qwen2.5-0.5B fine-tune.
jinghao1632/bit-jev-2b-distilled
2B • Updated • 2.47kNote bit-jev: 2B model distilled from Jev.
akhilaaa3/Jev-Omni
Text Classification • 12B • Updated • 3.91k • 376Note Jev-Omni: Gemma 4 12B, multimodal decisions.
ollaya-dev/cygnet
Text Classification • Updated • 2Note Cygnet: Gemma-4-12B; top of JevBench v1.5.4 (73.7).
perplexity-ai/pplx-decider-v1-27b
Text Classification • 26B • Updated • 1.51k • 93Note pplx-decider: Perplexity's 27B decision model.
Cloudflare/clef
Image-Text-to-Text • 27B • Updated • 7.26k • 1.68kNote Clef: Cloudflare's decision model.
prism-ml/Ternary-Bonsai-2-27B-gguf
Text Generation • 27B • Updated • 4.19M • 2.49kNote Ternary Bonsai 2 27B (Qwen3.8-27B), base of Bonsai-Llama-Jev.