everetteonhf/zerank-2-distilled-1B-GGUF

About

Static quants of anonymousauthor01/instruction_following_reranker (Prabhakar et al.) for use with llama.cpp.

Support for this model was added in PR #24083.

Files

File	Format	Size
zerank-2-distilled-1B.bf16.gguf	BF16	2.31 GiB
zerank-2-distilled-1B.Q6_K.gguf	Q6_K	974 MiB
zerank-2-distilled-1B.Q4_K_M.gguf	Q4_K_M	770 MiB

Original model card:

---

EMNLP 2026 Findings: On-Policy Distillation Meets Off-policy GRPO : Training Compact Instruction Following Rerankers

Model Checkpoint

Citation

If you use this model, please cite:

@inproceedings{prabhakar2026onpolicy,
  title     = {On-Policy Distillation Meets Off-Policy {GRPO}:
               Training Compact Instruction-Following Rerankers},
  author    = {Prabhakar, Vignesh and Pan, Jialing and
               Ankisettipalli, Anil Babu},
  booktitle = {Findings of the Association for Computational Linguistics:
               EMNLP 2026},
  year      = {2026},
  address   = {Budapest, Hungary},
  publisher = {Association for Computational Linguistics},
  note      = {To appear}
}