Instructions to use TreezzZ/r2s-alfworld-qwen3-30b-a3b-teacher-for-qwen3-8b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TreezzZ/r2s-alfworld-qwen3-30b-a3b-teacher-for-qwen3-8b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="TreezzZ/r2s-alfworld-qwen3-30b-a3b-teacher-for-qwen3-8b") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("TreezzZ/r2s-alfworld-qwen3-30b-a3b-teacher-for-qwen3-8b") model = AutoModelForCausalLM.from_pretrained("TreezzZ/r2s-alfworld-qwen3-30b-a3b-teacher-for-qwen3-8b", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use TreezzZ/r2s-alfworld-qwen3-30b-a3b-teacher-for-qwen3-8b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "TreezzZ/r2s-alfworld-qwen3-30b-a3b-teacher-for-qwen3-8b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "TreezzZ/r2s-alfworld-qwen3-30b-a3b-teacher-for-qwen3-8b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/TreezzZ/r2s-alfworld-qwen3-30b-a3b-teacher-for-qwen3-8b
- SGLang
How to use TreezzZ/r2s-alfworld-qwen3-30b-a3b-teacher-for-qwen3-8b with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "TreezzZ/r2s-alfworld-qwen3-30b-a3b-teacher-for-qwen3-8b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "TreezzZ/r2s-alfworld-qwen3-30b-a3b-teacher-for-qwen3-8b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "TreezzZ/r2s-alfworld-qwen3-30b-a3b-teacher-for-qwen3-8b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "TreezzZ/r2s-alfworld-qwen3-30b-a3b-teacher-for-qwen3-8b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use TreezzZ/r2s-alfworld-qwen3-30b-a3b-teacher-for-qwen3-8b with Docker Model Runner:
docker model run hf.co/TreezzZ/r2s-alfworld-qwen3-30b-a3b-teacher-for-qwen3-8b
R2S teacher: ALFWorld, Qwen3-30B-A3B-Instruct-2507 repaired for a Qwen3-8B student
Fine-tuned teacher from the main results table of the R2S (Rollout-to-Scorer Distillation) paper, Capable Teacher, Myopic Scorer: Reward-Free Teacher Repair for Agentic On-Policy Distillation. R2S repairs the teacher without any reward:
it is fully fine-tuned on suffix-objective labels collected from takeover episodes that start at the student's own states in ALFWorld.
It was then used as the sole teacher for the student TreezzZ/r2s-alfworld-qwen3-8b-student.
| Environment | ALFWorld |
| Base teacher | Qwen/Qwen3-30B-A3B-Instruct-2507 |
| Paired student | Qwen3-8B |
| Fine-tuning | full-parameter, objective suffix, 1 epoch, learning rate 2e-06, gradient accumulation 8, seed 42 |
| Data | 1200 rows (1070 train / 130 held-out), 133 optimizer steps |
| Held-out suffix CE (promotion gate) | 0.1861 -> 0.1523 (passed) |
| Format | bf16 safetensors |
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
repo = "TreezzZ/r2s-alfworld-qwen3-30b-a3b-teacher-for-qwen3-8b"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(repo, dtype="bfloat16")
Provenance
Fine-tuned with the paper's code release, Tree-Shu-Zhao/miles-agent at tag r2s (scripts/r2s_teacher_ft.sh on the labels of the repair pipeline; docs/r2s.md holds the details). In the main table the "Teacher alone" row is the unrepaired base teacher; this checkpoint is only used for distillation.
Citation
@article{zhao2026capable,
title={Capable Teacher, Myopic Scorer: Reward-Free Teacher Repair for Agentic On-Policy Distillation},
author={Zhao, Shu and Yu, Tan},
journal={arXiv preprint arXiv:2610.28586},
year={2026}
}
- Downloads last month
- 320
Model tree for TreezzZ/r2s-alfworld-qwen3-30b-a3b-teacher-for-qwen3-8b
Base model
Qwen/Qwen3-30B-A3B-Instruct-2507