Instructions to use baseten/math-sgd-qwen38_27b-expert with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use baseten/math-sgd-qwen38_27b-expert with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="baseten/math-sgd-qwen38_27b-expert")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("baseten/math-sgd-qwen38_27b-expert")
model = AutoModelForMultimodalLM.from_pretrained("baseten/math-sgd-qwen38_27b-expert", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use baseten/math-sgd-qwen38_27b-expert with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "baseten/math-sgd-qwen38_27b-expert"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "baseten/math-sgd-qwen38_27b-expert",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/baseten/math-sgd-qwen38_27b-expert

SGLang

How to use baseten/math-sgd-qwen38_27b-expert with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "baseten/math-sgd-qwen38_27b-expert" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "baseten/math-sgd-qwen38_27b-expert",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "baseten/math-sgd-qwen38_27b-expert" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "baseten/math-sgd-qwen38_27b-expert",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use baseten/math-sgd-qwen38_27b-expert with Docker Model Runner:
```
docker model run hf.co/baseten/math-sgd-qwen38_27b-expert
```

math-sgd-qwen38_27b-expert / assets /environment-curves /20261027 /training.csv

waterloo-intern

Replace Math SGD with final200 SymPy format-reward weights and curves

5d653bb verified 9 days ago

Raw History Blame Contribute Delete

23.4 kB

series,completed_updates,value,source_metric,complete,samples,scored,unscored,correct,truncated,completed,format_valid,format_valid_among_completed,mean_output_tokens,correctness_lower_bound,correctness_upper_bound
Adam,1,0.40234375,train/reward_mean,,,,,,,,,,,,
Adam,2,0.375,train/reward_mean,,,,,,,,,,,,
Adam,3,0.41796875,train/reward_mean,,,,,,,,,,,,
Adam,4,0.3515625,train/reward_mean,,,,,,,,,,,,
Adam,5,0.421875,train/reward_mean,,,,,,,,,,,,
Adam,6,0.5703125,train/reward_mean,,,,,,,,,,,,
Adam,7,0.3046875,train/reward_mean,,,,,,,,,,,,
Adam,8,0.41796875,train/reward_mean,,,,,,,,,,,,
Adam,9,0.4453125,train/reward_mean,,,,,,,,,,,,
Adam,10,0.44140625,train/reward_mean,,,,,,,,,,,,
Adam,11,0.17578125,train/reward_mean,,,,,,,,,,,,
Adam,12,0.36328125,train/reward_mean,,,,,,,,,,,,
Adam,13,0.453125,train/reward_mean,,,,,,,,,,,,
Adam,14,0.25390625,train/reward_mean,,,,,,,,,,,,
Adam,15,0.6640625,train/reward_mean,,,,,,,,,,,,
Adam,16,0.54296875,train/reward_mean,,,,,,,,,,,,
Adam,17,0.3984375,train/reward_mean,,,,,,,,,,,,
Adam,18,0.63671875,train/reward_mean,,,,,,,,,,,,
Adam,19,0.57421875,train/reward_mean,,,,,,,,,,,,
Adam,20,0.2578125,train/reward_mean,,,,,,,,,,,,
Adam,21,0.6015625,train/reward_mean,,,,,,,,,,,,
Adam,22,0.52734375,train/reward_mean,,,,,,,,,,,,
Adam,23,0.4296875,train/reward_mean,,,,,,,,,,,,
Adam,24,0.58984375,train/reward_mean,,,,,,,,,,,,
Adam,25,0.61328125,train/reward_mean,,,,,,,,,,,,
Adam,26,0.60546875,train/reward_mean,,,,,,,,,,,,
Adam,27,0.6328125,train/reward_mean,,,,,,,,,,,,
Adam,28,0.5625,train/reward_mean,,,,,,,,,,,,
Adam,29,0.65234375,train/reward_mean,,,,,,,,,,,,
Adam,30,0.6796875,train/reward_mean,,,,,,,,,,,,
Adam,31,0.59765625,train/reward_mean,,,,,,,,,,,,
Adam,32,0.51171875,train/reward_mean,,,,,,,,,,,,
Adam,33,0.46875,train/reward_mean,,,,,,,,,,,,
Adam,34,0.37109375,train/reward_mean,,,,,,,,,,,,
Adam,35,0.59765625,train/reward_mean,,,,,,,,,,,,
Adam,36,0.7890625,train/reward_mean,,,,,,,,,,,,
Adam,37,0.6796875,train/reward_mean,,,,,,,,,,,,
Adam,38,0.73046875,train/reward_mean,,,,,,,,,,,,
Adam,39,0.78125,train/reward_mean,,,,,,,,,,,,
Adam,40,0.75,train/reward_mean,,,,,,,,,,,,
Adam,41,0.6640625,train/reward_mean,,,,,,,,,,,,
Adam,42,0.5234375,train/reward_mean,,,,,,,,,,,,
Adam,43,0.58984375,train/reward_mean,,,,,,,,,,,,
Adam,44,0.69140625,train/reward_mean,,,,,,,,,,,,
Adam,45,0.49609375,train/reward_mean,,,,,,,,,,,,
Adam,46,0.55078125,train/reward_mean,,,,,,,,,,,,
Adam,47,0.546875,train/reward_mean,,,,,,,,,,,,
Adam,48,0.6875,train/reward_mean,,,,,,,,,,,,
Adam,49,0.45703125,train/reward_mean,,,,,,,,,,,,
Adam,50,0.4453125,train/reward_mean,,,,,,,,,,,,
Adam,51,0.4453125,train/reward_mean,,,,,,,,,,,,
Adam,52,0.54296875,train/reward_mean,,,,,,,,,,,,
Adam,53,0.49609375,train/reward_mean,,,,,,,,,,,,
Adam,54,0.66796875,train/reward_mean,,,,,,,,,,,,
Adam,55,0.61328125,train/reward_mean,,,,,,,,,,,,
Adam,56,0.34765625,train/reward_mean,,,,,,,,,,,,
Adam,57,0.6015625,train/reward_mean,,,,,,,,,,,,
Adam,58,0.51953125,train/reward_mean,,,,,,,,,,,,
Adam,59,0.62109375,train/reward_mean,,,,,,,,,,,,
Adam,60,0.7734375,train/reward_mean,,,,,,,,,,,,
Adam,61,0.5625,train/reward_mean,,,,,,,,,,,,
Adam,62,0.64453125,train/reward_mean,,,,,,,,,,,,
Adam,63,0.5390625,train/reward_mean,,,,,,,,,,,,
Adam,64,0.5546875,train/reward_mean,,,,,,,,,,,,
Adam,65,0.578125,train/reward_mean,,,,,,,,,,,,
Adam,66,0.66796875,train/reward_mean,,,,,,,,,,,,
Adam,67,0.5859375,train/reward_mean,,,,,,,,,,,,
Adam,68,0.70703125,train/reward_mean,,,,,,,,,,,,
Adam,69,0.66015625,train/reward_mean,,,,,,,,,,,,
Adam,70,0.6171875,train/reward_mean,,,,,,,,,,,,
Adam,71,0.609375,train/reward_mean,,,,,,,,,,,,
Adam,72,0.6015625,train/reward_mean,,,,,,,,,,,,
Adam,73,0.5390625,train/reward_mean,,,,,,,,,,,,
Adam,74,0.71875,train/reward_mean,,,,,,,,,,,,
Adam,75,0.68359375,train/reward_mean,,,,,,,,,,,,
Adam,76,0.57421875,train/reward_mean,,,,,,,,,,,,
Adam,77,0.54296875,train/reward_mean,,,,,,,,,,,,
Adam,78,0.75,train/reward_mean,,,,,,,,,,,,
Adam,79,0.58984375,train/reward_mean,,,,,,,,,,,,
Adam,80,0.5234375,train/reward_mean,,,,,,,,,,,,
Adam,81,0.5625,train/reward_mean,,,,,,,,,,,,
Adam,82,0.6484375,train/reward_mean,,,,,,,,,,,,
Adam,83,0.515625,train/reward_mean,,,,,,,,,,,,
Adam,84,0.453125,train/reward_mean,,,,,,,,,,,,
Adam,85,0.5078125,train/reward_mean,,,,,,,,,,,,
Adam,86,0.53515625,train/reward_mean,,,,,,,,,,,,
Adam,87,0.55859375,train/reward_mean,,,,,,,,,,,,
Adam,88,0.390625,train/reward_mean,,,,,,,,,,,,
Adam,89,0.47265625,train/reward_mean,,,,,,,,,,,,
Adam,90,0.42578125,train/reward_mean,,,,,,,,,,,,
Adam,91,0.43359375,train/reward_mean,,,,,,,,,,,,
Adam,92,0.46484375,train/reward_mean,,,,,,,,,,,,
Adam,93,0.6015625,train/reward_mean,,,,,,,,,,,,
Adam,94,0.51953125,train/reward_mean,,,,,,,,,,,,
Adam,95,0.53125,train/reward_mean,,,,,,,,,,,,
Adam,96,0.66015625,train/reward_mean,,,,,,,,,,,,
Adam,97,0.3984375,train/reward_mean,,,,,,,,,,,,
Adam,98,0.40234375,train/reward_mean,,,,,,,,,,,,
Adam,99,0.48046875,train/reward_mean,,,,,,,,,,,,
Adam,100,0.56640625,train/reward_mean,,,,,,,,,,,,
Adam,101,0.58203125,train/reward_mean,,,,,,,,,,,,
Adam,102,0.52734375,train/reward_mean,,,,,,,,,,,,
Adam,103,0.5078125,train/reward_mean,,,,,,,,,,,,
Adam,104,0.64453125,train/reward_mean,,,,,,,,,,,,
Adam,105,0.69921875,train/reward_mean,,,,,,,,,,,,
Adam,106,0.5546875,train/reward_mean,,,,,,,,,,,,
Adam,107,0.55078125,train/reward_mean,,,,,,,,,,,,
Adam,108,0.62109375,train/reward_mean,,,,,,,,,,,,
Adam,109,0.5625,train/reward_mean,,,,,,,,,,,,
Adam,110,0.51953125,train/reward_mean,,,,,,,,,,,,
Adam,111,0.51953125,train/reward_mean,,,,,,,,,,,,
Adam,112,0.62890625,train/reward_mean,,,,,,,,,,,,
Adam,113,0.671875,train/reward_mean,,,,,,,,,,,,
Adam,114,0.5390625,train/reward_mean,,,,,,,,,,,,
Adam,115,0.52734375,train/reward_mean,,,,,,,,,,,,
Adam,116,0.703125,train/reward_mean,,,,,,,,,,,,
Adam,117,0.6328125,train/reward_mean,,,,,,,,,,,,
Adam,118,0.6953125,train/reward_mean,,,,,,,,,,,,
Adam,119,0.62890625,train/reward_mean,,,,,,,,,,,,
Adam,120,0.55078125,train/reward_mean,,,,,,,,,,,,
Adam,121,0.44140625,train/reward_mean,,,,,,,,,,,,
Adam,122,0.609375,train/reward_mean,,,,,,,,,,,,
Adam,123,0.40234375,train/reward_mean,,,,,,,,,,,,
Adam,124,0.44140625,train/reward_mean,,,,,,,,,,,,
Adam,125,0.4921875,train/reward_mean,,,,,,,,,,,,
Adam,126,0.3359375,train/reward_mean,,,,,,,,,,,,
Adam,127,0.37890625,train/reward_mean,,,,,,,,,,,,
Adam,128,0.28515625,train/reward_mean,,,,,,,,,,,,
Adam,129,0.2890625,train/reward_mean,,,,,,,,,,,,
Adam,130,0.53515625,train/reward_mean,,,,,,,,,,,,
Adam,131,0.34765625,train/reward_mean,,,,,,,,,,,,
Adam,132,0.4375,train/reward_mean,,,,,,,,,,,,
Adam,133,0.421875,train/reward_mean,,,,,,,,,,,,
Adam,134,0.41796875,train/reward_mean,,,,,,,,,,,,
Adam,135,0.5,train/reward_mean,,,,,,,,,,,,
Adam,136,0.44921875,train/reward_mean,,,,,,,,,,,,
Adam,137,0.5,train/reward_mean,,,,,,,,,,,,
Adam,138,0.390625,train/reward_mean,,,,,,,,,,,,
Adam,139,0.546875,train/reward_mean,,,,,,,,,,,,
Adam,140,0.4375,train/reward_mean,,,,,,,,,,,,
Adam,141,0.66796875,train/reward_mean,,,,,,,,,,,,
Adam,142,0.41796875,train/reward_mean,,,,,,,,,,,,
Adam,143,0.3515625,train/reward_mean,,,,,,,,,,,,
Adam,144,0.48828125,train/reward_mean,,,,,,,,,,,,
Adam,145,0.421875,train/reward_mean,,,,,,,,,,,,
Adam,146,0.7734375,train/reward_mean,,,,,,,,,,,,
Adam,147,0.59375,train/reward_mean,,,,,,,,,,,,
Adam,148,0.5703125,train/reward_mean,,,,,,,,,,,,
Adam,149,0.44140625,train/reward_mean,,,,,,,,,,,,
Adam,150,0.3828125,train/reward_mean,,,,,,,,,,,,
Adam,151,0.56640625,train/reward_mean,,,,,,,,,,,,
Adam,152,0.6328125,train/reward_mean,,,,,,,,,,,,
Adam,153,0.58203125,train/reward_mean,,,,,,,,,,,,
Adam,154,0.62890625,train/reward_mean,,,,,,,,,,,,
Adam,155,0.58203125,train/reward_mean,,,,,,,,,,,,
Adam,156,0.375,train/reward_mean,,,,,,,,,,,,
Adam,157,0.5546875,train/reward_mean,,,,,,,,,,,,
Adam,158,0.546875,train/reward_mean,,,,,,,,,,,,
Adam,159,0.50390625,train/reward_mean,,,,,,,,,,,,
Adam,160,0.56640625,train/reward_mean,,,,,,,,,,,,
Adam,161,0.45703125,train/reward_mean,,,,,,,,,,,,
Adam,162,0.515625,train/reward_mean,,,,,,,,,,,,
Adam,163,0.53515625,train/reward_mean,,,,,,,,,,,,
Adam,164,0.5078125,train/reward_mean,,,,,,,,,,,,
Adam,165,0.65625,train/reward_mean,,,,,,,,,,,,
Adam,166,0.3984375,train/reward_mean,,,,,,,,,,,,
Adam,167,0.37109375,train/reward_mean,,,,,,,,,,,,
Adam,168,0.4765625,train/reward_mean,,,,,,,,,,,,
Adam,169,0.52734375,train/reward_mean,,,,,,,,,,,,
Adam,170,0.6171875,train/reward_mean,,,,,,,,,,,,
Adam,171,0.41796875,train/reward_mean,,,,,,,,,,,,
Adam,172,0.640625,train/reward_mean,,,,,,,,,,,,
Adam,173,0.6796875,train/reward_mean,,,,,,,,,,,,
Adam,174,0.546875,train/reward_mean,,,,,,,,,,,,
Adam,175,0.703125,train/reward_mean,,,,,,,,,,,,
Adam,176,0.5859375,train/reward_mean,,,,,,,,,,,,
Adam,177,0.45703125,train/reward_mean,,,,,,,,,,,,
Adam,178,0.3828125,train/reward_mean,,,,,,,,,,,,
Adam,179,0.54296875,train/reward_mean,,,,,,,,,,,,
Adam,180,0.51171875,train/reward_mean,,,,,,,,,,,,
Adam,181,0.62890625,train/reward_mean,,,,,,,,,,,,
Adam,182,0.453125,train/reward_mean,,,,,,,,,,,,
Adam,183,0.625,train/reward_mean,,,,,,,,,,,,
Adam,184,0.59765625,train/reward_mean,,,,,,,,,,,,
Adam,185,0.6015625,train/reward_mean,,,,,,,,,,,,
Adam,186,0.49609375,train/reward_mean,,,,,,,,,,,,
Adam,187,0.484375,train/reward_mean,,,,,,,,,,,,
Adam,188,0.484375,train/reward_mean,,,,,,,,,,,,
Adam,189,0.5859375,train/reward_mean,,,,,,,,,,,,
Adam,190,0.57421875,train/reward_mean,,,,,,,,,,,,
Adam,191,0.65234375,train/reward_mean,,,,,,,,,,,,
Adam,192,0.578125,train/reward_mean,,,,,,,,,,,,
Adam,193,0.59765625,train/reward_mean,,,,,,,,,,,,
Adam,194,0.57421875,train/reward_mean,,,,,,,,,,,,
Adam,195,0.72265625,train/reward_mean,,,,,,,,,,,,
Adam,196,0.50390625,train/reward_mean,,,,,,,,,,,,
Adam,197,0.48828125,train/reward_mean,,,,,,,,,,,,
Adam,198,0.5234375,train/reward_mean,,,,,,,,,,,,
Adam,199,0.53125,train/reward_mean,,,,,,,,,,,,
Adam,200,0.55859375,train/reward_mean,,,,,,,,,,,,
SGD + format reward,1,0.384765625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,2,0.43828125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,3,0.41015625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,4,0.36875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,5,0.388671875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,6,0.556640625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,7,0.374609375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,8,0.47578125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,9,0.42109375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,10,0.433203125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,11,0.158203125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,12,0.4234375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,13,0.4828125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,14,0.299609375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,15,0.70625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,16,0.533203125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,17,0.48828125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,18,0.678515625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,19,0.619140625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,20,0.35703125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,21,0.668359375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,22,0.5609375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,23,0.53671875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,24,0.513671875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,25,0.640625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,26,0.551171875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,27,0.7203125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,28,0.5328125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,29,0.63515625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,30,0.676953125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,31,0.619140625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,32,0.39765625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,33,0.619140625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,34,0.475,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,35,0.572265625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,36,0.7390625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,37,0.74140625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,38,0.67734375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,39,0.76875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,40,0.780859375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,41,0.62734375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,42,0.4859375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,43,0.669921875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,44,0.70546875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,45,0.559375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,46,0.64453125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,47,0.664453125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,48,0.6609375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,49,0.518359375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,50,0.631640625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,51,0.52578125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,52,0.520703125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,53,0.54453125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,54,0.755078125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,55,0.6359375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,56,0.4875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,57,0.625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,58,0.55,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,59,0.66640625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,60,0.788671875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,61,0.581640625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,62,0.659765625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,63,0.585546875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,64,0.646875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,65,0.708203125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,66,0.712890625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,67,0.57109375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,68,0.787109375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,69,0.641796875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,70,0.60546875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,71,0.660546875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,72,0.71328125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,73,0.612109375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,74,0.65859375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,75,0.72578125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,76,0.631640625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,77,0.655078125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,78,0.748046875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,79,0.705859375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,80,0.7828125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,81,0.7140625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,82,0.7390625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,83,0.627734375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,84,0.649609375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,85,0.59296875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,86,0.592578125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,87,0.65234375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,88,0.57109375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,89,0.44765625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,90,0.528125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,91,0.537109375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,92,0.616015625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,93,0.67890625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,94,0.68359375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,95,0.56015625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,96,0.618359375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,97,0.55078125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,98,0.591796875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,99,0.60390625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,100,0.64296875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,101,0.694140625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,102,0.628515625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,103,0.540234375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,104,0.63671875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,105,0.7484375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,106,0.56796875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,107,0.57890625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,108,0.690234375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,109,0.566015625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,110,0.56171875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,111,0.569921875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,112,0.635546875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,113,0.734375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,114,0.59765625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,115,0.4640625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,116,0.71875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,117,0.681640625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,118,0.7640625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,119,0.7234375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,120,0.57890625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,121,0.5796875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,122,0.641015625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,123,0.5328125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,124,0.4765625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,125,0.58046875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,126,0.365625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,127,0.453515625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,128,0.35390625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,129,0.45,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,130,0.597265625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,131,0.460546875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,132,0.4359375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,133,0.4765625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,134,0.49921875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,135,0.56484375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,136,0.457421875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,137,0.504296875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,138,0.45390625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,139,0.53125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,140,0.468359375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,141,0.691015625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,142,0.45625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,143,0.36484375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,144,0.528515625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,145,0.416796875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,146,0.825390625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,147,0.600390625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,148,0.6109375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,149,0.479296875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,150,0.37734375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,151,0.50078125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,152,0.577734375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,153,0.547265625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,154,0.609375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,155,0.5421875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,156,0.397265625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,157,0.440625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,158,0.550390625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,159,0.519921875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,160,0.557421875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,161,0.426953125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,162,0.452734375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,163,0.527734375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,164,0.475390625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,165,0.575390625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,166,0.444140625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,167,0.3734375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,168,0.4875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,169,0.320703125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,170,0.52265625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,171,0.416796875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,172,0.58984375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,173,0.60546875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,174,0.504296875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,175,0.634765625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,176,0.5671875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,177,0.509765625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,178,0.37578125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,179,0.49140625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,180,0.421875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,181,0.5421875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,182,0.405859375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,183,0.405859375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,184,0.468359375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,185,0.53125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,186,0.46484375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,187,0.501171875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,188,0.413671875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,189,0.43515625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,190,0.493359375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,191,0.52578125,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,192,0.55,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,193,0.56796875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,194,0.416796875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,195,0.4734375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,196,0.423046875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,197,0.48515625,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,198,0.51796875,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,199,0.480859375,rollout/raw_reward,,,,,,,,,,,,
SGD + format reward,200,0.515625,rollout/raw_reward,,,,,,,,,,,,