YAML Metadata Error:Invalid content in Eval Result file .eval_results/swe-marathon-v1.1.yaml

Check out the documentation for more information.

Show details
Task ID "swe_marathon_v1_1" does not match any task in dataset "rdesai2/swe-marathon". Available: none
VeriLoop-E2 / .eval_results /swe-marathon-v1.1.yaml
ConorWang's picture
Add SWE-Marathon v1.1 evaluation result
9379d19 verified
Raw History Blame Contribute Delete
380 Bytes
- dataset:
id: rdesai2/swe-marathon
task_id: swe_marathon_v1_1
value: 45.0
source:
url: https://huggingface.co/datasets/tsinghua-sigs-robot-lab/VeriLoop-E2-Evaluation-Evidence/tree/main/swe-marathon-v1.1
name: VeriLoop E2 evaluation evidence
user: tsinghua-sigs-robot-lab
notes: "20 tasks × 8 trials; 72/160 passing trials; 45.0% frozen release score."