TEMA Qwen2.5-Omni-7B SFT

Paper: arXiv:2609.30029

Qwen2.5-Omni-7B after temporal initialization and dialogue SFT on 40,704 dialogues (198,195 turns, 848 updates). The model answers multi-turn, multi-audio questions with Route, Span, Reason, and Answer.

Task definitions

TEMA-Dialog and TEMA-Bench cover five task families and 18 subtasks. See the 18-subtask guide for definitions, example questions and answers, evidence requirements, and internal task labels.

TEMA-Bench results

253 dialogues / 1,239 questions, using model-generated history. Values are percentages.

QA	QA+T	Span [email protected]	[email protected]
68.93	58.27	52.30	42.78

Evaluation uses Qwen/Qwen2.5-Omni-7B + this repository's adapter/.

Use

The repository includes merged model weights and the training adapter. Load merged weights with Qwen2_5OmniForConditionalGeneration.from_pretrained(...) and the included processor; set return_audio=False for text responses. To use adapter/, load it on Qwen/Qwen2.5-Omni-7B.

Inference commands · Training · Dataset