Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrieval
Paper
•
2408.10613
•
Published
tDRO: Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrieval. Guangyuan Ma, Yongliang Ma, Xing Wu, Zhenpeng Su, Ming Zhou and Songlin Hu.
This is a fine-tuned baseline retriever with uniform sampling weights of tdro-llm/finetune_data. This model is also used as a reference model in tDRO.
Base model
Qwen/Qwen1.5-0.5B