Instructions to use evilfreelancer/saiga_mistral_7b_128k_lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use evilfreelancer/saiga_mistral_7b_128k_lora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("NousResearch/Yarn-Mistral-7b-128k") model = PeftModel.from_pretrained(base_model, "evilfreelancer/saiga_mistral_7b_128k_lora") - Notebooks
- Google Colab
- Kaggle
| { | |
| "system_prompt": "Ты — Сайга, русскоязычный автоматический ассистент. Ты разговариваешь с людьми и помогаешь им.", | |
| "system_message_template": "<s>{role}\n{content}</s>\n", | |
| "user_message_template": "<s>{role}\n{content}</s>\n", | |
| "bot_message_template": "<s>{role}\n{content}</s>\n", | |
| "user_role": "user", | |
| "bot_role": "bot", | |
| "system_role": "system", | |
| "suffix": "<s>bot" | |
| } | |