ICEPVP8977/Uncensored_Small_Reasoning
Viewer • Updated • 4.54k • 22 • 7
How to use vpakarinen/amd-instella-3b-lora-uncensored with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("amd/Instella-3B-Instruct")
model = PeftModel.from_pretrained(base_model, "vpakarinen/amd-instella-3b-lora-uncensored")Fine-tuned version of amd/Instella-3B-Instruct on the ICEPVP8977/Uncensored_Small_Test_Time_Compute dataset.
This LoRA will fully uncensor the Instella-3B-Instruct, use alpaca instruction template.
Base model
amd/Instella-3B-Instruct
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("amd/Instella-3B-Instruct") model = PeftModel.from_pretrained(base_model, "vpakarinen/amd-instella-3b-lora-uncensored")