damerajee
/

Tinyllama-sft-small

Text Generation

Model card Files Files and versions

damerajee commited on Jan 10, 2024

Commit

4251a6c

·

1 Parent(s): 644c753

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -34,9 +34,9 @@ from peft import PeftModel, PeftConfig
 from transformers import AutoModelForCausalLM ,AutoTokenizer
 config = PeftConfig.from_pretrained("damerajee/Tinyllama-sft-small")
-model = AutoModelForCausalLM.from_pretrained("unsloth/tinyllama-bnb-4bit")
 tokenizer=AutoTokenizer.from_pretrained("damerajee/Tinyllama-sft-small")
-model = PeftModel.from_pretrained(model, "damerajee/Tinyllama-sft-small")
 ```
 ### Inference

 from transformers import AutoModelForCausalLM ,AutoTokenizer
 config = PeftConfig.from_pretrained("damerajee/Tinyllama-sft-small")
+model = AutoModelForCausalLM.from_pretrained("unsloth/tinyllama")
 tokenizer=AutoTokenizer.from_pretrained("damerajee/Tinyllama-sft-small")
+model = PeftModel.from_pretrained(model, "damerajee/Tinyllama-sft-small")l")
 ```
 ### Inference