GGUF
conversational
How to use from
Lemonade
Pull the model
# Download Lemonade from https://lemonade-server.ai/
lemonade pull NexesQuants/Llama_3.x_70b_DoppelGutenberg-L3.3_abliterated_fusion-iMat-CQ-GGUF:Q5_0_E
Run and chat with the model
lemonade run user.Llama_3.x_70b_DoppelGutenberg-L3.3_abliterated_fusion-iMat-CQ-GGUF-Q5_0_E
List all available models
lemonade list
Quick Links
README.md exists but content is empty.
Downloads last month
16
GGUF
Model size
71B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

5-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for NexesQuants/Llama_3.x_70b_DoppelGutenberg-L3.3_abliterated_fusion-iMat-CQ-GGUF