Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

7,324

Base only

Active filters: GGUF

andrijdavid/CatPPT-base-GGUF

Text Generation • 7B • Updated Dec 27, 2023 • 301 • 1

andrijdavid/LMCocktail-10.7B-v1-GGUF

Text Generation • 11B • Updated Dec 27, 2023 • 213 • 1

andrijdavid/Sakura-SOLAR-Instruct-GGUF

Text Generation • 11B • Updated Dec 28, 2023 • 144 • 1

tsunemoto/TinyLlama-1.1B-Chat-v0.6-x8-MoE-GGUF

6B • Updated Dec 29, 2023 • 412 • 6

mozilla-ai/TinyLlama-1.1B-Chat-v1.0-llamafile

Updated Jan 6, 2025 • 19.2k • 16

andrijdavid/CarbonVillain-en-10.7B-v2-GGUF

Text Generation • 11B • Updated Jan 1, 2024 • 291

andrijdavid/StopCarbon-10.7B-v5-GGUF

Text Generation • 11B • Updated Jan 1, 2024 • 315 • 1

LiteLLMs/CarbonVillain-en-10.7B-v3-GGUF

Text Generation • 11B • Updated Jan 1, 2024 • 340

yargpt/vicuna-13b-v1.5-gguf

Text Generation • 13B • Updated Jan 2, 2024 • 17 • 1

andrijdavid/TinyLlama-1.1B-Chat-v1.0-GGUF

Text Generation • 1B • Updated Jan 19, 2024 • 1.15k • 2

andrijdavid/finance-chat-GGUF

Text Generation • 7B • Updated Jan 19, 2024 • 580 • 4

andrijdavid/TinyLlama-1.1B-32k-GGUF

Text Generation • 1B • Updated Jan 2, 2024 • 206

andrijdavid/MobileLLaMA-1.4B-Base-GGUF

Text Generation • 1B • Updated Jan 2, 2024 • 788 • 3

andrijdavid/tinyfrank-1.4B-GGUF

Text Generation • 1B • Updated Jan 2, 2024 • 195

andrijdavid/MiniMA-2-3B-GGUF

Text Generation • 3B • Updated Jan 2, 2024 • 301

Trelis/Tiny

Text Generation • 1B • Updated Feb 22, 2024 • 7

tsunemoto/FlatDolphinMaid-8x7B-GGUF

47B • Updated Jan 4, 2024 • 339

rabil/TinyLlama-1.1B-Chat-v1.0-llamafile

Updated Jan 4, 2024 • 52

tsunemoto/Norobara-ZLoss-8x7B-GGUF

47B • Updated Jan 5, 2024 • 406

rabil/deepseek-coder-6.7b-instruct-llamafile

Updated Jan 5, 2024 • 23 • 3

rabil/dolphin-2_6-phi-2-llamafile

Updated Jan 7, 2024 • 42

tsunemoto/LiteLlama-460M-1T-GGUF

0.5B • Updated Jan 7, 2024 • 500 • 6

rabil/openchat-3.5-0106-llamafile

Updated Jan 11, 2024 • 9

tuantran1632001/Psyfighter2-Orca2-13B-ties-GGUF

13B • Updated Jan 12, 2024 • 842

sethuiyer/MedleyMD-GGUF

13B • Updated Jan 15, 2024 • 44 • 1

tsunemoto/NexoNimbus-7B-GGUF

7B • Updated Jan 15, 2024 • 143 • 1

tsunemoto/Heimer-kto-TinyLlama-1.1B-GGUF

1B • Updated Jan 15, 2024 • 502

tsunemoto/Heimer-ipo-TinyLlama-1.1B-GGUF

1B • Updated Jan 15, 2024 • 433

tsunemoto/Heimer-dpo-TinyLlama-1.1B-GGUF

1B • Updated Jan 15, 2024 • 435

vicgalle/solarized-18B-dpo-GGUF

18B • Updated Jan 20, 2024 • 123 • 3