Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

135

Base only

Active filters: kv-cache

ddddamn/IronCell-Mark-1

anthonym21/Mistral-7B-v0.3-CoDA-GQA-L

Text Generation • 7B • Updated Feb 24 • 18

fromthesky/PLDR-LLM-v51-SOC-110M-1

Text Generation • 0.1B • Updated Mar 26 • 159 • 1

fromthesky/PLDR-LLM-v51-SOC-110M-2

Text Generation • 0.1B • Updated Mar 26 • 19

fromthesky/PLDR-LLM-v51-SOC-110M-3

Text Generation • 0.1B • Updated Mar 26 • 16

fromthesky/PLDR-LLM-v51-SOC-110M-4

Text Generation • 0.1B • Updated Mar 26 • 22

fromthesky/PLDR-LLM-v51-SOC-110M-5

Text Generation • 0.1B • Updated Mar 26 • 22

ElvianElvy/MESA-Qwen2.5-0.5B-KL-Regularized

Text Generation • Updated Mar 12

chinedudave06/musicgen-small-onnx

Text-to-Audio • Updated Mar 18 • 21

chinedudave06/musicgen-small-stereo-onnx

Text-to-Audio • Updated Mar 18 • 20

chinedudave06/musicgen-medium-onnx

Text-to-Audio • Updated Mar 18 • 13

chinedudave06/musicgen-medium-stereo-onnx

Text-to-Audio • Updated Mar 18 • 13

aoiandroid/llama32-1b-kvcache-coreml

Updated Mar 19 • 9

Croc-Prog-HF/LoreWeaver-2-LoRA_PREVIEW

Text Generation • Updated 12 days ago

flovflo/turboquant-mlx-qwen35-kv

Updated Mar 25 • 18

alexcovo/qwen35-9b-mlx-turboquant-tq3

Text Generation • 9B • Updated Mar 30 • 162 • 4

NOT-OMEGA/NanoMind

Text Generation • Updated Apr 3

bmeyer2025/tiny-gpt-shakespeare

Text Generation • Updated Mar 31 • 20

eigengram/eigengram-protocol

adobeXd/nexus

Text Generation • Updated Apr 4 • 1

Engram-protocol/engram

Feature Extraction • Updated Apr 3

tonera/FLUX.2-klein-9b-kv-Nunchaku

Image-to-Image • 9B • Updated Jun 23 • 505 • 12

Funkylazer/dm-qwen3.5-27b-b1p-knowledgecorridor

Text Generation • 27B • Updated Apr 7 • 13

atomicmilkshake/llama-cpp-turboquant-binaries

Updated Apr 8 • 13

majentik/Qwen3.5-27B-TurboQuant-MLX-2bit

Text Generation • 27B • Updated about 1 month ago • 275

satya007/gemmacut-spectral

Text Generation • Updated Apr 13

EnsueAI/metal-int4-sdpa

Updated Apr 21 • 3 • 6

Reinforce-ai/spiral-qwen2.5-coder-7b

Text Generation • 8B • Updated Apr 22 • 47 • 1

MarkShark2/omnivoice-onnx-kv-b1-fp16

Text-to-Speech • Updated Apr 27 • 1

Alwahsh/Meta-Llama-3.1-8B-Instruct-Butler

Text Generation • 8B • Updated May 26 • 24