QuantLLM/functiongemma-270m-it-4bit-mlx
Text Generation
•
0.3B
•
Updated
•
55
QuantLLM
non-profit
AI & ML interests
QuantLLM is an open-source community exploring AI and ML through practical models and real-world applications.
Recent Activity
View all activity
Organization Card
QuantLLM | The Ultra-Fast LLM Quantization
Welcome to QuantLLM — an open-source community focused on building efficient and accessible AI models. This space hosts our quantized and fine-tuned transformer models, designed for real-world applications and ease of deployment.
models
9
QuantLLM/functiongemma-270m-it-4bit-gguf
0.3B
•
Updated
•
30
QuantLLM/functiongemma-270m-it-8bit-gguf
0.3B
•
Updated
•
37
•
1
QuantLLM/Llama-3.2-3B-2bit-gguf
3B
•
Updated
•
36
QuantLLM/Llama-3.2-3B-5bit-gguf
3B
•
Updated
•
34
QuantLLM/Llama-3.2-3B-5bit-mlx
Text Generation
•
3B
•
Updated
•
39
QuantLLM/Llama-3.2-3B-8bit-mlx
Text Generation
•
3B
•
Updated
•
32
QuantLLM/Llama-3.2-3B-2bit-mlx
Text Generation
•
3B
•
Updated
•
22
QuantLLM/Llama-3.2-3B-4bit-mlx
Text Generation
•
3B
•
Updated
•
15
datasets
0
None public yet