---
base_model: THUDM/GLM-4-9B-0414
license: mit
language:
  - zh
  - en
pipeline_tag: text-generation
library_name: transformers
---

EXL2 quants of [GLM-4-9B-0414](https://huggingface.co/THUDM/GLM-4-9B-0414)

[4.5 bits per weight](https://huggingface.co/adriabama06/GLM-4-9B-0414-exl2/tree/4.5bpw)    
[6.0 bits per weight](https://huggingface.co/adriabama06/GLM-4-9B-0414-exl2/tree/6.0bpw)

| Model    | Size            |
|----------|-----------------|
| 4.5 bpw  | 6.32 GB         |
| 6.0 bpw  | 7.85 GB         |