Configuration Parsing Warning:In config.json: "quantization_config.bits" must be an integer

Jackrong / Qwopus3.6-27B-v2

QUANTIZED BY: UnstableLlama

Information

exl3 quantizations of Jackrong's Qwopus3.6-27B-v2 via exllamav3.
repo generated automatically with ezexl3.

Repo Data

REVISION	GiB	KL DIV	PPL
3.08bpw	12.90	0.0340	6.9926
4.15bpw	15.93	0.0102	6.9347
6.00bpw	21.17	0.0014	6.8837
bf16	51.75	0.0000	6.8680

SVG Catbench

3.08 bpw

4.15 bpw

6.00 bpw

CLI Download

hf download UnstableLlama/Qwopus3.6-27B-v2-exl3-4.15bpw --local-dir ./Qwopus3.6-27B-v2-exl3-4.15bpw

Safetensors

Model size

9B params

Tensor type

BF16

F16

I16

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for UnstableLlama/Qwopus3.6-27B-v2-exl3-4.15bpw

Base model

Quantized

(59)

this model