KaviarLabs/Gemma-4-26B-A4B-Heretic-PRISM-DQ-I

Gemma 4 26B A4B Heretic — PRISM-PRO-DQ Map Reapplication

Heretic finetune converted to GGUF using an unofficial PRISM-PRO-DQ tensor-map reapplication.

Important provenance notice

This is not an official PRISM-DQ or PRISM-PRO-DQ model. This repository is not affiliated with Ex0bit, PRISM-DQ, or the authors of the source finetune.

The underlying trained weights come from coder3101/gemma-4-26B-A4B-it-heretic. No trained tensor values from Ex0bit's PRISM model were copied, merged, or transplanted into this model.

The quantized file was produced by reconstructing the per-tensor GGML quantization-type assignment visible in the public Ex0bit/Gemma4-26B-A4B-PRISM-PRO-DQ-GGUF release and then applying that assignment to this separate finetune. This is therefore a map reapplication, not a reproduction of the original PRISM-DQ calibration, optimization procedure, dataset, or proprietary pipeline.

The Unsloth importance matrix imatrix_unsloth.gguf_file was used during quantization. Conversion and quantization were performed with llama.cpp.

Quantization layout

For the 658 tensors shared with the reference Gemma 4 PRISM-PRO-DQ GGUF, the final distribution is:

GGML type	Tensor count
F32	392
Q5_1	30
Q5_K	91
Q6_K	115
Q8_0	30

The language-model GGUF contains 658 tensors and matches the reconstructed reference type map without extra language-model tensors.

Files and integrity

File	Size	SHA-256	Purpose
Gemma-4-26B-A4B-Heretic-PRISM-DQ-I.gguf	16.85 GiB	f4bf630c758d6f439d94f10844412e7a66a1a76494d0938aea6c4e404e241ff3	Unofficial PRISM-PRO-DQ tensor-map reapplication with Unsloth I-matrix

Template and tokenizer

• The tokenizer vocabulary and special-token IDs were checked against the source Hugging Face tokenizer.
• The embedded chat template was updated to the current official template from google/gemma-4-26B-A4B-it at conversion time.

Usage with llama.cpp

llama-cli \
  -m Gemma-4-26B-A4B-Heretic-PRISM-DQ-I.gguf \
  --jinja \
  -p "Hello"

For server use:

llama-server \
  -m Gemma-4-26B-A4B-Heretic-PRISM-DQ-I.gguf \
  --jinja \
  --host 127.0.0.1 \
  --port 8080

References

1. Source finetune: coder3101/gemma-4-26B-A4B-it-heretic
2. Official Gemma 4 base: google/gemma-4-26B-A4B-it
3. PRISM-PRO-DQ public GGUF used only as the tensor-map reference: Ex0bit/Gemma4-26B-A4B-PRISM-PRO-DQ-GGUF
4. Unsloth importance matrix: imatrix_unsloth.gguf_file
5. GGUF conversion and quantization tooling: ggml-org/llama.cpp
6. Gemma Terms of Use: https://ai.google.dev/gemma/terms

License and responsibility

Use of this repository remains subject to the original source model's license and the Gemma Terms of Use. The behavior and safety characteristics of the source finetune are inherited; quantization does not make the model safer or change its intended-use restrictions. Users are responsible for evaluating outputs and complying with applicable laws and licenses.