--- license: gemma base_model: - Vortex5/G4-Moonlight-Dusk-26B-A4B-heretic - google/gemma-4-26B-A4B-it base_model_relation: quantized pipeline_tag: text-generation library_name: gguf language: - en - pt tags: - gemma-4 - gguf - llama.cpp - mixture-of-experts - quantized - unofficial - prism-pro-dq-map --- # Gemma 4 26B A4B Moonlight Dusk Heretic — PRISM-PRO-DQ Map Reapplication Moonlight Dusk Heretic finetune converted to GGUF and quantized with an unofficial reapplication of the PRISM-PRO-DQ per-tensor type map. ## Important provenance notice > **This is not an official PRISM-DQ or PRISM-PRO-DQ model.** This repository is not affiliated with Ex0bit, PRISM-DQ, or the authors of the source finetune. The underlying trained weights come from [Vortex5/G4-Moonlight-Dusk-26B-A4B-heretic](https://huggingface.co/Vortex5/G4-Moonlight-Dusk-26B-A4B-heretic). No trained tensor values from Ex0bit's PRISM model were copied, merged, or transplanted into this model. The quantized file was produced by reconstructing the **per-tensor GGML quantization-type assignment** visible in the public [`Ex0bit/Gemma4-26B-A4B-PRISM-PRO-DQ-GGUF`](https://huggingface.co/Ex0bit/Gemma4-26B-A4B-PRISM-PRO-DQ-GGUF) release and then applying that assignment to this separate finetune. This is therefore a **map reapplication**, not a reproduction of the original PRISM-DQ calibration, optimization procedure, dataset, or proprietary pipeline. The Unsloth importance matrix [`imatrix_unsloth.gguf_file`](https://huggingface.co/unsloth/gemma-4-26B-A4B-it-GGUF/blob/main/imatrix_unsloth.gguf_file) was used during quantization. Conversion and quantization were performed with [`llama.cpp`](https://github.com/ggml-org/llama.cpp). ## Quantization layout For the 658 tensors shared with the reference Gemma 4 PRISM-PRO-DQ GGUF, the final distribution is: | GGML type | Tensor count | |---|---:| | F32 | 392 | | Q5_1 | 30 | | Q5_K | 91 | | Q6_K | 115 | | Q8_0 | 30 | This source checkpoint contains a separate `output.weight`, resulting in 659 tensors. That tensor was preserved and stored as Q5_K rather than discarded or tied during conversion. ## Files and integrity | File | Size | SHA-256 | Purpose | |---|---:|---|---| | `Gemma-4-26B-A4B-Moonlight-Dusk-Heretic-PRISM-DQ-I.gguf` | 17.32 GiB | `7f556d9679961ddd25c2e51ed705e6152d8a395d97cdc013d7ada2fa8447ebc3` | Unofficial PRISM-PRO-DQ tensor-map reapplication with Unsloth I-matrix | ## Template and tokenizer - The tokenizer vocabulary and special-token IDs were checked against the source Hugging Face tokenizer. - The embedded chat template was updated to the current official template from [`google/gemma-4-26B-A4B-it`](https://huggingface.co/google/gemma-4-26B-A4B-it) at conversion time. ## Usage with llama.cpp ```bash llama-cli -m Gemma-4-26B-A4B-Moonlight-Dusk-Heretic-PRISM-DQ-I.gguf --jinja -p "Hello" ``` For server use: ```bash llama-server -m Gemma-4-26B-A4B-Moonlight-Dusk-Heretic-PRISM-DQ-I.gguf --jinja --host 127.0.0.1 --port 8080 ``` ## References 1. Source finetune: [Vortex5/G4-Moonlight-Dusk-26B-A4B-heretic](https://huggingface.co/Vortex5/G4-Moonlight-Dusk-26B-A4B-heretic) 2. Official Gemma 4 base: [`google/gemma-4-26B-A4B-it`](https://huggingface.co/google/gemma-4-26B-A4B-it) 3. PRISM-PRO-DQ public GGUF used only as the tensor-map reference: [`Ex0bit/Gemma4-26B-A4B-PRISM-PRO-DQ-GGUF`](https://huggingface.co/Ex0bit/Gemma4-26B-A4B-PRISM-PRO-DQ-GGUF) 4. Unsloth importance matrix: [`imatrix_unsloth.gguf_file`](https://huggingface.co/unsloth/gemma-4-26B-A4B-it-GGUF/blob/main/imatrix_unsloth.gguf_file) 5. GGUF conversion and quantization tooling: [`ggml-org/llama.cpp`](https://github.com/ggml-org/llama.cpp) 6. Gemma Terms of Use: https://ai.google.dev/gemma/terms ## License and responsibility Use of this repository remains subject to the original source model's license and the Gemma Terms of Use. The behavior and safety characteristics of the source finetune are inherited; quantization does not make the model safer or change its intended-use restrictions. Users are responsible for evaluating outputs and complying with applicable laws and licenses.