serialhex/gemma4-12b-biblical-gguf

An AI that reads the whole passage before it talks

This is the GGUF build — quantized (Q4_K_M), made to run on your own machine with llama.cpp or Ollama. No GPU required, no cloud, no account, your hardest spiritual questions never leave your laptop. For the full-precision adapter, see gemma4-12b-biblical-qlora.

Ask a general-purpose chatbot a real theology question — "why does God let bad things happen," "did Paul really mean that," "is this verse about me or about Israel" — and you get one of two failure modes: a confident answer built on a single verse yanked out of its chapter, or three paragraphs of hedging that never actually engages the question. Neither helps you think.

This is a QLoRA fine-tune of Gemma 4 12B trained specifically not to do that. Every answer is built from reading the full pericope — the passage, the argument, the narrated scene — not an isolated verse. When the Bible genuinely holds something in tension (grace and real human response, sovereignty and freedom), the model is trained to hold it too, instead of flattening it into whichever half is easier to state. And where Christians have historically disagreed for real reasons, it says so and shows you the shape of the disagreement instead of picking a side and pretending it was never contested.

You don't need to be a seminarian for this to be useful. If you've ever had a question about a Bible passage and gotten either a Sunday-school one-liner or an answer that clearly didn't read past the one verse you quoted — that's the gap this is trying to close.

What's actually different about it

• Reads at the passage level, not the verse level. Context (who's speaking, to whom, what comes before and after) does real work in every answer, not just as a disclaimer at the end.
• Shows its reasoning. Every answer carries a think trace — the actual chain of "here's what the text says, here's what that rules out, here's the conclusion" — so you can check why, not just read a verdict.
• Doesn't dodge the hard, genuinely contested questions. Predestination, the nature of grace, sacramental theology — where real, informed Christians have disagreed across history, the model engages the disagreement instead of silently picking a denomination's answer or refusing to engage.
• Built on sources you can go check yourself. Training data is drawn from the public-domain World English Bible, the early creeds, the Didache, patristic writings, and classical logic/philosophy texts — not a black box. The dataset is CC0 and public.

The Grug-Think variant: same answers, way fewer tokens

There's also a Grug-Think edition of this GGUF, and its whole reason for existing is speed. The base model's reasoning traces are essay-shaped: "Let me consider the context... First, I'll note that..." — that's a lot of tokens generated (and waited on) before you get to an actual answer. Grug-Think runs every training trace through a rewrite pass targeting short, dense, declarative reasoning — same hypothesis-and-check, same conclusion, filler banned — so the model learns to think in way fewer tokens for the identical output quality. Fewer tokens generated per answer means faster responses, full stop. Same questions, same answers, same sources as this model — only the think field in training changed. On CPU inference especially, this is the one you want.

Pair it with retrieval for real gains

This model was trained to reason well over a passage once it has one in front of it — it was not trained as a Bible-memorization engine, and a base LLM's recall of exact wording and cross-references degrades the way any LLM's does. You will get noticeably better, more precise answers if you put it behind even a simple RAG setup: grep/embed the relevant chapter(s) for the user's question and inject the actual verse text into context before the model answers, rather than relying on it to recall the passage from training alone. Retrieval does the remembering; the model does the reading and the reasoning — that split is where this model is strongest.

Quick start

# llama.cpp
llama-cli -hf serialhex/gemma4-12b-biblical-gguf -p "Did Paul mean 'all have sinned' literally, or is Romans 3 making a narrower argument?"

# or with Ollama
ollama run hf.co/serialhex/gemma4-12b-biblical-gguf

The family

Model	What it is
gemma4-12b-biblical-qlora	Full-size Gemma 4 12B fine-tune
gemma4-12b-biblical-gguf	This model — Q4_K_M quantized, runs on a laptop
gemma4-12b-biblical-qlora-gt	Grug-Think reasoning (full-size)
gemma4-12b-biblical-gguf-gt	Grug-Think reasoning, quantized
gemma4-26b-biblical-qlora	Bigger base model (Gemma 4 26B-A4B, mixture-of-experts)
gemma4-26b-biblical-qlora-gt	26B, Grug-Think reasoning
gemma4-26b-biblical-gguf-gt	26B, Grug-Think, quantized

Known limitations

• This is a LoRA fine-tune on top of a general instruction model, not a theologian. It will be wrong sometimes. Verify anything load-bearing against the sources it cites.
• Training data skews toward Protestant evangelical framing in places even where it tries to represent other traditions fairly — spot-check before treating it as neutral across traditions.
• It is not a substitute for a pastor, a priest, a rabbi, or a therapist.

Quantization

Q4_K_M, converted from the merged full-precision model via llama.cpp's convert_hf_to_gguf.py and llama-quantize.