Instructions to use google/gemma-4-12B-it-qat-q4_0-unquantized with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use google/gemma-4-12B-it-qat-q4_0-unquantized with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("google/gemma-4-12B-it-qat-q4_0-unquantized") model = AutoModelForMultimodalLM.from_pretrained("google/gemma-4-12B-it-qat-q4_0-unquantized", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update to canonical Gemma 4 chat template
#2
by lucianommartins - opened
This PR syncs the template with the canonical version of the base models.
MaartenGr changed pull request status to merged