How to use litert-community/Gemma3-1B-IT-Tensor-NPU with LiteRT-LM:
# LiteRT-LM runs on various platforms (Android, iOS, Windows, Linux, macOS, IoT, Web/WASM) # and supports many APIs (C++, Python, Kotlin, Swift, JavaScript, Flutter). # For platform-specific integration guides, please refer to the official developer website: # https://ai.google.dev/edge/litert-lm # To try LiteRT-LM, the easiest way is to use our CLI tool. # 1. Install the LiteRT-LM CLI tool: pip install -U litert-lm # 2. Download and run this model locally: # See: https://ai.google.dev/edge/litert-lm/cli # A single .litertlm file in the repo is picked automatically; otherwise the CLI asks which one to run # (or pass its name right after the repo id). litert-lm run \ --from-huggingface-repo=litert-community/Gemma3-1B-IT-Tensor-NPU \ --prompt="Write me a poem"
https://huggingface.co/litert-community/Gemma3-1B-IT-Tensor-NPU/resolve/4175f2d82f9f7c26a691b15015ed9a0090a196fe/MANIFEST.md
hf download hf://litert-community/Gemma3-1B-IT-Tensor-NPU@4175f2d82f9f7c26a691b15015ed9a0090a196fe/MANIFEST.md
curl -L -o MANIFEST.md https://huggingface.co/litert-community/Gemma3-1B-IT-Tensor-NPU/resolve/4175f2d82f9f7c26a691b15015ed9a0090a196fe/MANIFEST.md
Gemma3-1B-IT_int4hadamard_aot_ekv4096_G4.litertlm
1c2962c8b18ff600ab37a1b15dfcccd6d1e5d8c155ad1ea46fe5fd0ab50dd6ee
Verify after download:
sha256sum Gemma3-1B-IT_int4hadamard_aot_ekv4096_G4.litertlm
