OpenLLM-France/Luciole-1B-Instruct-1.1-FP8

Luciole-1B-Instruct-1.1-FP8 is a FP8-quantized version of Luciole-1B-Instruct-1.1 in the transformers / compressed-tensors (https://github.com/neuralmagic/compressed-tensors) format, quantized with LLM Compressor (https://github.com/vllm-project/llm-compressor).

It is intended to be served with vLLM (https://github.com/vllm-project/vllm):

vllm serve OpenLLM-France/Luciole-1B-Instruct-1.1-FP8

FP8 acceleration requires a GPU with native FP8 support (NVIDIA Hopper, Ada Lovelace, or Blackwell).

License

Copyright (c) 2025-2026 LINAGORA SAS. Luciole-1B-Instruct-1.1-FP8 is developed by LINAGORA within the OpenLLM-France consortium (PROJET FRANCE2030 OpenLLM-France, funded by Bpifrance) and released under the Apache License 2.0.