Cosmos
Diffusers
Safetensors
cosmos3_omni
nvidia
cosmos3
vllm
vllm-omni
sglang
sglang-diffusion
text, image, video, audio, and action generation
omnimodel
Instructions to use nvidia/Cosmos3-Nano-FP8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Cosmos
How to use nvidia/Cosmos3-Nano-FP8 with Cosmos:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Diffusers
How to use nvidia/Cosmos3-Nano-FP8 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("nvidia/Cosmos3-Nano-FP8", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Commit History
5 days ago
-
Update vLLM, SGLang and vLLM-Omni examples; refresh generated examples from FP8 (#7)
- Update vLLM, SGLang and vLLM-Omni examples; refresh generated examples from FP8 (2f29c6d2db0b1638fce7d238f433f1b5ecee815a) - Point Test Hardware to the Performance Benchmarking section (b32b545c401bbdb4b82747d1aa262b0a0a98fe19) - Cap huggingface_hub below 2 and note the Rust toolchain requirement for the SGLang editable install (2a81c9a5f72c3eb1d7f9a2e77805102ab0e7c916) - Drop the nonexistent [cli] extra from the huggingface_hub install lines (7ebd7ba651b47918c80c25c46cf76f980436d140) - Resolve README conflict by retaining main Test Hardware details (576bb359a29fd6f8e9b20b17897bcd19be0ae3ab) Co-authored-by: Wojciech Kutak <[email protected]>e2af96f
-
Add Cosmos3 Nano FP8 snapshot (#1)
- Track Nano FP8 tokenizer and example assets (738e02cba84a52df5b80719cb2374cb522e0efd5) - Add Cosmos3 Nano FP8 snapshot files (13a8e400db8843a7686d3ffee48fbe2f499b1de9) Co-authored-by: Wojciech Kutak <[email protected]>72bd99d