How to use lora-library/hu-tao-hat with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-2-1-base", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("lora-library/hu-tao-hat") prompt = "black hat, hat ornament, flower hat" image = pipe(prompt).images[0]
https://huggingface.co/lora-library/hu-tao-hat/resolve/main/test_images/image_1.png
hf download hf://lora-library/hu-tao-hat/test_images/image_1.png
curl -L -o image_1.png https://huggingface.co/lora-library/hu-tao-hat/resolve/main/test_images/image_1.png
