Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

DavidAU
/
Qwen3.5-4B-Deckard-HERETIC-UNCENSORED-Thinking

Image-Text-to-Text
Transformers
Safetensors
English
Chinese
qwen3_5
unsloth
heretic
uncensored
abliterated
fine tune
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prosing
vivid writing
fiction
roleplaying
bfloat16
all use cases
conversational
Model card Files Files and versions
xet
Community
2

Instructions to use DavidAU/Qwen3.5-4B-Deckard-HERETIC-UNCENSORED-Thinking with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Transformers

    How to use DavidAU/Qwen3.5-4B-Deckard-HERETIC-UNCENSORED-Thinking with Transformers:

    # Use a pipeline as a high-level helper
    from transformers import pipeline
    
    pipe = pipeline("image-text-to-text", model="DavidAU/Qwen3.5-4B-Deckard-HERETIC-UNCENSORED-Thinking")
    messages = [
        {
            "role": "user",
            "content": [
                {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
                {"type": "text", "text": "What animal is on the candy?"}
            ]
        },
    ]
    pipe(text=messages)
    # pip install -U transformers accelerate
    # Load model directly
    from transformers import AutoProcessor, AutoModelForMultimodalLM
    
    processor = AutoProcessor.from_pretrained("DavidAU/Qwen3.5-4B-Deckard-HERETIC-UNCENSORED-Thinking")
    model = AutoModelForMultimodalLM.from_pretrained("DavidAU/Qwen3.5-4B-Deckard-HERETIC-UNCENSORED-Thinking", device_map="auto")
    messages = [
        {
            "role": "user",
            "content": [
                {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
                {"type": "text", "text": "What animal is on the candy?"}
            ]
        },
    ]
    inputs = processor.apply_chat_template(
    	messages,
    	add_generation_prompt=True,
    	tokenize=True,
    	return_dict=True,
    	return_tensors="pt",
    ).to(model.device)
    
    outputs = model.generate(**inputs, max_new_tokens=256)
    print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))
  • Notebooks
  • Google Colab
  • Kaggle
  • Local Apps Settings
  • vLLM

    How to use DavidAU/Qwen3.5-4B-Deckard-HERETIC-UNCENSORED-Thinking with vLLM:

    Install from pip and serve model
    # Install vLLM from pip:
    pip install vllm
    # Start the vLLM server:
    vllm serve "DavidAU/Qwen3.5-4B-Deckard-HERETIC-UNCENSORED-Thinking"
    # Call the server using curl (OpenAI-compatible API):
    curl -X POST "http://localhost:8000/v1/chat/completions" \
    	-H "Content-Type: application/json" \
    	--data '{
    		"model": "DavidAU/Qwen3.5-4B-Deckard-HERETIC-UNCENSORED-Thinking",
    		"messages": [
    			{
    				"role": "user",
    				"content": [
    					{
    						"type": "text",
    						"text": "Describe this image in one sentence."
    					},
    					{
    						"type": "image_url",
    						"image_url": {
    							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
    						}
    					}
    				]
    			}
    		]
    	}'
    Use Docker
    docker model run hf.co/DavidAU/Qwen3.5-4B-Deckard-HERETIC-UNCENSORED-Thinking
  • SGLang

    How to use DavidAU/Qwen3.5-4B-Deckard-HERETIC-UNCENSORED-Thinking with SGLang:

    Install from pip and serve model
    # Install SGLang from pip:
    pip install sglang
    # Start the SGLang server:
    python3 -m sglang.launch_server \
        --model-path "DavidAU/Qwen3.5-4B-Deckard-HERETIC-UNCENSORED-Thinking" \
        --host 0.0.0.0 \
        --port 30000
    # Call the server using curl (OpenAI-compatible API):
    curl -X POST "http://localhost:30000/v1/chat/completions" \
    	-H "Content-Type: application/json" \
    	--data '{
    		"model": "DavidAU/Qwen3.5-4B-Deckard-HERETIC-UNCENSORED-Thinking",
    		"messages": [
    			{
    				"role": "user",
    				"content": [
    					{
    						"type": "text",
    						"text": "Describe this image in one sentence."
    					},
    					{
    						"type": "image_url",
    						"image_url": {
    							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
    						}
    					}
    				]
    			}
    		]
    	}'
    Use Docker images
    docker run --gpus all \
        --shm-size 32g \
        -p 30000:30000 \
        -v ~/.cache/huggingface:/root/.cache/huggingface \
        --env "HF_TOKEN=<secret>" \
        --ipc=host \
        lmsysorg/sglang:latest \
        python3 -m sglang.launch_server \
            --model-path "DavidAU/Qwen3.5-4B-Deckard-HERETIC-UNCENSORED-Thinking" \
            --host 0.0.0.0 \
            --port 30000
    # Call the server using curl (OpenAI-compatible API):
    curl -X POST "http://localhost:30000/v1/chat/completions" \
    	-H "Content-Type: application/json" \
    	--data '{
    		"model": "DavidAU/Qwen3.5-4B-Deckard-HERETIC-UNCENSORED-Thinking",
    		"messages": [
    			{
    				"role": "user",
    				"content": [
    					{
    						"type": "text",
    						"text": "Describe this image in one sentence."
    					},
    					{
    						"type": "image_url",
    						"image_url": {
    							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
    						}
    					}
    				]
    			}
    		]
    	}'
  • Unsloth Desktop
  • Docker Model Runner

    How to use DavidAU/Qwen3.5-4B-Deckard-HERETIC-UNCENSORED-Thinking with Docker Model Runner:

    docker model run hf.co/DavidAU/Qwen3.5-4B-Deckard-HERETIC-UNCENSORED-Thinking
Qwen3.5-4B-Deckard-HERETIC-UNCENSORED-Thinking
9.11 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 11 commits
DavidAU's picture
DavidAU
Update README.md
b0d6e0e verified 8 days ago
  • .gitattributes
    1.57 kB
    Upload folder using huggingface_hub 8 months ago
  • README.md
    134 kB
    Update README.md 8 days ago
  • chat_template.jinja
    7.76 kB
    Upload folder using huggingface_hub 8 months ago
  • config.json
    2.82 kB
    Upload folder using huggingface_hub 8 months ago
  • generation_config.json
    115 Bytes
    Upload folder using huggingface_hub 8 months ago
  • model-00001-of-00002.safetensors
    4.97 GB
    xet
    Upload folder using huggingface_hub 8 months ago
  • model-00002-of-00002.safetensors
    4.11 GB
    xet
    Upload folder using huggingface_hub 8 months ago
  • model.safetensors.index.json
    66.2 kB
    Upload folder using huggingface_hub 8 months ago
  • preprocessor_config.json
    390 Bytes
    Upload folder using huggingface_hub 8 months ago
  • processor_config.json
    1.3 kB
    Upload folder using huggingface_hub 8 months ago
  • tokenizer.json
    20 MB
    xet
    Upload folder using huggingface_hub 8 months ago
  • tokenizer_config.json
    8.69 kB
    Upload folder using huggingface_hub 8 months ago
  • video_preprocessor_config.json
    385 Bytes
    Upload folder using huggingface_hub 8 months ago
  • vocab.json
    6.72 MB
    Upload folder using huggingface_hub 8 months ago