Instructions to use Oysiyl/qwen3-0.6b-unslop-good-lora-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Oysiyl/qwen3-0.6b-unslop-good-lora-v1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Oysiyl/qwen3-0.6b-unslop-good-lora-v1") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Oysiyl/qwen3-0.6b-unslop-good-lora-v1") model = AutoModelForCausalLM.from_pretrained("Oysiyl/qwen3-0.6b-unslop-good-lora-v1", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Inference
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Oysiyl/qwen3-0.6b-unslop-good-lora-v1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Oysiyl/qwen3-0.6b-unslop-good-lora-v1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Oysiyl/qwen3-0.6b-unslop-good-lora-v1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Oysiyl/qwen3-0.6b-unslop-good-lora-v1
- SGLang
How to use Oysiyl/qwen3-0.6b-unslop-good-lora-v1 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Oysiyl/qwen3-0.6b-unslop-good-lora-v1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Oysiyl/qwen3-0.6b-unslop-good-lora-v1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Oysiyl/qwen3-0.6b-unslop-good-lora-v1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Oysiyl/qwen3-0.6b-unslop-good-lora-v1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Unsloth Desktop
- Docker Model Runner
How to use Oysiyl/qwen3-0.6b-unslop-good-lora-v1 with Docker Model Runner:
docker model run hf.co/Oysiyl/qwen3-0.6b-unslop-good-lora-v1
qwen3-0.6b-unslop-good-lora-v1
A small pilot fine-tune of Qwen3-0.6B for unslop rewriting: taking AI-sounding passages and attempting to rewrite them into cleaner, more natural prose while preserving meaning.
This is the weakest model in the current unslop pilot family and should be treated as a proof-of-behavior artifact, not a production-ready standalone model.
How it was trained
- Base model:
Qwen/Qwen3-0.6B - Training path: Unsloth 4-bit LoRA fine-tuning on Hugging Face Jobs
- Dataset:
N8Programs/unslop-good - Rows used: 1000 (full training split)
- Objective: conversational rewrite / style cleanup
Intended use
Use this model as a pipeline stage for:
- rewriting AI-sounding prose into more natural text
- reducing clichรฉ-heavy or overblown style
- experimenting with a compact unslopper before scaling to larger models
Limitations
- pilot-sized dataset
- very small model size (0.6B)
- may introduce local coherence issues on longer passages
- may overcompress content and drop details
- should be reviewed by a human or used as one stage in a larger editing pipeline
Example usage
from transformers import AutoTokenizer, AutoModelForCausalLM
repo = "Oysiyl/qwen3-0.6b-unslop-good-lora-v1"
messages = [
{"role": "user", "content": "Polish this AI passage to feel more human while preserving meaning:\n[TEXT HERE]"}
]
tokenizer = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(repo, device_map="auto")
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(text, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=512, temperature=0.8, repetition_penalty=1.1, do_sample=True)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
Training loss vs training progress
Training loss is shown on normalized training progress (0โ100%) for optimization visibility only. It helps show whether the run trained smoothly, but it is not by itself evidence of generalization or overfitting. Held-out rewrite fidelity remains the real decision metric.
Judgment
Too bad output.
Conclusion
Too bad output.
- Downloads last month
- 23
