wilai-2.5 (draft)

This folder contains prepared artifacts for the wilai-2.5 release (development draft).

Contents:

• config.json (copied from v2.0, may be adjusted)
• tokenizer.json (canonical tokenizer copied from v2.0)
• pytorch_model.bin (converted or to-be-converted checkpoint for v2.5)

Notes:

• The v2 model uses a new modular layer SecretLayer and a SwiGLU MLP (see wilai_transformers/modeling_wilai_v2.py).
• This implementation is experimental and intended for testing. Do not publish publicly without review if you intend the SecretLayer to remain private.

How to test locally:

$env:PYTHONPATH='D:\GitHub\Ai-Thai-wilai'
python -c "from wilai_transformers.modeling_wilai_v2 import WilaiForCausalLMV2; print('import ok')"

When you're ready, I can upload this folder to Hugging Face as JonusNattapong/wilai-2.5 and include the converted checkpoint. If you want me to upload now, confirm and I'll push the prepared files to the new repo.