Duplicate from mys/laya-multilingual-GGUF

Co-authored-by: M. Yusuf Sarıgöz <[email protected]>

.gitattributes

@@ -0,0 +1,38 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+laya_multilingual_f16.gguf filter=lfs diff=lfs merge=lfs -text
+laya_multilingual_q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+laya_multilingual_ud_q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,73 @@
+---
+license: apache-2.0
+base_model: convaiinnovations/laya-multilingual
+tags:
+  - ggmlc
+  - gguf
+  - laya
+  - jev
+  - mmbert
+  - multilingual
+  - decision
+  - system-1
+language:
+  - multilingual
+---
+
+# Laya Multilingual GGUF (ggmlc)
+
+**Multilingual System 1 decision model** compiled from [convaiinnovations/laya-multilingual](https://huggingface.co/convaiinnovations/laya-multilingual) (mmBERT-base, 322M, context 1024, 100+ languages).
+
+These files are **not** llama.cpp / `llama-cli` GGUFs. They are produced by **[ggmlc](https://github.com/monatis/ggmlc)**, a neural network compiler that lowers PyTorch, JAX, Flax, and Keras models to high-performance GGML execution. Loading them in llama.cpp will fail.
+
+Typed questions (`choice` / `score` / `noul`) are scored in **one encoder pass**. There is no autoregressive token generation.
+
+Source, CLI, and binaries: **[examples/laya](https://github.com/monatis/ggmlc/tree/main/examples/laya)**
+
+Other families: [laya-GGUF](https://huggingface.co/mys/laya-GGUF) (English) · [laya-typed-decisions-GGUF](https://huggingface.co/mys/laya-typed-decisions-GGUF)
+
+## Files
+
+| File | Quant | Size | Notes |
+| :--- | :--- | ---: | :--- |
+| `laya_multilingual_f16.gguf` | F16 | ~633 MB | Full precision. |
+| `laya_multilingual_q8_0.gguf` | Q8_0 | ~345 MB | Usually the best size / quality trade. |
+| `laya_multilingual_ud_q4_k_m.gguf` | UD_Q4_K_M | ~500 MB | Larger than Q8_0 here because embeddings stay F16. |
+
+Tokenizer is **Gemma BPE + Metaspace** (`▁`), specials `<bos>/<eos>/<pad>/<mask>` (ids 2/1/0/4), not ModernBERT `[CLS]/[SEP]/[MASK]`.
+
+```bash
+huggingface-cli download mys/laya-multilingual-GGUF laya_multilingual_f16.gguf --local-dir .
+```
+
+## Run with `laya`
+
+Download a binary from [ggmlc releases](https://github.com/monatis/ggmlc/releases/latest) (`laya.exe` / `laya`). `--device` defaults to `auto` (CUDA or Metal if present, else CPU).
+
+```bash
+laya help
+laya list-presets
+laya info laya_multilingual_f16.gguf
+
+laya decide laya_multilingual_f16.gguf --preset email --text "二重に請求されました" --device auto --cuda-graph
+laya decide laya_multilingual_f16.gguf --preset triage --text "Bitte erstatten Sie die doppelte Abbuchung." --json
+laya serve laya_multilingual_f16.gguf --port 8080 --device auto --cuda-graph
+laya bench laya_multilingual_f16.gguf --preset email --device auto --cuda-graph
+```
+
+Put English + multilingual GGUFs in one directory to route before the forward (non-Latin script → multilingual; otherwise English function-word count):
+
+```bash
+laya detect-lang --text "二重に請求されました"
+laya decide --models-dir . --preset email --text "二重に請求されました"
+```
+
+`serve` starts Decision Studio (`GET /`) and `POST /api/decide`. `daemon` is newline JSON-RPC on stdin/stdout.
+
+## What this is
+
+[Laya](https://github.com/NandhaKishorM/laya) is the open reproduction of TypeSafe **Jev**: given a *state* and typed questions, it returns calibrated probabilities instead of generating tokens. The English checkpoint stays confident while collapsing off English; use this family for non-English (or mixed) text.
+
+## License
+
+Apache 2.0, same as the upstream Laya weights. Compiler: [ggmlc](https://github.com/monatis/ggmlc) (MIT).

laya_multilingual_f16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5fdabb71480e6469e986d71d15dabe1dc7160fcdf4bc6e10bd3acc4f51ff4f71
+size 663262880

laya_multilingual_q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:757c1a4b1f0f41824113dde76d6cd06b0881d37b796103a338de77f9f9b935c3
+size 361712736

laya_multilingual_ud_q4_k_m.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7c0e47f3dfaf1242929d69e91afb8868fcc5ee78092e7784e1aa2ee85adc9840
+size 523916512