Publish paired evaluation, loader and quantization recipe

LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2025 Resemble AI
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

README.md

@@ -0,0 +1,70 @@
+---
+library_name: mlx-audio
+license: mit
+base_model: mlx-community/chatterbox-multilingual-v3
+base_model_relation: quantized
+pipeline_tag: text-to-speech
+language: ["ar", "da", "de", "el", "en", "es", "fi", "fr", "he", "hi", "it", "ja", "ko", "ms", "nl", "no", "pl", "pt", "ru", "sv", "sw", "tr", "zh"]
+tags: [mlx, chatterbox, multilingual, text-to-speech, voice-cloning, 8-bit, affine, omlx]
+---
+
+# Chatterbox Multilingual MLX Q8 G64
+
+Native MLX affine 8-bit, group-64 quantization of [mlx-community/chatterbox-multilingual-v3](https://huggingface.co/mlx-community/chatterbox-multilingual-v3), from its original FP32 weights. The main checkpoint is **877.79 MB**, versus **2,711.11 MB** for FP32. This model uses a user-provided reference recording; it contains no Valentina or other private voice recording or conditioning.
+
+**651 compatible main matrices** are stored as Q8. The included loader also converts **37 compatible external S3Tokenizer matrices** to Q8 at load time, for **688 Q8 matrices in execution**. Unsupported tensors keep original FP32. The external [S3TokenizerV2](https://huggingface.co/mlx-community/S3TokenizerV2) remains a separate approximately 494.87 MB download/cache; its on-disk weights are not replaced. Loading through the standard mlx-audio loader quantizes only the main checkpoint; use **load_q8.py** to reproduce the evaluated full configuration.
+
+## Evaluation
+
+[Read the full FP32 comparison report](evaluation/REPORT.md). On the documented MacBook Air M5 run with six English/Spanish prompts and two seeds, Q8 used 53.2% less process peak RSS and 51.7% less peak MLX memory, with 28.7% shorter mean generation time. Strict Parakeet WER was 7.33% FP32 versus 6.67% Q8; the difference was a single edit and does not establish improved speech quality. No perceptual naturalness/voice-similarity score is claimed. The report includes exact hashes, seeds, parameters, transcripts, resource and power limitations.
+
+## Usage on Apple Silicon
+
+Tested with mlx-audio 0.5.7 and MLX 0.32.3. Inference uses mlx-audio/Metal. oMLX supplied the original packing primitive; the oMLX serving runtime is not required.
+
+```bash
+pip install -r requirements.txt
+```
+
+```python
+import sys
+from pathlib import Path
+from huggingface_hub import snapshot_download
+import mlx.core as mx
+import numpy as np
+import soundfile as sf
+
+folder = Path(snapshot_download("groxaxo/chatterbox-multilingual-MLX-Q8-G64"))
+sys.path.insert(0, str(folder))
+from load_q8 import load_model
+
+model = load_model(folder)
+conds = model.prepare_conditionals("your-reference.wav", 24000, 0.5)
+mx.random.seed(42)
+results = list(model.generate(
+    "Hola, esta es una prueba de voz.", conds=conds, lang_code="es",
+    exaggeration=0.5, cfg_weight=0.5, temperature=0.8,
+    repetition_penalty=1.2, min_p=0.05, top_p=0.95,
+    max_new_tokens=400, verbose=False,
+))
+mx.eval(*[r.audio for r in results])
+mx.synchronize()
+audio = np.concatenate([np.asarray(r.audio).reshape(-1) for r in results])
+sf.write("output.wav", audio, 24000)
+```
+
+Use `lang_code="en"` for English. First use fetches the separate S3Tokenizer dependency unless it is already cached. Set offline mode only after both model and dependency are cached. Use reference audio you have permission to use.
+
+## Provenance and license
+
+Source revision: `03565773edd72e949572557597af8063bb49a18a`. External tokenizer revision tested: `e0c9886f0e1c35ae85b1f27277416fb19fc72bec`. Source and quantized hashes are in [evaluation/weight-validation.json](evaluation/weight-validation.json). 1,836 untouched tensors were verified byte-identical to the baseline. The [MIT license](LICENSE) and upstream Resemble AI attribution are retained. This is an unofficial quantization, without fine-tuning, LoRA or voice adaptation baked into the checkpoint.
+
+## Rebuild the packed matrices
+
+`quantize_q8.py` uses native MLX affine Q8 with the published per-matrix policy. Run it against the pinned FP32 source into a new directory:
+
+```bash
+python quantize_q8.py --source /path/to/fp32 --out ./rebuilt-q8
+```
+
+The original artifact used oMLX for packing, not calibrated oQ importance weighting. Rebuild with the tested MLX version; serialized file hashes can depend on serialization and library versions.

SHA256SUMS.json

@@ -0,0 +1,90 @@
+{
+  "model.safetensors": {
+    "bytes": 877793962,
+    "sha256": "aa938735e36edfa807531d274baa608ec168f8f06ad6c835a3c4071effcf172e"
+  },
+  "LICENSE": {
+    "bytes": 1067,
+    "sha256": "4248e910a928849fe5815a0f9236e17fa07768d95b9193212752c464b93d6caa"
+  },
+  "requirements.txt": {
+    "bytes": 84,
+    "sha256": "419d7e39848b9c08609a079b21cadd00f8220b536a299a2d614772ed2dc57328"
+  },
+  "config.json": {
+    "bytes": 137850,
+    "sha256": "f81cf5cb5f7e8b6ed4a6d8d341a10aef863706d61d658e059622ae947b12ea49"
+  },
+  "load_q8.py": {
+    "bytes": 926,
+    "sha256": "8c976e357b573d8940d0ff54fb0fa7e4b16804e762ba98de69e15013a1acbcff"
+  },
+  "tokenizer.json": {
+    "bytes": 69989,
+    "sha256": "69632f47220a788a52ce2661d096453c5655e9bf25289d89a8d832c46ee07dbf"
+  },
+  "README.md": {
+    "bytes": 4232,
+    "sha256": "39a5d756686d52481a5b89cf77129f4b34111b8e3a016c7f8d29f56c0a5dc896"
+  },
+  "Cangjie5_TC.json": {
+    "bytes": 1920163,
+    "sha256": "7073fd9de919443ae88e0bd2449917a65fe54898a4413ed1edcc4b67f28bce8c"
+  },
+  "quantize_q8.py": {
+    "bytes": 1427,
+    "sha256": "ca0a3bd5101d41d6363e4259e3e112401f5fffbdb705c7173c9e3d3b97004939"
+  },
+  "evaluation/asr-health.json": {
+    "bytes": 363,
+    "sha256": "a5a8069fcb1031b0f2b4d4611f75fd23f1fd3c6dcb4794e4332132d53afe63c3"
+  },
+  "evaluation/asr-versions.json": {
+    "bytes": 74,
+    "sha256": "4025b2c293b3ed70b821ab0f92ca5a128b755c18adc1e51901523a87adb36ffe"
+  },
+  "evaluation/benchmark.py": {
+    "bytes": 3910,
+    "sha256": "0eb6842a1e6c5aa0c8a462975c8b73afc0a6dd78fd676f03a07cf59ae5bc75bf"
+  },
+  "evaluation/REPORT.md": {
+    "bytes": 10607,
+    "sha256": "5e2b2ec672e6d908d7d106c7c10ce20e4f6b52b74ab4979952f85c1d5fa19fbb"
+  },
+  "evaluation/power-samples.json": {
+    "bytes": 14289,
+    "sha256": "08aecec8c942be5da8d28f6723f56cc727f79f721725ae1fca8e5de171440d3f"
+  },
+  "evaluation/fp32-results.json": {
+    "bytes": 9633,
+    "sha256": "0483d88aff53f367daff158ccc8e6aa5315f5da5a678d9c2f9bc609ddbfa10c2"
+  },
+  "evaluation/results.json": {
+    "bytes": 32424,
+    "sha256": "a02f0bdf1c9c2dbbabb1adba106b9c9a9cc4bcb1c00f3241a38b4ac04fcf4d9d"
+  },
+  "evaluation/q8-results.json": {
+    "bytes": 96041,
+    "sha256": "0ab91348019edc2f1b8b39a8c3d20525f455b67749989c987ed050bb3f543c37"
+  },
+  "evaluation/weight-validation.json": {
+    "bytes": 979,
+    "sha256": "e33832ab376bfb6b665b7f7dbb9b61de60d2f5a5b7dd684a4860b894e3674f59"
+  },
+  "evaluation/rebuild-validation.json": {
+    "bytes": 384,
+    "sha256": "c33eabadacb4e77fa88e322d55be5d7d3c0323552f1c00d54cc515372e25ee3f"
+  },
+  "evaluation/score_audio.py": {
+    "bytes": 1423,
+    "sha256": "a860456c1a8d94b8f7c381686b067d46143f226a39a497bb1656f58aee307d36"
+  },
+  "evaluation/upstream.json": {
+    "bytes": 1499,
+    "sha256": "f53cea6d7c156b47b06b051debb7d0240fcdda83b2dc9c754dc74aef926a39fa"
+  },
+  "evaluation/results.csv": {
+    "bytes": 10688,
+    "sha256": "334039349d24eb03e2f34d25c7445c301bcce5e38ca49d894bfcd6eb132469b4"
+  }
+}

evaluation/REPORT.md

@@ -0,0 +1,86 @@
+# Chatterbox Multilingual MLX Q8 versus FP32
+
+Measured 9 October 2026 on a MacBook Air M5 (Mac17,4), 24 GiB unified memory, macOS build 25G76. This report evaluates the published Q8 artifact against its exact FP32 source, using the same private reference voice, prompts, seeds, runtime and decoding settings. Reference and generated voice recordings are not part of this publication.
+
+## Findings
+
+The main checkpoint is **67.6% smaller**. On this 12-pair short-prompt run, Q8 reduced mean generation time by **28.7%**, process peak RSS by **53.2%**, and peak MLX allocation by **51.7%**. These are observations from one desktop run, not population-level performance guarantees.
+
+| Measurement | Original FP32 | Q8 affine G64 |
+|---|---:|---:|
+| Main checkpoint size, decimal MB | 2711.11 | 877.79 |
+| Model load, s | 0.674 | 0.547 |
+| Reference conditioning, s | 0.131 | 0.131 |
+| Separate warm-up generation, s | 2.415 | 1.721 |
+| Mean warm generation per clip, s | 3.701 | 2.639 |
+| Mean generated audio length, s | 3.553 | 3.633 |
+| Aggregate real-time factor | 1.042 | 0.726 |
+| Process peak RSS over load and generation, GiB | 3.227 | 1.511 |
+| Maximum per-generation MLX peak, GiB | 4.197 | 2.029 |
+| Mean process CPU, % of one core | 25.0 | 31.4 |
+| Whole-chip CPU+GPU+ANE power during sampled generation, W | 6.149 | 7.791 |
+| Sampled chip energy during generation, J | 270.31 | 244.51 |
+| Strict pooled Parakeet WER | 7.33% (11/150 edits) | 6.67% (10/150 edits) |
+| Thermal pressure during sampled generation | Nominal | Nominal |
+
+RTF = generation seconds / audio seconds; less than 1 is faster than real time. RSS and MLX memory overlap and must **not be added**. Main checkpoint size excludes the separate 494.87 MB S3Tokenizer dependency, which is kept in its original disk cache for both variants. Load times use already-cached files and exclude downloads and Python imports; cold HTTP latency is not measured. Q8 converts the external tokenizer during model load.
+
+## What changed structurally
+
+- Baseline: [mlx-community/chatterbox-multilingual-v3](https://huggingface.co/mlx-community/chatterbox-multilingual-v3/tree/03565773edd72e949572557597af8063bb49a18a), pinned revision `03565773edd72e949572557597af8063bb49a18a`. Its local main-checkpoint SHA-256 matched the Hub LFS hash during this run.
+- **651 checkpoint matrices** stored as native MLX affine 8-bit, group size 64: 222 T3 matrices, 428 S3Gen matrices and 1 voice-encoder matrix.
+- **37 external S3Tokenizer matrices** are additionally converted to Q8 in memory by the included `load_q8.py`, for **688 Q8 matrices in execution**. This changes precision beyond T3; the audio comparison does not isolate transformer-only quantization.
+- **1,836 other checkpoint tensors**, totaling 159.84 MB, were checked byte-for-byte identical to FP32. Unsupported convolution, normalization, bias and other tensors retain their original representation. This is not an all-integer model.
+- The original packing used oMLX `_quantize_chunked`, revision `70f44cfd`, with the native MLX affine path. This is weight quantization, without importance calibration, LoRA merging or voice fine-tuning.
+- External tokenizer: [mlx-community/S3TokenizerV2](https://huggingface.co/mlx-community/S3TokenizerV2/tree/e0c9886f0e1c35ae85b1f27277416fb19fc72bec), revision `e0c9886f0e1c35ae85b1f27277416fb19fc72bec`. Its cached file hash matched the Hub LFS hash. No baseline or cache was overwritten.
+
+Full file hashes and structural checks are in [weight-validation.json](weight-validation.json). The included native MLX rebuild recipe was executed from the FP32 source and reproduced the packed checkpoint **byte-for-byte**, including the complete SHA-256; see [rebuild-validation.json](rebuild-validation.json).
+
+## Detected audio and text differences
+
+None of the 12 paired WAV outputs was bit-identical. Different waveform hashes under the same seed are expected when quantization changes autoregressive logits or acoustic decoding; they do not prove perceptual degradation. Paired duration differences ranged from -8.0% to 16.4%. All clips were finite, non-empty 24 kHz PCM16 audio; no synthesis exception or silent output occurred. Clipping fractions and amplitudes are recorded per clip in the data.
+
+| Language | FP32 WER | Q8 WER | FP32 aggregate RTF | Q8 aggregate RTF |
+|---|---:|---:|---:|---:|
+| English | 13.51% | 13.51% | 1.027 | 0.733 |
+| Spanish | 1.32% | 0.00% | 1.055 | 0.720 |
+
+The pooled difference is **one edit in 150 reference tokens**. It is too small to claim improved overall speech quality. English pooled WER is identical across variants; most English errors cluster around the phrase about tested/saved recordings. With seed 123, FP32 omitted Spanish “se” while Q8 retained it. The English contraction “I'm” versus “I am” contributes two strict word edits in one clip for each variant. ASR cannot by itself tell whether an error came from pronunciation, synthesis or recognition. Voice similarity, naturalness and MOS were **not measured**.
+
+Every paired transcription follows, including unfavorable cases:
+
+| Language / prompt / seed | FP32 transcript | Q8 transcript | Edits FP32 / Q8 |
+|---|---|---|---|
+| en / 0 / 42 | The weather is pleasant today and I'm going for a walk. | The weather is pleasant today and I am going for a walk. | 2 / 0 |
+| en / 0 / 123 | The weather is pleasant today and I am going for a walk. | The weather is pleasant today and I'm going for a walk. | 0 / 2 |
+| es / 1 / 42 | Hoy hace buen tiempo y voy a salir a caminar por el parque. | Hoy hace buen tiempo y voy a salir a caminar por el parque. | 0 / 0 |
+| es / 1 / 123 | Hoy hace buen tiempo y voy a salir a caminar por el parque. | Hoy hace buen tiempo y voy a salir a caminar por el parque. | 0 / 0 |
+| en / 2 / 42 | Could you check the microphone and tell me whether the sound is clear? | Could you check the microphone and tell me whether the sound is clear? | 0 / 0 |
+| en / 2 / 123 | Could you check the microphone and tell me whether the sound is kid? | Could you check the microphone and tell me whether the sound is clear? | 1 / 0 |
+| es / 3 / 42 | ¿Podés revisar el micrófono y decirme si mi voz se escucha claramente? | ¿Podés revisar el micrófono y decirme si mi voz se escucha claramente? | 0 / 0 |
+| es / 3 / 123 | ¿Podés revisar el micrófono y decirme si mi voz escucha claramente? | ¿Podés revisar el micrófono y decirme si mi voz se escucha claramente? | 1 / 0 |
+| en / 4 / 42 | We test the smaller model twice and save both recording for comparison. | We test the smaller model twice and save Boss Recording for comparison. | 3 / 4 |
+| en / 4 / 123 | We test the smaller model twice, and save Boss Recording for comparison. | We test the smaller model twice, and save voice recording for comparison. | 4 / 4 |
+| es / 5 / 42 | Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas. | Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas. | 0 / 0 |
+| es / 5 / 123 | Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas. | Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas. | 0 / 0 |
+
+## Method, scope and limitations
+
+Six unique prompts (3 English, 3 Spanish), paired seeds 42 and 123, 12 measured generations per variant. FP32 ran first, then Q8, in separate sequential processes; each prepared its own conditioning from the same reference and performed one separate warm-up. ASR ran after both TTS processes finished. Reference SHA-256: `ace8518ab1d3b45e702a4c54700cab378a3d6e8172dfa8cd3dd51d8e176cfac3`. The reference voice was the local Valentina profile; no voice is embedded in the checkpoint and the reference itself is not distributed.
+
+Parameters: exaggeration=0.5, cfg_weight=0.5, temperature=0.8, repetition_penalty=1.2, min_p=0.05, top_p=0.95, max_new_tokens=400. MLX cache limit=512 MiB. Identical runtime versions: `{"huggingface-hub": "1.33.0", "mlx": "0.32.3", "mlx-audio": "0.5.7", "numpy": "2.4.6", "soundfile": "0.14.0"}`. Output 24 kHz PCM16. Generation timing includes materializing and synchronizing audio, excludes loading, conditioning, warm-up and WAV writing. CPU is measured by process CPU time divided by generation wall time; 100% means one core, not the whole CPU or GPU.
+
+Parakeet TDT 0.6B v3 ONNX INT8, CPUExecutionProvider, four intra-op threads and one inter-op thread, with all models available locally and offline mode enabled. ASR package versions: onnx-asr 0.12.0, onnxruntime 1.27.0, NumPy 1.26.4 ([asr-versions.json](asr-versions.json)). WER is Levenshtein word edits divided by reference tokens, Unicode NFC, case-folded, punctuation removed, accents retained, contractions unexpanded. Two seeds per prompt are not 12 independent linguistic examples. No confidence interval, blind listening panel or statistical significance claim is made.
+
+Power comes from macOS powermetrics at roughly 1-second intervals. Each sample is weighted by its overlap with recorded generation intervals. Coverage: FP32 43.96/44.42 s, Q8 31.39/31.67 s. This is whole-chip CPU+GPU+ANE power, includes other desktop activity, excludes display, battery losses and charger consumption, and does not isolate TTS watts. Rounded sample timestamps and interval boundaries make energy approximate; it excludes startup, conditioning, warm-up and idle time. AC power was confirmed during the measured run. The desktop remained active; order was fixed, and thermal pressure was nominal. No long-text, sustained thermal, multilingual breadth or streaming-latency evaluation is claimed.
+
+Reproduce generation with [benchmark.py](benchmark.py), running variants in separate processes with the same reference. Reproduce transcription and WER with [score_audio.py](score_audio.py). Full metrics and paired differences: [results.json](results.json), [results.csv](results.csv); measured runtime module lists: [fp32-results.json](fp32-results.json), [q8-results.json](q8-results.json); power samples: [power-samples.json](power-samples.json).
+
+```bash
+python evaluation/benchmark.py --variant fp32 --source /path/to/fp32 \
+  --q8 /path/to/q8 --reference /path/to/your/reference.wav --out ./audio
+python evaluation/benchmark.py --variant q8 --source /path/to/fp32 \
+  --q8 /path/to/q8 --reference /path/to/your/reference.wav --out ./audio
+```
+
+This publication includes the generic model, loader, checksums, measurement data and scripts. It does not include private reference audio, generated voice samples, authentication files, caches or local service configuration.

evaluation/asr-health.json

@@ -0,0 +1,19 @@
+{
+  "status": "healthy",
+  "models": [
+    "parakeet-tdt-0.6b-v3",
+    "istupakov/parakeet-tdt-0.6b-v3-onnx",
+    "grikdotnet/parakeet-tdt-0.6b-fp16"
+  ],
+  "loaded": [
+    "parakeet-tdt-0.6b-v3"
+  ],
+  "default_model": "parakeet-tdt-0.6b-v3",
+  "cpu": {
+    "physical": 10,
+    "logical": 10,
+    "ort_intra": 4,
+    "ort_inter": 1,
+    "audio_workers": 8
+  }
+}

evaluation/asr-versions.json

@@ -0,0 +1,5 @@
+{
+  "onnx-asr": "0.12.0",
+  "onnxruntime": "1.27.0",
+  "numpy": "1.26.4"
+}

evaluation/benchmark.py

@@ -0,0 +1,34 @@
+"""Reproducible paired MLX benchmark; run each variant in its own process."""
+import argparse,hashlib,importlib.metadata,json,os,resource,sys,time
+from pathlib import Path
+p=argparse.ArgumentParser();p.add_argument('--variant',choices=['q8','fp32'],required=True);p.add_argument('--source',required=True);p.add_argument('--q8',required=True);p.add_argument('--reference',required=True);p.add_argument('--out',required=True)
+a=p.parse_args();out=Path(a.out);out.mkdir(parents=True,exist_ok=True)
+os.environ['HF_HUB_OFFLINE']='1'
+import mlx.core as mx
+import numpy as np
+import soundfile as sf
+from mlx_audio.tts.models.chatterbox.chatterbox import Model
+mx.set_cache_limit(512*1024**2)
+prompts=[('en','The weather is pleasant today, and I am going for a walk.'),('es','Hoy hace buen tiempo y voy a salir a caminar por el parque.'),('en','Could you check the microphone and tell me whether the sound is clear?'),('es','¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?'),('en','We tested the smaller model twice, and saved both recordings for comparison.'),('es','Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.')]
+t=time.perf_counter()
+if a.variant=='q8':
+ sys.path.insert(0,a.q8);from load_q8 import load_model;model=load_model(a.q8)
+else:model=Model.from_pretrained(Path(a.source))
+mx.eval(model.parameters());mx.synchronize();load_s=time.perf_counter()-t
+mods=dict(model.named_modules());quant=[{'name':n,'bits':m.bits,'group_size':m.group_size} for n,m in mods.items() if hasattr(m,'bits')]
+t=time.perf_counter();conds=model.prepare_conditionals(a.reference,24000,.5);mx.synchronize();conditioning_s=time.perf_counter()-t
+params=dict(exaggeration=.5,cfg_weight=.5,temperature=.8,repetition_penalty=1.2,min_p=.05,top_p=.95,max_new_tokens=400,verbose=False)
+def synth(text,lang,seed):
+ mx.random.seed(seed);mx.synchronize();mx.reset_peak_memory();started=time.perf_counter();started_at=time.time();cpu=time.process_time()
+ r=list(model.generate(text,conds=conds,lang_code=lang,**params));mx.eval(*[x.audio for x in r]);mx.synchronize();wav=np.concatenate([np.asarray(x.audio).reshape(-1) for x in r]);elapsed=time.perf_counter()-started
+ return wav,elapsed,time.process_time()-cpu,mx.get_peak_memory(),started_at,time.time()
+w,dt,ct,peak,start_at,end_at=synth('Hello, this is the warm up.','en',42)
+meta={'variant':a.variant,'load_s':load_s,'conditioning_s':conditioning_s,'warmup_s':dt,'parameters':params,'seeds':[42,123],'quantized_modules':quant,'reference_sha256':hashlib.sha256(Path(a.reference).read_bytes()).hexdigest(),'versions':{k:importlib.metadata.version(k) for k in ['mlx','mlx-audio','numpy','soundfile','huggingface-hub']},'rows':[]}
+print(json.dumps({'variant':a.variant,'load_s':load_s,'conditioning_s':conditioning_s,'runtime_quantized_modules':len(quant)}),flush=True)
+for i,(lang,text) in enumerate(prompts):
+ for seed in [42,123]:
+  wav,dt,ct,peak,start_at,end_at=synth(text,lang,seed)
+  assert np.isfinite(wav).all() and len(wav)>2400 and np.max(np.abs(wav))>1e-4
+  f=f'{a.variant}-{i}-{seed}.wav';sf.write(out/f,wav,24000,subtype='PCM_16')
+  row={'variant':a.variant,'prompt':i,'lang':lang,'text':text,'seed':seed,'generation_s':dt,'started_at':start_at,'finished_at':end_at,'audio_s':len(wav)/24000,'rtf':dt/(len(wav)/24000),'cpu_s':ct,'cpu_pct_one_core':100*ct/dt,'process_peak_rss_bytes':resource.getrusage(resource.RUSAGE_SELF).ru_maxrss,'mlx_peak_bytes':peak,'rms':float(np.sqrt(np.mean(wav*wav))),'peak_amplitude':float(np.max(np.abs(wav))),'clipped_fraction':float(np.mean(np.abs(wav)>=1.0)),'audio_sha256':hashlib.sha256((out/f).read_bytes()).hexdigest(),'file':f}
+  meta['rows'].append(row);(out/f'{a.variant}-results.json').write_text(json.dumps(meta,ensure_ascii=False,indent=2));print(json.dumps({k:row[k] for k in ['variant','prompt','seed','generation_s','audio_s','rtf']},ensure_ascii=False),flush=True)

evaluation/fp32-results.json

@@ -0,0 +1,283 @@
+{
+  "variant": "fp32",
+  "load_s": 0.6741061250013445,
+  "conditioning_s": 0.1307210409995605,
+  "warmup_s": 2.4151600410004903,
+  "parameters": {
+    "exaggeration": 0.5,
+    "cfg_weight": 0.5,
+    "temperature": 0.8,
+    "repetition_penalty": 1.2,
+    "min_p": 0.05,
+    "top_p": 0.95,
+    "max_new_tokens": 400,
+    "verbose": false
+  },
+  "seeds": [
+    42,
+    123
+  ],
+  "quantized_modules": [],
+  "reference_sha256": "ace8518ab1d3b45e702a4c54700cab378a3d6e8172dfa8cd3dd51d8e176cfac3",
+  "versions": {
+    "mlx": "0.32.3",
+    "mlx-audio": "0.5.7",
+    "numpy": "2.4.6",
+    "soundfile": "0.14.0",
+    "huggingface-hub": "1.33.0"
+  },
+  "rows": [
+    {
+      "variant": "fp32",
+      "prompt": 0,
+      "lang": "en",
+      "text": "The weather is pleasant today, and I am going for a walk.",
+      "seed": 42,
+      "generation_s": 3.1965204579992132,
+      "started_at": 1791505087.485913,
+      "finished_at": 1791505090.68248,
+      "audio_s": 3.04,
+      "rtf": 1.0514869927628991,
+      "cpu_s": 0.7317990000000001,
+      "cpu_pct_one_core": 22.893612276708293,
+      "process_peak_rss_bytes": 3463380992,
+      "mlx_peak_bytes": 4345317492,
+      "rms": 0.07403168827295303,
+      "peak_amplitude": 0.4069647789001465,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "64007babd631a940eae8ca91abec17aae1c70cd35dae16d7ab35575966bb027a",
+      "file": "fp32-0-42.wav"
+    },
+    {
+      "variant": "fp32",
+      "prompt": 0,
+      "lang": "en",
+      "text": "The weather is pleasant today, and I am going for a walk.",
+      "seed": 123,
+      "generation_s": 3.0633785410009295,
+      "started_at": 1791505090.684835,
+      "finished_at": 1791505093.748255,
+      "audio_s": 2.84,
+      "rtf": 1.0786544158453977,
+      "cpu_s": 0.6330870000000002,
+      "cpu_pct_one_core": 20.66630001897007,
+      "process_peak_rss_bytes": 3463512064,
+      "mlx_peak_bytes": 4322116548,
+      "rms": 0.06872081756591797,
+      "peak_amplitude": 0.4245677888393402,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "1f527123d71a467235b096f6d089d8da50c33a9ba9fab13118118da0b382b3cb",
+      "file": "fp32-0-123.wav"
+    },
+    {
+      "variant": "fp32",
+      "prompt": 1,
+      "lang": "es",
+      "text": "Hoy hace buen tiempo y voy a salir a caminar por el parque.",
+      "seed": 42,
+      "generation_s": 3.6277591250000114,
+      "started_at": 1791505093.749502,
+      "finished_at": 1791505097.377311,
+      "audio_s": 3.08,
+      "rtf": 1.1778438717532504,
+      "cpu_s": 1.217866,
+      "cpu_pct_one_core": 33.570751475954076,
+      "process_peak_rss_bytes": 3463544832,
+      "mlx_peak_bytes": 4351905580,
+      "rms": 0.07840348035097122,
+      "peak_amplitude": 0.4688829183578491,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "3d0606768bff683048a5a912f0d141b24951e9616440f5b02379986555f1945f",
+      "file": "fp32-1-42.wav"
+    },
+    {
+      "variant": "fp32",
+      "prompt": 1,
+      "lang": "es",
+      "text": "Hoy hace buen tiempo y voy a salir a caminar por el parque.",
+      "seed": 123,
+      "generation_s": 3.964549750000515,
+      "started_at": 1791505097.378741,
+      "finished_at": 1791505101.3433459,
+      "audio_s": 3.48,
+      "rtf": 1.139238433908194,
+      "cpu_s": 1.3446109999999996,
+      "cpu_pct_one_core": 33.915856397055556,
+      "process_peak_rss_bytes": 3463544832,
+      "mlx_peak_bytes": 4401863908,
+      "rms": 0.0745975524187088,
+      "peak_amplitude": 0.49563872814178467,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "0ab2af738e3bf675cc1b0fe92caf8207c09814bc589e0b187ebc04047b0f8e03",
+      "file": "fp32-1-123.wav"
+    },
+    {
+      "variant": "fp32",
+      "prompt": 2,
+      "lang": "en",
+      "text": "Could you check the microphone and tell me whether the sound is clear?",
+      "seed": 42,
+      "generation_s": 3.2237355840006785,
+      "started_at": 1791505101.345545,
+      "finished_at": 1791505104.5693262,
+      "audio_s": 3.12,
+      "rtf": 1.033248584615602,
+      "cpu_s": 0.7545999999999999,
+      "cpu_pct_one_core": 23.407626969937034,
+      "process_peak_rss_bytes": 3463544832,
+      "mlx_peak_bytes": 4354393232,
+      "rms": 0.0651380643248558,
+      "peak_amplitude": 0.5876898765563965,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "4585b93dc0be3e79bd1c5850086b1bca653e6279027ce786cb5dcb83c2b06662",
+      "file": "fp32-2-42.wav"
+    },
+    {
+      "variant": "fp32",
+      "prompt": 2,
+      "lang": "en",
+      "text": "Could you check the microphone and tell me whether the sound is clear?",
+      "seed": 123,
+      "generation_s": 3.125938209001106,
+      "started_at": 1791505104.571863,
+      "finished_at": 1791505107.697845,
+      "audio_s": 2.92,
+      "rtf": 1.0705267839044883,
+      "cpu_s": 0.612603,
+      "cpu_pct_one_core": 19.597412330033144,
+      "process_peak_rss_bytes": 3463757824,
+      "mlx_peak_bytes": 4332290508,
+      "rms": 0.05791015177965164,
+      "peak_amplitude": 0.3281961679458618,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "cb3682f0f4e09b91a6dbc214bf8d7fff96d63ec3e6ae6dd071242022e6085224",
+      "file": "fp32-2-123.wav"
+    },
+    {
+      "variant": "fp32",
+      "prompt": 3,
+      "lang": "es",
+      "text": "¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?",
+      "seed": 42,
+      "generation_s": 4.158612834000451,
+      "started_at": 1791505107.699348,
+      "finished_at": 1791505111.858019,
+      "audio_s": 3.76,
+      "rtf": 1.1060140515958645,
+      "cpu_s": 1.6599370000000002,
+      "cpu_pct_one_core": 39.91564173583321,
+      "process_peak_rss_bytes": 3463888896,
+      "mlx_peak_bytes": 4435468468,
+      "rms": 0.07013692706823349,
+      "peak_amplitude": 0.49748122692108154,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "f643c084636fd77e71ddf0b0ea3bd1293a73020bcec716dad22f697eb2adb4d2",
+      "file": "fp32-3-42.wav"
+    },
+    {
+      "variant": "fp32",
+      "prompt": 3,
+      "lang": "es",
+      "text": "¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?",
+      "seed": 123,
+      "generation_s": 3.7025962919997255,
+      "started_at": 1791505111.860312,
+      "finished_at": 1791505115.5629609,
+      "audio_s": 3.68,
+      "rtf": 1.0061402967390558,
+      "cpu_s": 0.8157210000000017,
+      "cpu_pct_one_core": 22.03105431079663,
+      "process_peak_rss_bytes": 3463888896,
+      "mlx_peak_bytes": 4426045692,
+      "rms": 0.06872870773077011,
+      "peak_amplitude": 0.3373930752277374,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "f9104434605f2d430389f7a3c278854ee89fb263f8ab28956106062ecc6363bc",
+      "file": "fp32-3-123.wav"
+    },
+    {
+      "variant": "fp32",
+      "prompt": 4,
+      "lang": "en",
+      "text": "We tested the smaller model twice, and saved both recordings for comparison.",
+      "seed": 42,
+      "generation_s": 4.000432833001469,
+      "started_at": 1791505115.565877,
+      "finished_at": 1791505119.566365,
+      "audio_s": 4.04,
+      "rtf": 0.9902061467825417,
+      "cpu_s": 0.8506999999999998,
+      "cpu_pct_one_core": 21.265198930030067,
+      "process_peak_rss_bytes": 3463921664,
+      "mlx_peak_bytes": 4474547224,
+      "rms": 0.07948584854602814,
+      "peak_amplitude": 0.5621404647827148,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "87164016136e0e2ce4683b9035903b1ed17bb41b18022e100f8a7e029bdef6d4",
+      "file": "fp32-4-42.wav"
+    },
+    {
+      "variant": "fp32",
+      "prompt": 4,
+      "lang": "en",
+      "text": "We tested the smaller model twice, and saved both recordings for comparison.",
+      "seed": 123,
+      "generation_s": 3.9630061669995484,
+      "started_at": 1791505119.569291,
+      "finished_at": 1791505123.53235,
+      "audio_s": 4.08,
+      "rtf": 0.9713250409312618,
+      "cpu_s": 0.790343,
+      "cpu_pct_one_core": 19.943017161600345,
+      "process_peak_rss_bytes": 3464183808,
+      "mlx_peak_bytes": 4476951344,
+      "rms": 0.07089035212993622,
+      "peak_amplitude": 0.534336507320404,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "5b16450d839fbc974dad48f8745f57e3b54b68458919359184f9e82fea500743",
+      "file": "fp32-4-123.wav"
+    },
+    {
+      "variant": "fp32",
+      "prompt": 5,
+      "lang": "es",
+      "text": "Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.",
+      "seed": 42,
+      "generation_s": 4.196048207999411,
+      "started_at": 1791505123.5343418,
+      "finished_at": 1791505127.7304478,
+      "audio_s": 4.32,
+      "rtf": 0.9713074555554191,
+      "cpu_s": 0.8885400000000008,
+      "cpu_pct_one_core": 21.17563850448797,
+      "process_peak_rss_bytes": 3464282112,
+      "mlx_peak_bytes": 4506407736,
+      "rms": 0.08085767179727554,
+      "peak_amplitude": 0.7336018681526184,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "8c8a9a7cadd59754de7d28bc2c8203234edc99eb462e80da16acf613c269df40",
+      "file": "fp32-5-42.wav"
+    },
+    {
+      "variant": "fp32",
+      "prompt": 5,
+      "lang": "es",
+      "text": "Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.",
+      "seed": 123,
+      "generation_s": 4.19392358299956,
+      "started_at": 1791505127.732991,
+      "finished_at": 1791505131.71377,
+      "audio_s": 4.28,
+      "rtf": 0.9798886876167194,
+      "cpu_s": 0.9046869999999991,
+      "cpu_pct_one_core": 21.571375398140965,
+      "process_peak_rss_bytes": 3464740864,
+      "mlx_peak_bytes": 4506837580,
+      "rms": 0.08112484961748123,
+      "peak_amplitude": 0.6759235858917236,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "fefb05967eede4ab9c2d3e2d82a761f425ab9619f2d8258c878fef31598c0f8d",
+      "file": "fp32-5-123.wav"
+    }
+  ]
+}

evaluation/power-samples.json

@@ -0,0 +1,538 @@
+{
+  "fp32": [
+    {
+      "sample_end_epoch": 1791505088.0,
+      "interval_s": 1.01335,
+      "generation_overlap_s": 0.5140869617462158,
+      "chip_watts": 6.289,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505089.0,
+      "interval_s": 1.00776,
+      "generation_overlap_s": 1.0077600479125977,
+      "chip_watts": 5.068,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505090.0,
+      "interval_s": 1.00855,
+      "generation_overlap_s": 1.0085499286651611,
+      "chip_watts": 7.414,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505091.0,
+      "interval_s": 1.01472,
+      "generation_overlap_s": 1.0123651027679443,
+      "chip_watts": 6.676,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505092.0,
+      "interval_s": 1.00778,
+      "generation_overlap_s": 1.0077800750732422,
+      "chip_watts": 4.967,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505093.0,
+      "interval_s": 1.00772,
+      "generation_overlap_s": 1.0077199935913086,
+      "chip_watts": 7.623,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505094.0,
+      "interval_s": 1.01347,
+      "generation_overlap_s": 1.0122230052947998,
+      "chip_watts": 6.875,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505095.0,
+      "interval_s": 1.0121900000000001,
+      "generation_overlap_s": 1.0121901035308838,
+      "chip_watts": 3.178,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505096.0,
+      "interval_s": 1.01179,
+      "generation_overlap_s": 1.0117900371551514,
+      "chip_watts": 4.838,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505097.0,
+      "interval_s": 1.0078099999999999,
+      "generation_overlap_s": 1.007810115814209,
+      "chip_watts": 7.935,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505098.0,
+      "interval_s": 1.00803,
+      "generation_overlap_s": 1.0065999031066895,
+      "chip_watts": 5.0,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505099.0,
+      "interval_s": 1.01343,
+      "generation_overlap_s": 1.013430118560791,
+      "chip_watts": 3.166,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505100.0,
+      "interval_s": 1.01227,
+      "generation_overlap_s": 1.0122699737548828,
+      "chip_watts": 5.629,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505101.0,
+      "interval_s": 1.0081900000000001,
+      "generation_overlap_s": 1.0081899166107178,
+      "chip_watts": 7.72,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505102.0,
+      "interval_s": 1.00772,
+      "generation_overlap_s": 1.0055208206176758,
+      "chip_watts": 5.881,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505103.0,
+      "interval_s": 1.00773,
+      "generation_overlap_s": 1.0077300071716309,
+      "chip_watts": 5.901,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505104.0,
+      "interval_s": 1.01508,
+      "generation_overlap_s": 1.0150799751281738,
+      "chip_watts": 7.669,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505105.0,
+      "interval_s": 1.01549,
+      "generation_overlap_s": 1.012953281402588,
+      "chip_watts": 6.732,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505106.0,
+      "interval_s": 1.00774,
+      "generation_overlap_s": 1.0077400207519531,
+      "chip_watts": 5.784,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505107.0,
+      "interval_s": 1.01669,
+      "generation_overlap_s": 1.0166900157928467,
+      "chip_watts": 8.064,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505108.0,
+      "interval_s": 1.0081799999999999,
+      "generation_overlap_s": 1.0066769123077393,
+      "chip_watts": 6.586,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505109.0,
+      "interval_s": 1.01402,
+      "generation_overlap_s": 1.0140199661254883,
+      "chip_watts": 3.299,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505110.0,
+      "interval_s": 1.014,
+      "generation_overlap_s": 1.0139999389648438,
+      "chip_watts": 4.087,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505111.0,
+      "interval_s": 1.00939,
+      "generation_overlap_s": 1.009390115737915,
+      "chip_watts": 7.21,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505112.0,
+      "interval_s": 1.01371,
+      "generation_overlap_s": 1.0114171504974365,
+      "chip_watts": 6.806,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505113.0,
+      "interval_s": 1.00778,
+      "generation_overlap_s": 1.0077800750732422,
+      "chip_watts": 5.219,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505114.0,
+      "interval_s": 1.00771,
+      "generation_overlap_s": 1.0077099800109863,
+      "chip_watts": 6.523,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505115.0,
+      "interval_s": 1.01505,
+      "generation_overlap_s": 1.015049934387207,
+      "chip_watts": 7.245,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505116.0,
+      "interval_s": 1.02014,
+      "generation_overlap_s": 1.017223834991455,
+      "chip_watts": 6.051,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505117.0,
+      "interval_s": 1.0078,
+      "generation_overlap_s": 1.0078001022338867,
+      "chip_watts": 5.207,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505118.0,
+      "interval_s": 1.00771,
+      "generation_overlap_s": 1.0077099800109863,
+      "chip_watts": 6.608,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505119.0,
+      "interval_s": 1.0147899999999999,
+      "generation_overlap_s": 1.0147900581359863,
+      "chip_watts": 6.948,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505120.0,
+      "interval_s": 1.01485,
+      "generation_overlap_s": 1.0119237899780273,
+      "chip_watts": 6.503,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505121.0,
+      "interval_s": 1.0078099999999999,
+      "generation_overlap_s": 1.007810115814209,
+      "chip_watts": 5.253,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505122.0,
+      "interval_s": 1.00773,
+      "generation_overlap_s": 1.0077300071716309,
+      "chip_watts": 6.85,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505123.0,
+      "interval_s": 1.0141900000000001,
+      "generation_overlap_s": 1.0141899585723877,
+      "chip_watts": 7.836,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505124.0,
+      "interval_s": 1.00865,
+      "generation_overlap_s": 1.0066583156585693,
+      "chip_watts": 5.783,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505125.0,
+      "interval_s": 1.00789,
+      "generation_overlap_s": 1.007889986038208,
+      "chip_watts": 5.233,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505126.0,
+      "interval_s": 1.00771,
+      "generation_overlap_s": 1.0077099800109863,
+      "chip_watts": 6.604,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505127.0,
+      "interval_s": 1.01417,
+      "generation_overlap_s": 1.0141699314117432,
+      "chip_watts": 7.021,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505128.0,
+      "interval_s": 1.01375,
+      "generation_overlap_s": 1.011206865310669,
+      "chip_watts": 6.359,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505129.0,
+      "interval_s": 1.00768,
+      "generation_overlap_s": 1.0076799392700195,
+      "chip_watts": 5.625,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505130.0,
+      "interval_s": 1.00787,
+      "generation_overlap_s": 1.0078699588775635,
+      "chip_watts": 6.3,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505131.0,
+      "interval_s": 1.0161799999999999,
+      "generation_overlap_s": 1.0161800384521484,
+      "chip_watts": 7.031,
+      "thermal": "Nominal"
+    }
+  ],
+  "q8": [
+    {
+      "sample_end_epoch": 1791505135.0,
+      "interval_s": 1.0081799999999999,
+      "generation_overlap_s": 0.15093493461608887,
+      "chip_watts": 8.748,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505136.0,
+      "interval_s": 1.00882,
+      "generation_overlap_s": 1.0088200569152832,
+      "chip_watts": 7.303,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505137.0,
+      "interval_s": 1.00804,
+      "generation_overlap_s": 1.008039951324463,
+      "chip_watts": 8.794,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505138.0,
+      "interval_s": 1.00967,
+      "generation_overlap_s": 1.0066039562225342,
+      "chip_watts": 7.132,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505139.0,
+      "interval_s": 1.0079500000000001,
+      "generation_overlap_s": 1.0079500675201416,
+      "chip_watts": 8.394,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505140.0,
+      "interval_s": 1.00803,
+      "generation_overlap_s": 1.0044620037078857,
+      "chip_watts": 8.176,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505141.0,
+      "interval_s": 1.00978,
+      "generation_overlap_s": 1.009779930114746,
+      "chip_watts": 7.55,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505142.0,
+      "interval_s": 1.00817,
+      "generation_overlap_s": 1.0081698894500732,
+      "chip_watts": 8.653,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505143.0,
+      "interval_s": 1.01112,
+      "generation_overlap_s": 1.0080912113189697,
+      "chip_watts": 7.1,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505144.0,
+      "interval_s": 1.0079500000000001,
+      "generation_overlap_s": 1.0079500675201416,
+      "chip_watts": 8.109,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505145.0,
+      "interval_s": 1.00799,
+      "generation_overlap_s": 1.0047290325164795,
+      "chip_watts": 7.83,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505146.0,
+      "interval_s": 1.0081499999999999,
+      "generation_overlap_s": 1.0081501007080078,
+      "chip_watts": 8.069,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505147.0,
+      "interval_s": 1.00807,
+      "generation_overlap_s": 1.0049450397491455,
+      "chip_watts": 8.551,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505148.0,
+      "interval_s": 1.01097,
+      "generation_overlap_s": 1.010970115661621,
+      "chip_watts": 7.131,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505149.0,
+      "interval_s": 1.00817,
+      "generation_overlap_s": 1.0081698894500732,
+      "chip_watts": 8.313,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505150.0,
+      "interval_s": 1.00881,
+      "generation_overlap_s": 1.0058350563049316,
+      "chip_watts": 7.25,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505151.0,
+      "interval_s": 1.00885,
+      "generation_overlap_s": 1.00885009765625,
+      "chip_watts": 7.351,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505152.0,
+      "interval_s": 1.0079500000000001,
+      "generation_overlap_s": 1.0079500675201416,
+      "chip_watts": 8.6,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505153.0,
+      "interval_s": 1.01135,
+      "generation_overlap_s": 1.0050499439239502,
+      "chip_watts": 6.802,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505154.0,
+      "interval_s": 1.00829,
+      "generation_overlap_s": 1.0082900524139404,
+      "chip_watts": 7.649,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505155.0,
+      "interval_s": 1.00816,
+      "generation_overlap_s": 1.0046331882476807,
+      "chip_watts": 8.357,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505156.0,
+      "interval_s": 1.01113,
+      "generation_overlap_s": 1.0111300945281982,
+      "chip_watts": 6.975,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505157.0,
+      "interval_s": 1.00805,
+      "generation_overlap_s": 1.0080499649047852,
+      "chip_watts": 7.769,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505158.0,
+      "interval_s": 1.00797,
+      "generation_overlap_s": 1.0041122436523438,
+      "chip_watts": 8.17,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505159.0,
+      "interval_s": 1.0107300000000001,
+      "generation_overlap_s": 1.0107300281524658,
+      "chip_watts": 7.264,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505160.0,
+      "interval_s": 1.00812,
+      "generation_overlap_s": 1.008120059967041,
+      "chip_watts": 7.689,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505161.0,
+      "interval_s": 1.00785,
+      "generation_overlap_s": 1.0033178329467773,
+      "chip_watts": 8.189,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505162.0,
+      "interval_s": 1.0109,
+      "generation_overlap_s": 1.0109000205993652,
+      "chip_watts": 7.186,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505163.0,
+      "interval_s": 1.00803,
+      "generation_overlap_s": 1.0080299377441406,
+      "chip_watts": 8.196,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505164.0,
+      "interval_s": 1.00884,
+      "generation_overlap_s": 1.005007028579712,
+      "chip_watts": 7.452,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505165.0,
+      "interval_s": 1.00975,
+      "generation_overlap_s": 1.0097498893737793,
+      "chip_watts": 7.163,
+      "thermal": "Nominal"
+    },
+    {
+      "sample_end_epoch": 1791505166.0,
+      "interval_s": 1.00784,
+      "generation_overlap_s": 1.0078399181365967,
+      "chip_watts": 8.209,
+      "thermal": "Nominal"
+    }
+  ]
+}

evaluation/q8-results.json

@@ -0,0 +1,3724 @@
+{
+  "variant": "q8",
+  "load_s": 0.5469651250004972,
+  "conditioning_s": 0.13102108299972315,
+  "warmup_s": 1.7207783329995436,
+  "parameters": {
+    "exaggeration": 0.5,
+    "cfg_weight": 0.5,
+    "temperature": 0.8,
+    "repetition_penalty": 1.2,
+    "min_p": 0.05,
+    "top_p": 0.95,
+    "max_new_tokens": 400,
+    "verbose": false
+  },
+  "seeds": [
+    42,
+    123
+  ],
+  "quantized_modules": [
+    {
+      "name": "_s3_tokenizer.quantizer.fsq_codebook.project_down",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.5.mlp.layers.2",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.5.mlp.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.5.attn.out",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.5.attn.value",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.5.attn.key",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.5.attn.query",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.4.mlp.layers.2",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.4.mlp.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.4.attn.out",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.4.attn.value",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.4.attn.key",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.4.attn.query",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.3.mlp.layers.2",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.3.mlp.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.3.attn.out",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.3.attn.value",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.3.attn.key",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.3.attn.query",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.2.mlp.layers.2",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.2.mlp.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.2.attn.out",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.2.attn.value",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.2.attn.key",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.2.attn.query",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.1.mlp.layers.2",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.1.mlp.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.1.attn.out",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.1.attn.value",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.1.attn.key",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.1.attn.query",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.0.mlp.layers.2",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.0.mlp.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.0.attn.out",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.0.attn.value",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.0.attn.key",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "_s3_tokenizer.encoder.blocks.0.attn.query",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "ve.proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.mel2wav.f0_predictor.classifier",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_3.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_3.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_3.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_3.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_3.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_3.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_2.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_2.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_2.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_2.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_2.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_2.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_1.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_1.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_1.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_1.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_1.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_1.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_0.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_0.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_0.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_0.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_0.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.transformer_0.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.up_blocks_0.resnet.mlp_linear",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_3.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_3.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_3.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_3.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_3.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_3.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_2.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_2.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_2.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_2.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_2.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_2.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_1.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_1.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_1.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_1.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_1.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_1.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_0.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_0.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_0.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_0.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_0.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.transformer_0.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_11.resnet.mlp_linear",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_3.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_3.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_3.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_3.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_3.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_3.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_2.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_2.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_2.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_2.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_2.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_2.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_1.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_1.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_1.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_1.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_1.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_1.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_0.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_0.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_0.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_0.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_0.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.transformer_0.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_10.resnet.mlp_linear",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_3.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_3.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_3.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_3.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_3.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_3.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_2.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_2.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_2.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_2.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_2.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_2.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_1.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_1.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_1.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_1.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_1.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_1.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_0.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_0.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_0.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_0.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_0.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.transformer_0.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_9.resnet.mlp_linear",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_3.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_3.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_3.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_3.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_3.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_3.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_2.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_2.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_2.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_2.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_2.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_2.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_1.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_1.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_1.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_1.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_1.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_1.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_0.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_0.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_0.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_0.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_0.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.transformer_0.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_8.resnet.mlp_linear",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_3.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_3.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_3.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_3.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_3.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_3.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_2.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_2.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_2.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_2.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_2.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_2.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_1.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_1.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_1.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_1.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_1.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_1.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_0.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_0.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_0.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_0.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_0.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.transformer_0.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_7.resnet.mlp_linear",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_3.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_3.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_3.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_3.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_3.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_3.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_2.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_2.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_2.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_2.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_2.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_2.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_1.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_1.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_1.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_1.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_1.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_1.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_0.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_0.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_0.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_0.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_0.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.transformer_0.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_6.resnet.mlp_linear",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_3.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_3.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_3.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_3.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_3.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_3.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_2.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_2.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_2.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_2.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_2.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_2.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_1.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_1.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_1.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_1.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_1.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_1.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_0.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_0.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_0.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_0.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_0.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.transformer_0.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_5.resnet.mlp_linear",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_3.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_3.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_3.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_3.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_3.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_3.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_2.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_2.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_2.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_2.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_2.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_2.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_1.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_1.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_1.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_1.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_1.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_1.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_0.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_0.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_0.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_0.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_0.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.transformer_0.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_4.resnet.mlp_linear",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_3.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_3.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_3.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_3.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_3.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_3.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_2.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_2.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_2.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_2.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_2.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_2.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_1.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_1.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_1.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_1.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_1.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_1.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_0.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_0.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_0.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_0.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_0.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.transformer_0.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_3.resnet.mlp_linear",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_3.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_3.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_3.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_3.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_3.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_3.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_2.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_2.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_2.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_2.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_2.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_2.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_1.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_1.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_1.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_1.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_1.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_1.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_0.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_0.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_0.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_0.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_0.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.transformer_0.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_2.resnet.mlp_linear",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_3.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_3.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_3.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_3.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_3.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_3.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_2.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_2.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_2.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_2.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_2.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_2.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_1.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_1.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_1.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_1.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_1.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_1.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_0.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_0.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_0.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_0.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_0.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.transformer_0.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_1.resnet.mlp_linear",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_3.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_3.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_3.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_3.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_3.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_3.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_2.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_2.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_2.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_2.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_2.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_2.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_1.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_1.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_1.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_1.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_1.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_1.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_0.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_0.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_0.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_0.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_0.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.transformer_0.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.mid_blocks_0.resnet.mlp_linear",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_3.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_3.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_3.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_3.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_3.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_3.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_2.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_2.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_2.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_2.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_2.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_2.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_1.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_1.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_1.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_1.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_1.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_1.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_0.ff.layers.1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_0.ff.layers.0",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_0.attn.out_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_0.attn.value_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_0.attn.key_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.transformer_0.attn.query_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.down_blocks_0.resnet.mlp_linear",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.time_mlp.linear_2",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.decoder.estimator.time_mlp.linear_1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_3.feed_forward.w_2",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_3.feed_forward.w_1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_3.self_attn.linear_pos",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_3.self_attn.linear_out",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_3.self_attn.linear_v",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_3.self_attn.linear_k",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_3.self_attn.linear_q",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_2.feed_forward.w_2",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_2.feed_forward.w_1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_2.self_attn.linear_pos",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_2.self_attn.linear_out",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_2.self_attn.linear_v",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_2.self_attn.linear_k",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_2.self_attn.linear_q",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_1.feed_forward.w_2",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_1.feed_forward.w_1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_1.self_attn.linear_pos",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_1.self_attn.linear_out",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_1.self_attn.linear_v",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_1.self_attn.linear_k",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_1.self_attn.linear_q",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_0.feed_forward.w_2",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_0.feed_forward.w_1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_0.self_attn.linear_pos",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_0.self_attn.linear_out",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_0.self_attn.linear_v",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_0.self_attn.linear_k",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_encoders_0.self_attn.linear_q",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.up_embed.linear",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_5.feed_forward.w_2",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_5.feed_forward.w_1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_5.self_attn.linear_pos",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_5.self_attn.linear_out",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_5.self_attn.linear_v",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_5.self_attn.linear_k",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_5.self_attn.linear_q",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_4.feed_forward.w_2",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_4.feed_forward.w_1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_4.self_attn.linear_pos",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_4.self_attn.linear_out",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_4.self_attn.linear_v",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_4.self_attn.linear_k",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_4.self_attn.linear_q",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_3.feed_forward.w_2",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_3.feed_forward.w_1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_3.self_attn.linear_pos",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_3.self_attn.linear_out",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_3.self_attn.linear_v",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_3.self_attn.linear_k",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_3.self_attn.linear_q",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_2.feed_forward.w_2",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_2.feed_forward.w_1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_2.self_attn.linear_pos",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_2.self_attn.linear_out",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_2.self_attn.linear_v",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_2.self_attn.linear_k",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_2.self_attn.linear_q",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_1.feed_forward.w_2",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_1.feed_forward.w_1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_1.self_attn.linear_pos",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_1.self_attn.linear_out",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_1.self_attn.linear_v",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_1.self_attn.linear_k",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_1.self_attn.linear_q",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_0.feed_forward.w_2",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_0.feed_forward.w_1",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_0.self_attn.linear_pos",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_0.self_attn.linear_out",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_0.self_attn.linear_v",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_0.self_attn.linear_k",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.encoders_0.self_attn.linear_q",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.encoder.embed.linear",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.spk_embed_affine_layer",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "s3gen.flow.input_embedding",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.speech_head",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.text_head",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.speech_pos_emb.emb",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.text_pos_emb.emb",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.speech_emb",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.text_emb",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.cond_enc.perceiver.attn.proj_out",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.cond_enc.perceiver.attn.to_v",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.cond_enc.perceiver.attn.to_k",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.cond_enc.perceiver.attn.to_q",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.cond_enc.spkr_enc",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.29.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.29.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.29.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.29.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.29.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.29.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.29.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.28.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.28.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.28.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.28.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.28.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.28.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.28.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.27.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.27.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.27.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.27.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.27.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.27.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.27.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.26.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.26.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.26.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.26.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.26.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.26.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.26.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.25.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.25.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.25.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.25.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.25.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.25.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.25.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.24.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.24.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.24.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.24.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.24.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.24.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.24.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.23.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.23.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.23.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.23.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.23.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.23.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.23.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.22.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.22.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.22.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.22.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.22.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.22.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.22.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.21.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.21.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.21.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.21.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.21.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.21.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.21.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.20.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.20.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.20.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.20.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.20.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.20.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.20.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.19.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.19.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.19.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.19.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.19.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.19.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.19.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.18.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.18.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.18.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.18.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.18.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.18.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.18.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.17.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.17.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.17.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.17.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.17.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.17.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.17.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.16.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.16.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.16.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.16.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.16.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.16.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.16.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.15.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.15.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.15.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.15.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.15.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.15.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.15.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.14.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.14.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.14.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.14.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.14.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.14.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.14.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.13.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.13.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.13.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.13.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.13.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.13.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.13.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.12.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.12.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.12.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.12.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.12.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.12.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.12.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.11.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.11.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.11.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.11.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.11.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.11.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.11.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.10.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.10.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.10.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.10.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.10.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.10.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.10.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.9.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.9.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.9.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.9.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.9.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.9.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.9.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.8.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.8.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.8.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.8.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.8.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.8.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.8.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.7.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.7.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.7.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.7.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.7.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.7.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.7.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.6.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.6.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.6.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.6.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.6.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.6.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.6.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.5.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.5.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.5.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.5.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.5.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.5.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.5.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.4.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.4.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.4.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.4.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.4.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.4.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.4.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.3.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.3.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.3.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.3.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.3.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.3.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.3.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.2.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.2.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.2.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.2.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.2.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.2.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.2.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.1.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.1.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.1.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.1.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.1.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.1.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.1.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.0.mlp.up_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.0.mlp.down_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.0.mlp.gate_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.0.self_attn.o_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.0.self_attn.v_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.0.self_attn.k_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.layers.0.self_attn.q_proj",
+      "bits": 8,
+      "group_size": 64
+    },
+    {
+      "name": "t3.tfmr.model.embed_tokens",
+      "bits": 8,
+      "group_size": 64
+    }
+  ],
+  "reference_sha256": "ace8518ab1d3b45e702a4c54700cab378a3d6e8172dfa8cd3dd51d8e176cfac3",
+  "versions": {
+    "mlx": "0.32.3",
+    "mlx-audio": "0.5.7",
+    "numpy": "2.4.6",
+    "soundfile": "0.14.0",
+    "huggingface-hub": "1.33.0"
+  },
+  "rows": [
+    {
+      "variant": "q8",
+      "prompt": 0,
+      "lang": "en",
+      "text": "The weather is pleasant today, and I am going for a walk.",
+      "seed": 42,
+      "generation_s": 2.410087125001155,
+      "started_at": 1791505134.849065,
+      "finished_at": 1791505137.25908,
+      "audio_s": 3.2,
+      "rtf": 0.753152226562861,
+      "cpu_s": 0.7350559999999999,
+      "cpu_pct_one_core": 30.499146374206184,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2046074632,
+      "rms": 0.07169970870018005,
+      "peak_amplitude": 0.45490917563438416,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "0151c66eaec14dcf4bf20af14bf0953fda067ff078752d66aba46a15842af565",
+      "file": "q8-0-42.wav"
+    },
+    {
+      "variant": "q8",
+      "prompt": 0,
+      "lang": "en",
+      "text": "The weather is pleasant today, and I am going for a walk.",
+      "seed": 123,
+      "generation_s": 2.3017851669992524,
+      "started_at": 1791505137.262146,
+      "finished_at": 1791505139.563863,
+      "audio_s": 2.96,
+      "rtf": 0.7776301239862339,
+      "cpu_s": 0.7007829999999999,
+      "cpu_pct_one_core": 30.445195757064656,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2019792972,
+      "rms": 0.07119143009185791,
+      "peak_amplitude": 0.5510453581809998,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "69be94fef8d519f7f144a9b4b4dac92be5fc4dd27e92a94f74f3658bf66d8058",
+      "file": "q8-0-123.wav"
+    },
+    {
+      "variant": "q8",
+      "prompt": 1,
+      "lang": "es",
+      "text": "Hoy hace buen tiempo y voy a salir a caminar por el parque.",
+      "seed": 42,
+      "generation_s": 2.4547663329994975,
+      "started_at": 1791505139.567431,
+      "finished_at": 1791505142.022123,
+      "audio_s": 3.24,
+      "rtf": 0.7576439299381165,
+      "cpu_s": 0.7590430000000001,
+      "cpu_pct_one_core": 30.921191552782936,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2050595820,
+      "rms": 0.07512058317661285,
+      "peak_amplitude": 0.5246090292930603,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "80834d33d4ab34150b823535f9def51eb383512cd0413c5e8260551b75052d9f",
+      "file": "q8-1-42.wav"
+    },
+    {
+      "variant": "q8",
+      "prompt": 1,
+      "lang": "es",
+      "text": "Hoy hace buen tiempo y voy a salir a caminar por el parque.",
+      "seed": 123,
+      "generation_s": 2.430637665998802,
+      "started_at": 1791505142.025152,
+      "finished_at": 1791505144.455717,
+      "audio_s": 3.2,
+      "rtf": 0.7595742706246256,
+      "cpu_s": 0.7468080000000001,
+      "cpu_pct_one_core": 30.724776894836793,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2046074632,
+      "rms": 0.07304202765226364,
+      "peak_amplitude": 0.4615444839000702,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "1fe91d76e1d41b481051090b6340ff8ed82d770925b6974df0c46273b78cd0a3",
+      "file": "q8-1-123.wav"
+    },
+    {
+      "variant": "q8",
+      "prompt": 2,
+      "lang": "en",
+      "text": "Could you check the microphone and tell me whether the sound is clear?",
+      "seed": 42,
+      "generation_s": 2.4078367499987507,
+      "started_at": 1791505144.458978,
+      "finished_at": 1791505146.866743,
+      "audio_s": 3.16,
+      "rtf": 0.7619736550628958,
+      "cpu_s": 0.7378610000000005,
+      "cpu_pct_one_core": 30.644145621599282,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2042977776,
+      "rms": 0.06565575301647186,
+      "peak_amplitude": 0.3712776005268097,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "d2de901e98a5803143051e1eb84ab536f496535ab0042d7c0aab7556db03a9dc",
+      "file": "q8-2-42.wav"
+    },
+    {
+      "variant": "q8",
+      "prompt": 2,
+      "lang": "en",
+      "text": "Could you check the microphone and tell me whether the sound is clear?",
+      "seed": 123,
+      "generation_s": 2.526483958999961,
+      "started_at": 1791505146.869868,
+      "finished_at": 1791505149.396276,
+      "audio_s": 3.4,
+      "rtf": 0.7430835173529298,
+      "cpu_s": 0.7780389999999997,
+      "cpu_pct_one_core": 30.795327127585047,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2068062295,
+      "rms": 0.06359126418828964,
+      "peak_amplitude": 0.4829810559749603,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "27e9fcb37366fcf5a619021cbf7ec83535969dacf5cbde34518d821e9d89e589",
+      "file": "q8-2-123.wav"
+    },
+    {
+      "variant": "q8",
+      "prompt": 3,
+      "lang": "es",
+      "text": "¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?",
+      "seed": 42,
+      "generation_s": 2.7936957919991983,
+      "started_at": 1791505149.399251,
+      "finished_at": 1791505152.192863,
+      "audio_s": 3.92,
+      "rtf": 0.7126774979589792,
+      "cpu_s": 0.9963949999999997,
+      "cpu_pct_one_core": 35.66583744921522,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2124378004,
+      "rms": 0.07724740356206894,
+      "peak_amplitude": 0.48256468772888184,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "85e572a6f4f97166b56f7b51d9dfca3aac4d69f8daeecc6d952ad8d6b39bfe63",
+      "file": "q8-3-42.wav"
+    },
+    {
+      "variant": "q8",
+      "prompt": 3,
+      "lang": "es",
+      "text": "¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?",
+      "seed": 123,
+      "generation_s": 2.6862090829999943,
+      "started_at": 1791505152.199163,
+      "finished_at": 1791505154.88529,
+      "audio_s": 3.72,
+      "rtf": 0.7220992158602135,
+      "cpu_s": 0.8049090000000003,
+      "cpu_pct_one_core": 29.964495507589724,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2103160055,
+      "rms": 0.0632360428571701,
+      "peak_amplitude": 0.3179806172847748,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "e79a8daf137b63dad2ecf845827167e5a64eebcfaac75bb06959bd401bd94431",
+      "file": "q8-3-123.wav"
+    },
+    {
+      "variant": "q8",
+      "prompt": 4,
+      "lang": "en",
+      "text": "We tested the smaller model twice, and saved both recordings for comparison.",
+      "seed": 42,
+      "generation_s": 2.8024199579995184,
+      "started_at": 1791505154.8888168,
+      "finished_at": 1791505157.6911511,
+      "audio_s": 4.08,
+      "rtf": 0.6868676367645878,
+      "cpu_s": 0.9096489999999999,
+      "cpu_pct_one_core": 32.45941056776317,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2142073736,
+      "rms": 0.07593627274036407,
+      "peak_amplitude": 0.5589218735694885,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "5c3f587fad416ed6a7aa0f859f9ab3663aee51f8900e1a49ebe1bbd8e0068dd5",
+      "file": "q8-4-42.wav"
+    },
+    {
+      "variant": "q8",
+      "prompt": 4,
+      "lang": "en",
+      "text": "We tested the smaller model twice, and saved both recordings for comparison.",
+      "seed": 123,
+      "generation_s": 2.8889624580006057,
+      "started_at": 1791505157.695009,
+      "finished_at": 1791505160.583884,
+      "audio_s": 4.12,
+      "rtf": 0.7012044800972344,
+      "cpu_s": 0.9068909999999999,
+      "cpu_pct_one_core": 31.39158134396947,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2148645176,
+      "rms": 0.08423066884279251,
+      "peak_amplitude": 0.7980673909187317,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "59fbe885cbd7be4e46d3e41ee3608273215c379248ae644da71d9d3e6925bfe8",
+      "file": "q8-4-123.wav"
+    },
+    {
+      "variant": "q8",
+      "prompt": 5,
+      "lang": "es",
+      "text": "Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.",
+      "seed": 42,
+      "generation_s": 2.948882083999706,
+      "started_at": 1791505160.588416,
+      "finished_at": 1791505163.5372071,
+      "audio_s": 4.2,
+      "rtf": 0.7021147819046919,
+      "cpu_s": 0.9138099999999998,
+      "cpu_pct_one_core": 30.988353347806864,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2156804643,
+      "rms": 0.07882370799779892,
+      "peak_amplitude": 0.612423837184906,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "927b24cc5d84e7ca30e41cd9f640a32119e328d006736920eae36039c99393d3",
+      "file": "q8-5-42.wav"
+    },
+    {
+      "variant": "q8",
+      "prompt": 5,
+      "lang": "es",
+      "text": "Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.",
+      "seed": 123,
+      "generation_s": 3.0156151669998508,
+      "started_at": 1791505163.5410402,
+      "finished_at": 1791505166.5565639,
+      "audio_s": 4.4,
+      "rtf": 0.6853670834090569,
+      "cpu_s": 0.9809570000000001,
+      "cpu_pct_one_core": 32.52925010905573,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2178365728,
+      "rms": 0.08412422984838486,
+      "peak_amplitude": 0.7121328711509705,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "8438d762deb44cc656c348b53d2cf0c9b220bc84f41606af5fc8eaa7e07d6c0b",
+      "file": "q8-5-123.wav"
+    }
+  ]
+}

evaluation/rebuild-validation.json

@@ -0,0 +1,13 @@
+{
+  "original_sha256": "aa938735e36edfa807531d274baa608ec168f8f06ad6c835a3c4071effcf172e",
+  "rebuilt_sha256": "aa938735e36edfa807531d274baa608ec168f8f06ad6c835a3c4071effcf172e",
+  "byte_identical": true,
+  "recipe": "quantize_q8.py",
+  "versions": {
+    "mlx": "0.32.3",
+    "mlx-audio": "0.5.7",
+    "numpy": "2.4.6",
+    "soundfile": "0.14.0",
+    "huggingface-hub": "1.33.0"
+  }
+}

evaluation/results.csv

@@ -0,0 +1,25 @@
+variant,prompt,lang,text,seed,generation_s,started_at,finished_at,audio_s,rtf,cpu_s,cpu_pct_one_core,process_peak_rss_bytes,mlx_peak_bytes,rms,peak_amplitude,clipped_fraction,audio_sha256,file,transcript,word_edits,substitutions,deletions,insertions,reference_words,wer
+fp32,0,en,"The weather is pleasant today, and I am going for a walk.",42,3.1965204579992132,1791505087.485913,1791505090.68248,3.04,1.0514869927628991,0.7317990000000001,22.893612276708293,3463380992,4345317492,0.07403168827295303,0.4069647789001465,0.0,64007babd631a940eae8ca91abec17aae1c70cd35dae16d7ab35575966bb027a,fp32-0-42.wav,The weather is pleasant today and I'm going for a walk.,2,1,1,0,12,0.16666666666666666
+fp32,0,en,"The weather is pleasant today, and I am going for a walk.",123,3.0633785410009295,1791505090.684835,1791505093.748255,2.84,1.0786544158453977,0.6330870000000002,20.66630001897007,3463512064,4322116548,0.06872081756591797,0.4245677888393402,0.0,1f527123d71a467235b096f6d089d8da50c33a9ba9fab13118118da0b382b3cb,fp32-0-123.wav,The weather is pleasant today and I am going for a walk.,0,0,0,0,12,0.0
+fp32,1,es,Hoy hace buen tiempo y voy a salir a caminar por el parque.,42,3.6277591250000114,1791505093.749502,1791505097.377311,3.08,1.1778438717532504,1.217866,33.570751475954076,3463544832,4351905580,0.07840348035097122,0.4688829183578491,0.0,3d0606768bff683048a5a912f0d141b24951e9616440f5b02379986555f1945f,fp32-1-42.wav,Hoy hace buen tiempo y voy a salir a caminar por el parque.,0,0,0,0,13,0.0
+fp32,1,es,Hoy hace buen tiempo y voy a salir a caminar por el parque.,123,3.964549750000515,1791505097.378741,1791505101.3433459,3.48,1.139238433908194,1.3446109999999996,33.915856397055556,3463544832,4401863908,0.0745975524187088,0.49563872814178467,0.0,0ab2af738e3bf675cc1b0fe92caf8207c09814bc589e0b187ebc04047b0f8e03,fp32-1-123.wav,Hoy hace buen tiempo y voy a salir a caminar por el parque.,0,0,0,0,13,0.0
+fp32,2,en,Could you check the microphone and tell me whether the sound is clear?,42,3.2237355840006785,1791505101.345545,1791505104.5693262,3.12,1.033248584615602,0.7545999999999999,23.407626969937034,3463544832,4354393232,0.0651380643248558,0.5876898765563965,0.0,4585b93dc0be3e79bd1c5850086b1bca653e6279027ce786cb5dcb83c2b06662,fp32-2-42.wav,Could you check the microphone and tell me whether the sound is clear?,0,0,0,0,13,0.0
+fp32,2,en,Could you check the microphone and tell me whether the sound is clear?,123,3.125938209001106,1791505104.571863,1791505107.697845,2.92,1.0705267839044883,0.612603,19.597412330033144,3463757824,4332290508,0.05791015177965164,0.3281961679458618,0.0,cb3682f0f4e09b91a6dbc214bf8d7fff96d63ec3e6ae6dd071242022e6085224,fp32-2-123.wav,Could you check the microphone and tell me whether the sound is kid?,1,1,0,0,13,0.07692307692307693
+fp32,3,es,¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?,42,4.158612834000451,1791505107.699348,1791505111.858019,3.76,1.1060140515958645,1.6599370000000002,39.91564173583321,3463888896,4435468468,0.07013692706823349,0.49748122692108154,0.0,f643c084636fd77e71ddf0b0ea3bd1293a73020bcec716dad22f697eb2adb4d2,fp32-3-42.wav,¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?,0,0,0,0,12,0.0
+fp32,3,es,¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?,123,3.7025962919997255,1791505111.860312,1791505115.5629609,3.68,1.0061402967390558,0.8157210000000017,22.03105431079663,3463888896,4426045692,0.06872870773077011,0.3373930752277374,0.0,f9104434605f2d430389f7a3c278854ee89fb263f8ab28956106062ecc6363bc,fp32-3-123.wav,¿Podés revisar el micrófono y decirme si mi voz escucha claramente?,1,0,1,0,12,0.08333333333333333
+fp32,4,en,"We tested the smaller model twice, and saved both recordings for comparison.",42,4.000432833001469,1791505115.565877,1791505119.566365,4.04,0.9902061467825417,0.8506999999999998,21.265198930030067,3463921664,4474547224,0.07948584854602814,0.5621404647827148,0.0,87164016136e0e2ce4683b9035903b1ed17bb41b18022e100f8a7e029bdef6d4,fp32-4-42.wav,We test the smaller model twice and save both recording for comparison.,3,3,0,0,12,0.25
+fp32,4,en,"We tested the smaller model twice, and saved both recordings for comparison.",123,3.9630061669995484,1791505119.569291,1791505123.53235,4.08,0.9713250409312618,0.790343,19.943017161600345,3464183808,4476951344,0.07089035212993622,0.534336507320404,0.0,5b16450d839fbc974dad48f8745f57e3b54b68458919359184f9e82fea500743,fp32-4-123.wav,"We test the smaller model twice, and save Boss Recording for comparison.",4,4,0,0,12,0.3333333333333333
+fp32,5,es,Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.,42,4.196048207999411,1791505123.5343418,1791505127.7304478,4.32,0.9713074555554191,0.8885400000000008,21.17563850448797,3464282112,4506407736,0.08085767179727554,0.7336018681526184,0.0,8c8a9a7cadd59754de7d28bc2c8203234edc99eb462e80da16acf613c269df40,fp32-5-42.wav,Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.,0,0,0,0,13,0.0
+fp32,5,es,Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.,123,4.19392358299956,1791505127.732991,1791505131.71377,4.28,0.9798886876167194,0.9046869999999991,21.571375398140965,3464740864,4506837580,0.08112484961748123,0.6759235858917236,0.0,fefb05967eede4ab9c2d3e2d82a761f425ab9619f2d8258c878fef31598c0f8d,fp32-5-123.wav,Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.,0,0,0,0,13,0.0
+q8,0,en,"The weather is pleasant today, and I am going for a walk.",42,2.410087125001155,1791505134.849065,1791505137.25908,3.2,0.753152226562861,0.7350559999999999,30.499146374206184,1622228992,2046074632,0.07169970870018005,0.45490917563438416,0.0,0151c66eaec14dcf4bf20af14bf0953fda067ff078752d66aba46a15842af565,q8-0-42.wav,The weather is pleasant today and I am going for a walk.,0,0,0,0,12,0.0
+q8,0,en,"The weather is pleasant today, and I am going for a walk.",123,2.3017851669992524,1791505137.262146,1791505139.563863,2.96,0.7776301239862339,0.7007829999999999,30.445195757064656,1622228992,2019792972,0.07119143009185791,0.5510453581809998,0.0,69be94fef8d519f7f144a9b4b4dac92be5fc4dd27e92a94f74f3658bf66d8058,q8-0-123.wav,The weather is pleasant today and I'm going for a walk.,2,1,1,0,12,0.16666666666666666
+q8,1,es,Hoy hace buen tiempo y voy a salir a caminar por el parque.,42,2.4547663329994975,1791505139.567431,1791505142.022123,3.24,0.7576439299381165,0.7590430000000001,30.921191552782936,1622228992,2050595820,0.07512058317661285,0.5246090292930603,0.0,80834d33d4ab34150b823535f9def51eb383512cd0413c5e8260551b75052d9f,q8-1-42.wav,Hoy hace buen tiempo y voy a salir a caminar por el parque.,0,0,0,0,13,0.0
+q8,1,es,Hoy hace buen tiempo y voy a salir a caminar por el parque.,123,2.430637665998802,1791505142.025152,1791505144.455717,3.2,0.7595742706246256,0.7468080000000001,30.724776894836793,1622228992,2046074632,0.07304202765226364,0.4615444839000702,0.0,1fe91d76e1d41b481051090b6340ff8ed82d770925b6974df0c46273b78cd0a3,q8-1-123.wav,Hoy hace buen tiempo y voy a salir a caminar por el parque.,0,0,0,0,13,0.0
+q8,2,en,Could you check the microphone and tell me whether the sound is clear?,42,2.4078367499987507,1791505144.458978,1791505146.866743,3.16,0.7619736550628958,0.7378610000000005,30.644145621599282,1622228992,2042977776,0.06565575301647186,0.3712776005268097,0.0,d2de901e98a5803143051e1eb84ab536f496535ab0042d7c0aab7556db03a9dc,q8-2-42.wav,Could you check the microphone and tell me whether the sound is clear?,0,0,0,0,13,0.0
+q8,2,en,Could you check the microphone and tell me whether the sound is clear?,123,2.526483958999961,1791505146.869868,1791505149.396276,3.4,0.7430835173529298,0.7780389999999997,30.795327127585047,1622228992,2068062295,0.06359126418828964,0.4829810559749603,0.0,27e9fcb37366fcf5a619021cbf7ec83535969dacf5cbde34518d821e9d89e589,q8-2-123.wav,Could you check the microphone and tell me whether the sound is clear?,0,0,0,0,13,0.0
+q8,3,es,¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?,42,2.7936957919991983,1791505149.399251,1791505152.192863,3.92,0.7126774979589792,0.9963949999999997,35.66583744921522,1622228992,2124378004,0.07724740356206894,0.48256468772888184,0.0,85e572a6f4f97166b56f7b51d9dfca3aac4d69f8daeecc6d952ad8d6b39bfe63,q8-3-42.wav,¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?,0,0,0,0,12,0.0
+q8,3,es,¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?,123,2.6862090829999943,1791505152.199163,1791505154.88529,3.72,0.7220992158602135,0.8049090000000003,29.964495507589724,1622228992,2103160055,0.0632360428571701,0.3179806172847748,0.0,e79a8daf137b63dad2ecf845827167e5a64eebcfaac75bb06959bd401bd94431,q8-3-123.wav,¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?,0,0,0,0,12,0.0
+q8,4,en,"We tested the smaller model twice, and saved both recordings for comparison.",42,2.8024199579995184,1791505154.8888168,1791505157.6911511,4.08,0.6868676367645878,0.9096489999999999,32.45941056776317,1622228992,2142073736,0.07593627274036407,0.5589218735694885,0.0,5c3f587fad416ed6a7aa0f859f9ab3663aee51f8900e1a49ebe1bbd8e0068dd5,q8-4-42.wav,We test the smaller model twice and save Boss Recording for comparison.,4,4,0,0,12,0.3333333333333333
+q8,4,en,"We tested the smaller model twice, and saved both recordings for comparison.",123,2.8889624580006057,1791505157.695009,1791505160.583884,4.12,0.7012044800972344,0.9068909999999999,31.39158134396947,1622228992,2148645176,0.08423066884279251,0.7980673909187317,0.0,59fbe885cbd7be4e46d3e41ee3608273215c379248ae644da71d9d3e6925bfe8,q8-4-123.wav,"We test the smaller model twice, and save voice recording for comparison.",4,4,0,0,12,0.3333333333333333
+q8,5,es,Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.,42,2.948882083999706,1791505160.588416,1791505163.5372071,4.2,0.7021147819046919,0.9138099999999998,30.988353347806864,1622228992,2156804643,0.07882370799779892,0.612423837184906,0.0,927b24cc5d84e7ca30e41cd9f640a32119e328d006736920eae36039c99393d3,q8-5-42.wav,Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.,0,0,0,0,13,0.0
+q8,5,es,Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.,123,3.0156151669998508,1791505163.5410402,1791505166.5565639,4.4,0.6853670834090569,0.9809570000000001,32.52925010905573,1622228992,2178365728,0.08412422984838486,0.7121328711509705,0.0,8438d762deb44cc656c348b53d2cf0c9b220bc84f41606af5fc8eaa7e07d6c0b,q8-5-123.wav,Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.,0,0,0,0,13,0.0

evaluation/results.json

@@ -0,0 +1,900 @@
+{
+  "summary": {
+    "fp32": {
+      "main_checkpoint_bytes": 2711113780,
+      "load_s": 0.6741061250013445,
+      "conditioning_s": 0.1307210409995605,
+      "warmup_s": 2.4151600410004903,
+      "mean_generation_s": 3.701375132000218,
+      "aggregate_rtf": 1.0416627951220125,
+      "mean_audio_s": 3.5533333333333332,
+      "process_peak_rss_gib": 3.2267913818359375,
+      "mlx_peak_gib": 4.197319578379393,
+      "mean_cpu_pct_one_core": 24.99612379246228,
+      "pooled_word_edits": 11,
+      "reference_words": 150,
+      "pooled_wer": 0.07333333333333333,
+      "mean_chip_watts_during_generation": 6.148679065307085,
+      "estimated_chip_joules_sampled_generation": 270.31478564834595,
+      "power_coverage_s": 43.9630663394928,
+      "total_generation_s": 44.41650158400262,
+      "thermal_levels": [
+        "Nominal"
+      ],
+      "languages": {
+        "en": {
+          "wer": 0.13513513513513514,
+          "rtf": 1.0265973948105263
+        },
+        "es": {
+          "wer": 0.013157894736842105,
+          "rtf": 1.0550216722123749
+        }
+      }
+    },
+    "q8": {
+      "main_checkpoint_bytes": 877793962,
+      "load_s": 0.5469651250004972,
+      "conditioning_s": 0.13102108299972315,
+      "warmup_s": 1.7207783329995436,
+      "mean_generation_s": 2.6389484618330243,
+      "aggregate_rtf": 0.7263160904127591,
+      "mean_audio_s": 3.6333333333333333,
+      "process_peak_rss_gib": 1.5108184814453125,
+      "mlx_peak_gib": 2.028761178255081,
+      "mean_cpu_pct_one_core": 31.419059304456255,
+      "pooled_word_edits": 10,
+      "reference_words": 150,
+      "pooled_wer": 0.06666666666666667,
+      "mean_chip_watts_during_generation": 7.790531709632261,
+      "estimated_chip_joules_sampled_generation": 244.50865531969072,
+      "power_coverage_s": 31.385361671447754,
+      "total_generation_s": 31.667381541996292,
+      "thermal_levels": [
+        "Nominal"
+      ],
+      "languages": {
+        "en": {
+          "wer": 0.13513513513513514,
+          "rtf": 0.7331537006213786
+        },
+        "es": {
+          "wer": 0.0,
+          "rtf": 0.72000908840375
+        }
+      }
+    }
+  },
+  "rows": [
+    {
+      "variant": "fp32",
+      "prompt": 0,
+      "lang": "en",
+      "text": "The weather is pleasant today, and I am going for a walk.",
+      "seed": 42,
+      "generation_s": 3.1965204579992132,
+      "started_at": 1791505087.485913,
+      "finished_at": 1791505090.68248,
+      "audio_s": 3.04,
+      "rtf": 1.0514869927628991,
+      "cpu_s": 0.7317990000000001,
+      "cpu_pct_one_core": 22.893612276708293,
+      "process_peak_rss_bytes": 3463380992,
+      "mlx_peak_bytes": 4345317492,
+      "rms": 0.07403168827295303,
+      "peak_amplitude": 0.4069647789001465,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "64007babd631a940eae8ca91abec17aae1c70cd35dae16d7ab35575966bb027a",
+      "file": "fp32-0-42.wav",
+      "transcript": "The weather is pleasant today and I'm going for a walk.",
+      "word_edits": 2,
+      "substitutions": 1,
+      "deletions": 1,
+      "insertions": 0,
+      "reference_words": 12,
+      "wer": 0.16666666666666666
+    },
+    {
+      "variant": "fp32",
+      "prompt": 0,
+      "lang": "en",
+      "text": "The weather is pleasant today, and I am going for a walk.",
+      "seed": 123,
+      "generation_s": 3.0633785410009295,
+      "started_at": 1791505090.684835,
+      "finished_at": 1791505093.748255,
+      "audio_s": 2.84,
+      "rtf": 1.0786544158453977,
+      "cpu_s": 0.6330870000000002,
+      "cpu_pct_one_core": 20.66630001897007,
+      "process_peak_rss_bytes": 3463512064,
+      "mlx_peak_bytes": 4322116548,
+      "rms": 0.06872081756591797,
+      "peak_amplitude": 0.4245677888393402,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "1f527123d71a467235b096f6d089d8da50c33a9ba9fab13118118da0b382b3cb",
+      "file": "fp32-0-123.wav",
+      "transcript": "The weather is pleasant today and I am going for a walk.",
+      "word_edits": 0,
+      "substitutions": 0,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 12,
+      "wer": 0.0
+    },
+    {
+      "variant": "fp32",
+      "prompt": 1,
+      "lang": "es",
+      "text": "Hoy hace buen tiempo y voy a salir a caminar por el parque.",
+      "seed": 42,
+      "generation_s": 3.6277591250000114,
+      "started_at": 1791505093.749502,
+      "finished_at": 1791505097.377311,
+      "audio_s": 3.08,
+      "rtf": 1.1778438717532504,
+      "cpu_s": 1.217866,
+      "cpu_pct_one_core": 33.570751475954076,
+      "process_peak_rss_bytes": 3463544832,
+      "mlx_peak_bytes": 4351905580,
+      "rms": 0.07840348035097122,
+      "peak_amplitude": 0.4688829183578491,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "3d0606768bff683048a5a912f0d141b24951e9616440f5b02379986555f1945f",
+      "file": "fp32-1-42.wav",
+      "transcript": "Hoy hace buen tiempo y voy a salir a caminar por el parque.",
+      "word_edits": 0,
+      "substitutions": 0,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 13,
+      "wer": 0.0
+    },
+    {
+      "variant": "fp32",
+      "prompt": 1,
+      "lang": "es",
+      "text": "Hoy hace buen tiempo y voy a salir a caminar por el parque.",
+      "seed": 123,
+      "generation_s": 3.964549750000515,
+      "started_at": 1791505097.378741,
+      "finished_at": 1791505101.3433459,
+      "audio_s": 3.48,
+      "rtf": 1.139238433908194,
+      "cpu_s": 1.3446109999999996,
+      "cpu_pct_one_core": 33.915856397055556,
+      "process_peak_rss_bytes": 3463544832,
+      "mlx_peak_bytes": 4401863908,
+      "rms": 0.0745975524187088,
+      "peak_amplitude": 0.49563872814178467,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "0ab2af738e3bf675cc1b0fe92caf8207c09814bc589e0b187ebc04047b0f8e03",
+      "file": "fp32-1-123.wav",
+      "transcript": "Hoy hace buen tiempo y voy a salir a caminar por el parque.",
+      "word_edits": 0,
+      "substitutions": 0,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 13,
+      "wer": 0.0
+    },
+    {
+      "variant": "fp32",
+      "prompt": 2,
+      "lang": "en",
+      "text": "Could you check the microphone and tell me whether the sound is clear?",
+      "seed": 42,
+      "generation_s": 3.2237355840006785,
+      "started_at": 1791505101.345545,
+      "finished_at": 1791505104.5693262,
+      "audio_s": 3.12,
+      "rtf": 1.033248584615602,
+      "cpu_s": 0.7545999999999999,
+      "cpu_pct_one_core": 23.407626969937034,
+      "process_peak_rss_bytes": 3463544832,
+      "mlx_peak_bytes": 4354393232,
+      "rms": 0.0651380643248558,
+      "peak_amplitude": 0.5876898765563965,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "4585b93dc0be3e79bd1c5850086b1bca653e6279027ce786cb5dcb83c2b06662",
+      "file": "fp32-2-42.wav",
+      "transcript": "Could you check the microphone and tell me whether the sound is clear?",
+      "word_edits": 0,
+      "substitutions": 0,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 13,
+      "wer": 0.0
+    },
+    {
+      "variant": "fp32",
+      "prompt": 2,
+      "lang": "en",
+      "text": "Could you check the microphone and tell me whether the sound is clear?",
+      "seed": 123,
+      "generation_s": 3.125938209001106,
+      "started_at": 1791505104.571863,
+      "finished_at": 1791505107.697845,
+      "audio_s": 2.92,
+      "rtf": 1.0705267839044883,
+      "cpu_s": 0.612603,
+      "cpu_pct_one_core": 19.597412330033144,
+      "process_peak_rss_bytes": 3463757824,
+      "mlx_peak_bytes": 4332290508,
+      "rms": 0.05791015177965164,
+      "peak_amplitude": 0.3281961679458618,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "cb3682f0f4e09b91a6dbc214bf8d7fff96d63ec3e6ae6dd071242022e6085224",
+      "file": "fp32-2-123.wav",
+      "transcript": "Could you check the microphone and tell me whether the sound is kid?",
+      "word_edits": 1,
+      "substitutions": 1,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 13,
+      "wer": 0.07692307692307693
+    },
+    {
+      "variant": "fp32",
+      "prompt": 3,
+      "lang": "es",
+      "text": "¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?",
+      "seed": 42,
+      "generation_s": 4.158612834000451,
+      "started_at": 1791505107.699348,
+      "finished_at": 1791505111.858019,
+      "audio_s": 3.76,
+      "rtf": 1.1060140515958645,
+      "cpu_s": 1.6599370000000002,
+      "cpu_pct_one_core": 39.91564173583321,
+      "process_peak_rss_bytes": 3463888896,
+      "mlx_peak_bytes": 4435468468,
+      "rms": 0.07013692706823349,
+      "peak_amplitude": 0.49748122692108154,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "f643c084636fd77e71ddf0b0ea3bd1293a73020bcec716dad22f697eb2adb4d2",
+      "file": "fp32-3-42.wav",
+      "transcript": "¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?",
+      "word_edits": 0,
+      "substitutions": 0,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 12,
+      "wer": 0.0
+    },
+    {
+      "variant": "fp32",
+      "prompt": 3,
+      "lang": "es",
+      "text": "¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?",
+      "seed": 123,
+      "generation_s": 3.7025962919997255,
+      "started_at": 1791505111.860312,
+      "finished_at": 1791505115.5629609,
+      "audio_s": 3.68,
+      "rtf": 1.0061402967390558,
+      "cpu_s": 0.8157210000000017,
+      "cpu_pct_one_core": 22.03105431079663,
+      "process_peak_rss_bytes": 3463888896,
+      "mlx_peak_bytes": 4426045692,
+      "rms": 0.06872870773077011,
+      "peak_amplitude": 0.3373930752277374,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "f9104434605f2d430389f7a3c278854ee89fb263f8ab28956106062ecc6363bc",
+      "file": "fp32-3-123.wav",
+      "transcript": "¿Podés revisar el micrófono y decirme si mi voz escucha claramente?",
+      "word_edits": 1,
+      "substitutions": 0,
+      "deletions": 1,
+      "insertions": 0,
+      "reference_words": 12,
+      "wer": 0.08333333333333333
+    },
+    {
+      "variant": "fp32",
+      "prompt": 4,
+      "lang": "en",
+      "text": "We tested the smaller model twice, and saved both recordings for comparison.",
+      "seed": 42,
+      "generation_s": 4.000432833001469,
+      "started_at": 1791505115.565877,
+      "finished_at": 1791505119.566365,
+      "audio_s": 4.04,
+      "rtf": 0.9902061467825417,
+      "cpu_s": 0.8506999999999998,
+      "cpu_pct_one_core": 21.265198930030067,
+      "process_peak_rss_bytes": 3463921664,
+      "mlx_peak_bytes": 4474547224,
+      "rms": 0.07948584854602814,
+      "peak_amplitude": 0.5621404647827148,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "87164016136e0e2ce4683b9035903b1ed17bb41b18022e100f8a7e029bdef6d4",
+      "file": "fp32-4-42.wav",
+      "transcript": "We test the smaller model twice and save both recording for comparison.",
+      "word_edits": 3,
+      "substitutions": 3,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 12,
+      "wer": 0.25
+    },
+    {
+      "variant": "fp32",
+      "prompt": 4,
+      "lang": "en",
+      "text": "We tested the smaller model twice, and saved both recordings for comparison.",
+      "seed": 123,
+      "generation_s": 3.9630061669995484,
+      "started_at": 1791505119.569291,
+      "finished_at": 1791505123.53235,
+      "audio_s": 4.08,
+      "rtf": 0.9713250409312618,
+      "cpu_s": 0.790343,
+      "cpu_pct_one_core": 19.943017161600345,
+      "process_peak_rss_bytes": 3464183808,
+      "mlx_peak_bytes": 4476951344,
+      "rms": 0.07089035212993622,
+      "peak_amplitude": 0.534336507320404,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "5b16450d839fbc974dad48f8745f57e3b54b68458919359184f9e82fea500743",
+      "file": "fp32-4-123.wav",
+      "transcript": "We test the smaller model twice, and save Boss Recording for comparison.",
+      "word_edits": 4,
+      "substitutions": 4,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 12,
+      "wer": 0.3333333333333333
+    },
+    {
+      "variant": "fp32",
+      "prompt": 5,
+      "lang": "es",
+      "text": "Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.",
+      "seed": 42,
+      "generation_s": 4.196048207999411,
+      "started_at": 1791505123.5343418,
+      "finished_at": 1791505127.7304478,
+      "audio_s": 4.32,
+      "rtf": 0.9713074555554191,
+      "cpu_s": 0.8885400000000008,
+      "cpu_pct_one_core": 21.17563850448797,
+      "process_peak_rss_bytes": 3464282112,
+      "mlx_peak_bytes": 4506407736,
+      "rms": 0.08085767179727554,
+      "peak_amplitude": 0.7336018681526184,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "8c8a9a7cadd59754de7d28bc2c8203234edc99eb462e80da16acf613c269df40",
+      "file": "fp32-5-42.wav",
+      "transcript": "Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.",
+      "word_edits": 0,
+      "substitutions": 0,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 13,
+      "wer": 0.0
+    },
+    {
+      "variant": "fp32",
+      "prompt": 5,
+      "lang": "es",
+      "text": "Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.",
+      "seed": 123,
+      "generation_s": 4.19392358299956,
+      "started_at": 1791505127.732991,
+      "finished_at": 1791505131.71377,
+      "audio_s": 4.28,
+      "rtf": 0.9798886876167194,
+      "cpu_s": 0.9046869999999991,
+      "cpu_pct_one_core": 21.571375398140965,
+      "process_peak_rss_bytes": 3464740864,
+      "mlx_peak_bytes": 4506837580,
+      "rms": 0.08112484961748123,
+      "peak_amplitude": 0.6759235858917236,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "fefb05967eede4ab9c2d3e2d82a761f425ab9619f2d8258c878fef31598c0f8d",
+      "file": "fp32-5-123.wav",
+      "transcript": "Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.",
+      "word_edits": 0,
+      "substitutions": 0,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 13,
+      "wer": 0.0
+    },
+    {
+      "variant": "q8",
+      "prompt": 0,
+      "lang": "en",
+      "text": "The weather is pleasant today, and I am going for a walk.",
+      "seed": 42,
+      "generation_s": 2.410087125001155,
+      "started_at": 1791505134.849065,
+      "finished_at": 1791505137.25908,
+      "audio_s": 3.2,
+      "rtf": 0.753152226562861,
+      "cpu_s": 0.7350559999999999,
+      "cpu_pct_one_core": 30.499146374206184,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2046074632,
+      "rms": 0.07169970870018005,
+      "peak_amplitude": 0.45490917563438416,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "0151c66eaec14dcf4bf20af14bf0953fda067ff078752d66aba46a15842af565",
+      "file": "q8-0-42.wav",
+      "transcript": "The weather is pleasant today and I am going for a walk.",
+      "word_edits": 0,
+      "substitutions": 0,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 12,
+      "wer": 0.0
+    },
+    {
+      "variant": "q8",
+      "prompt": 0,
+      "lang": "en",
+      "text": "The weather is pleasant today, and I am going for a walk.",
+      "seed": 123,
+      "generation_s": 2.3017851669992524,
+      "started_at": 1791505137.262146,
+      "finished_at": 1791505139.563863,
+      "audio_s": 2.96,
+      "rtf": 0.7776301239862339,
+      "cpu_s": 0.7007829999999999,
+      "cpu_pct_one_core": 30.445195757064656,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2019792972,
+      "rms": 0.07119143009185791,
+      "peak_amplitude": 0.5510453581809998,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "69be94fef8d519f7f144a9b4b4dac92be5fc4dd27e92a94f74f3658bf66d8058",
+      "file": "q8-0-123.wav",
+      "transcript": "The weather is pleasant today and I'm going for a walk.",
+      "word_edits": 2,
+      "substitutions": 1,
+      "deletions": 1,
+      "insertions": 0,
+      "reference_words": 12,
+      "wer": 0.16666666666666666
+    },
+    {
+      "variant": "q8",
+      "prompt": 1,
+      "lang": "es",
+      "text": "Hoy hace buen tiempo y voy a salir a caminar por el parque.",
+      "seed": 42,
+      "generation_s": 2.4547663329994975,
+      "started_at": 1791505139.567431,
+      "finished_at": 1791505142.022123,
+      "audio_s": 3.24,
+      "rtf": 0.7576439299381165,
+      "cpu_s": 0.7590430000000001,
+      "cpu_pct_one_core": 30.921191552782936,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2050595820,
+      "rms": 0.07512058317661285,
+      "peak_amplitude": 0.5246090292930603,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "80834d33d4ab34150b823535f9def51eb383512cd0413c5e8260551b75052d9f",
+      "file": "q8-1-42.wav",
+      "transcript": "Hoy hace buen tiempo y voy a salir a caminar por el parque.",
+      "word_edits": 0,
+      "substitutions": 0,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 13,
+      "wer": 0.0
+    },
+    {
+      "variant": "q8",
+      "prompt": 1,
+      "lang": "es",
+      "text": "Hoy hace buen tiempo y voy a salir a caminar por el parque.",
+      "seed": 123,
+      "generation_s": 2.430637665998802,
+      "started_at": 1791505142.025152,
+      "finished_at": 1791505144.455717,
+      "audio_s": 3.2,
+      "rtf": 0.7595742706246256,
+      "cpu_s": 0.7468080000000001,
+      "cpu_pct_one_core": 30.724776894836793,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2046074632,
+      "rms": 0.07304202765226364,
+      "peak_amplitude": 0.4615444839000702,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "1fe91d76e1d41b481051090b6340ff8ed82d770925b6974df0c46273b78cd0a3",
+      "file": "q8-1-123.wav",
+      "transcript": "Hoy hace buen tiempo y voy a salir a caminar por el parque.",
+      "word_edits": 0,
+      "substitutions": 0,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 13,
+      "wer": 0.0
+    },
+    {
+      "variant": "q8",
+      "prompt": 2,
+      "lang": "en",
+      "text": "Could you check the microphone and tell me whether the sound is clear?",
+      "seed": 42,
+      "generation_s": 2.4078367499987507,
+      "started_at": 1791505144.458978,
+      "finished_at": 1791505146.866743,
+      "audio_s": 3.16,
+      "rtf": 0.7619736550628958,
+      "cpu_s": 0.7378610000000005,
+      "cpu_pct_one_core": 30.644145621599282,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2042977776,
+      "rms": 0.06565575301647186,
+      "peak_amplitude": 0.3712776005268097,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "d2de901e98a5803143051e1eb84ab536f496535ab0042d7c0aab7556db03a9dc",
+      "file": "q8-2-42.wav",
+      "transcript": "Could you check the microphone and tell me whether the sound is clear?",
+      "word_edits": 0,
+      "substitutions": 0,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 13,
+      "wer": 0.0
+    },
+    {
+      "variant": "q8",
+      "prompt": 2,
+      "lang": "en",
+      "text": "Could you check the microphone and tell me whether the sound is clear?",
+      "seed": 123,
+      "generation_s": 2.526483958999961,
+      "started_at": 1791505146.869868,
+      "finished_at": 1791505149.396276,
+      "audio_s": 3.4,
+      "rtf": 0.7430835173529298,
+      "cpu_s": 0.7780389999999997,
+      "cpu_pct_one_core": 30.795327127585047,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2068062295,
+      "rms": 0.06359126418828964,
+      "peak_amplitude": 0.4829810559749603,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "27e9fcb37366fcf5a619021cbf7ec83535969dacf5cbde34518d821e9d89e589",
+      "file": "q8-2-123.wav",
+      "transcript": "Could you check the microphone and tell me whether the sound is clear?",
+      "word_edits": 0,
+      "substitutions": 0,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 13,
+      "wer": 0.0
+    },
+    {
+      "variant": "q8",
+      "prompt": 3,
+      "lang": "es",
+      "text": "¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?",
+      "seed": 42,
+      "generation_s": 2.7936957919991983,
+      "started_at": 1791505149.399251,
+      "finished_at": 1791505152.192863,
+      "audio_s": 3.92,
+      "rtf": 0.7126774979589792,
+      "cpu_s": 0.9963949999999997,
+      "cpu_pct_one_core": 35.66583744921522,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2124378004,
+      "rms": 0.07724740356206894,
+      "peak_amplitude": 0.48256468772888184,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "85e572a6f4f97166b56f7b51d9dfca3aac4d69f8daeecc6d952ad8d6b39bfe63",
+      "file": "q8-3-42.wav",
+      "transcript": "¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?",
+      "word_edits": 0,
+      "substitutions": 0,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 12,
+      "wer": 0.0
+    },
+    {
+      "variant": "q8",
+      "prompt": 3,
+      "lang": "es",
+      "text": "¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?",
+      "seed": 123,
+      "generation_s": 2.6862090829999943,
+      "started_at": 1791505152.199163,
+      "finished_at": 1791505154.88529,
+      "audio_s": 3.72,
+      "rtf": 0.7220992158602135,
+      "cpu_s": 0.8049090000000003,
+      "cpu_pct_one_core": 29.964495507589724,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2103160055,
+      "rms": 0.0632360428571701,
+      "peak_amplitude": 0.3179806172847748,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "e79a8daf137b63dad2ecf845827167e5a64eebcfaac75bb06959bd401bd94431",
+      "file": "q8-3-123.wav",
+      "transcript": "¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?",
+      "word_edits": 0,
+      "substitutions": 0,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 12,
+      "wer": 0.0
+    },
+    {
+      "variant": "q8",
+      "prompt": 4,
+      "lang": "en",
+      "text": "We tested the smaller model twice, and saved both recordings for comparison.",
+      "seed": 42,
+      "generation_s": 2.8024199579995184,
+      "started_at": 1791505154.8888168,
+      "finished_at": 1791505157.6911511,
+      "audio_s": 4.08,
+      "rtf": 0.6868676367645878,
+      "cpu_s": 0.9096489999999999,
+      "cpu_pct_one_core": 32.45941056776317,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2142073736,
+      "rms": 0.07593627274036407,
+      "peak_amplitude": 0.5589218735694885,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "5c3f587fad416ed6a7aa0f859f9ab3663aee51f8900e1a49ebe1bbd8e0068dd5",
+      "file": "q8-4-42.wav",
+      "transcript": "We test the smaller model twice and save Boss Recording for comparison.",
+      "word_edits": 4,
+      "substitutions": 4,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 12,
+      "wer": 0.3333333333333333
+    },
+    {
+      "variant": "q8",
+      "prompt": 4,
+      "lang": "en",
+      "text": "We tested the smaller model twice, and saved both recordings for comparison.",
+      "seed": 123,
+      "generation_s": 2.8889624580006057,
+      "started_at": 1791505157.695009,
+      "finished_at": 1791505160.583884,
+      "audio_s": 4.12,
+      "rtf": 0.7012044800972344,
+      "cpu_s": 0.9068909999999999,
+      "cpu_pct_one_core": 31.39158134396947,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2148645176,
+      "rms": 0.08423066884279251,
+      "peak_amplitude": 0.7980673909187317,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "59fbe885cbd7be4e46d3e41ee3608273215c379248ae644da71d9d3e6925bfe8",
+      "file": "q8-4-123.wav",
+      "transcript": "We test the smaller model twice, and save voice recording for comparison.",
+      "word_edits": 4,
+      "substitutions": 4,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 12,
+      "wer": 0.3333333333333333
+    },
+    {
+      "variant": "q8",
+      "prompt": 5,
+      "lang": "es",
+      "text": "Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.",
+      "seed": 42,
+      "generation_s": 2.948882083999706,
+      "started_at": 1791505160.588416,
+      "finished_at": 1791505163.5372071,
+      "audio_s": 4.2,
+      "rtf": 0.7021147819046919,
+      "cpu_s": 0.9138099999999998,
+      "cpu_pct_one_core": 30.988353347806864,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2156804643,
+      "rms": 0.07882370799779892,
+      "peak_amplitude": 0.612423837184906,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "927b24cc5d84e7ca30e41cd9f640a32119e328d006736920eae36039c99393d3",
+      "file": "q8-5-42.wav",
+      "transcript": "Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.",
+      "word_edits": 0,
+      "substitutions": 0,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 13,
+      "wer": 0.0
+    },
+    {
+      "variant": "q8",
+      "prompt": 5,
+      "lang": "es",
+      "text": "Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.",
+      "seed": 123,
+      "generation_s": 3.0156151669998508,
+      "started_at": 1791505163.5410402,
+      "finished_at": 1791505166.5565639,
+      "audio_s": 4.4,
+      "rtf": 0.6853670834090569,
+      "cpu_s": 0.9809570000000001,
+      "cpu_pct_one_core": 32.52925010905573,
+      "process_peak_rss_bytes": 1622228992,
+      "mlx_peak_bytes": 2178365728,
+      "rms": 0.08412422984838486,
+      "peak_amplitude": 0.7121328711509705,
+      "clipped_fraction": 0.0,
+      "audio_sha256": "8438d762deb44cc656c348b53d2cf0c9b220bc84f41606af5fc8eaa7e07d6c0b",
+      "file": "q8-5-123.wav",
+      "transcript": "Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.",
+      "word_edits": 0,
+      "substitutions": 0,
+      "deletions": 0,
+      "insertions": 0,
+      "reference_words": 13,
+      "wer": 0.0
+    }
+  ],
+  "pairs": [
+    {
+      "prompt": 0,
+      "seed": 42,
+      "lang": "en",
+      "text": "The weather is pleasant today, and I am going for a walk.",
+      "fp32_transcript": "The weather is pleasant today and I'm going for a walk.",
+      "q8_transcript": "The weather is pleasant today and I am going for a walk.",
+      "fp32_word_edits": 2,
+      "q8_word_edits": 0,
+      "duration_difference_s": 0.16000000000000014,
+      "duration_difference_percent": 5.263157894736836,
+      "waveform_identical": false
+    },
+    {
+      "prompt": 0,
+      "seed": 123,
+      "lang": "en",
+      "text": "The weather is pleasant today, and I am going for a walk.",
+      "fp32_transcript": "The weather is pleasant today and I am going for a walk.",
+      "q8_transcript": "The weather is pleasant today and I'm going for a walk.",
+      "fp32_word_edits": 0,
+      "q8_word_edits": 2,
+      "duration_difference_s": 0.1200000000000001,
+      "duration_difference_percent": 4.225352112676051,
+      "waveform_identical": false
+    },
+    {
+      "prompt": 1,
+      "seed": 42,
+      "lang": "es",
+      "text": "Hoy hace buen tiempo y voy a salir a caminar por el parque.",
+      "fp32_transcript": "Hoy hace buen tiempo y voy a salir a caminar por el parque.",
+      "q8_transcript": "Hoy hace buen tiempo y voy a salir a caminar por el parque.",
+      "fp32_word_edits": 0,
+      "q8_word_edits": 0,
+      "duration_difference_s": 0.16000000000000014,
+      "duration_difference_percent": 5.1948051948051965,
+      "waveform_identical": false
+    },
+    {
+      "prompt": 1,
+      "seed": 123,
+      "lang": "es",
+      "text": "Hoy hace buen tiempo y voy a salir a caminar por el parque.",
+      "fp32_transcript": "Hoy hace buen tiempo y voy a salir a caminar por el parque.",
+      "q8_transcript": "Hoy hace buen tiempo y voy a salir a caminar por el parque.",
+      "fp32_word_edits": 0,
+      "q8_word_edits": 0,
+      "duration_difference_s": -0.2799999999999998,
+      "duration_difference_percent": -8.045977011494243,
+      "waveform_identical": false
+    },
+    {
+      "prompt": 2,
+      "seed": 42,
+      "lang": "en",
+      "text": "Could you check the microphone and tell me whether the sound is clear?",
+      "fp32_transcript": "Could you check the microphone and tell me whether the sound is clear?",
+      "q8_transcript": "Could you check the microphone and tell me whether the sound is clear?",
+      "fp32_word_edits": 0,
+      "q8_word_edits": 0,
+      "duration_difference_s": 0.040000000000000036,
+      "duration_difference_percent": 1.2820512820512775,
+      "waveform_identical": false
+    },
+    {
+      "prompt": 2,
+      "seed": 123,
+      "lang": "en",
+      "text": "Could you check the microphone and tell me whether the sound is clear?",
+      "fp32_transcript": "Could you check the microphone and tell me whether the sound is kid?",
+      "q8_transcript": "Could you check the microphone and tell me whether the sound is clear?",
+      "fp32_word_edits": 1,
+      "q8_word_edits": 0,
+      "duration_difference_s": 0.48,
+      "duration_difference_percent": 16.43835616438356,
+      "waveform_identical": false
+    },
+    {
+      "prompt": 3,
+      "seed": 42,
+      "lang": "es",
+      "text": "¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?",
+      "fp32_transcript": "¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?",
+      "q8_transcript": "¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?",
+      "fp32_word_edits": 0,
+      "q8_word_edits": 0,
+      "duration_difference_s": 0.16000000000000014,
+      "duration_difference_percent": 4.255319148936176,
+      "waveform_identical": false
+    },
+    {
+      "prompt": 3,
+      "seed": 123,
+      "lang": "es",
+      "text": "¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?",
+      "fp32_transcript": "¿Podés revisar el micrófono y decirme si mi voz escucha claramente?",
+      "q8_transcript": "¿Podés revisar el micrófono y decirme si mi voz se escucha claramente?",
+      "fp32_word_edits": 1,
+      "q8_word_edits": 0,
+      "duration_difference_s": 0.040000000000000036,
+      "duration_difference_percent": 1.0869565217391353,
+      "waveform_identical": false
+    },
+    {
+      "prompt": 4,
+      "seed": 42,
+      "lang": "en",
+      "text": "We tested the smaller model twice, and saved both recordings for comparison.",
+      "fp32_transcript": "We test the smaller model twice and save both recording for comparison.",
+      "q8_transcript": "We test the smaller model twice and save Boss Recording for comparison.",
+      "fp32_word_edits": 3,
+      "q8_word_edits": 4,
+      "duration_difference_s": 0.040000000000000036,
+      "duration_difference_percent": 0.990099009900991,
+      "waveform_identical": false
+    },
+    {
+      "prompt": 4,
+      "seed": 123,
+      "lang": "en",
+      "text": "We tested the smaller model twice, and saved both recordings for comparison.",
+      "fp32_transcript": "We test the smaller model twice, and save Boss Recording for comparison.",
+      "q8_transcript": "We test the smaller model twice, and save voice recording for comparison.",
+      "fp32_word_edits": 4,
+      "q8_word_edits": 4,
+      "duration_difference_s": 0.040000000000000036,
+      "duration_difference_percent": 0.9803921568627416,
+      "waveform_identical": false
+    },
+    {
+      "prompt": 5,
+      "seed": 42,
+      "lang": "es",
+      "text": "Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.",
+      "fp32_transcript": "Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.",
+      "q8_transcript": "Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.",
+      "fp32_word_edits": 0,
+      "q8_word_edits": 0,
+      "duration_difference_s": -0.1200000000000001,
+      "duration_difference_percent": -2.777777777777779,
+      "waveform_identical": false
+    },
+    {
+      "prompt": 5,
+      "seed": 123,
+      "lang": "es",
+      "text": "Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.",
+      "fp32_transcript": "Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.",
+      "q8_transcript": "Probamos el modelo más pequeño dos veces y guardamos las grabaciones para compararlas.",
+      "fp32_word_edits": 0,
+      "q8_word_edits": 0,
+      "duration_difference_s": 0.1200000000000001,
+      "duration_difference_percent": 2.8037383177570208,
+      "waveform_identical": false
+    }
+  ]
+}

evaluation/score_audio.py

@@ -0,0 +1,20 @@
+"""Transcribe saved benchmark audio with an existing local OpenAI-compatible ASR endpoint."""
+import argparse,json,re,subprocess,unicodedata
+from pathlib import Path
+p=argparse.ArgumentParser();p.add_argument('--audio-dir',required=True);p.add_argument('--endpoint',default='http://127.0.0.1:15093/v1/audio/transcriptions');p.add_argument('--model',default='parakeet-tdt-0.6b-v3');a=p.parse_args();root=Path(a.audio_dir)
+def words(text):return re.findall(r"\w+(?:'\w+)?",unicodedata.normalize('NFC',text).casefold())
+def edits(ref,hyp):
+ prev=list(range(len(hyp)+1))
+ for i,x in enumerate(ref,1):
+  cur=[i]
+  for j,y in enumerate(hyp,1):cur.append(min(cur[-1]+1,prev[j]+1,prev[j-1]+(x!=y)))
+  prev=cur
+ return prev[-1]
+rows=[]
+for variant in ['fp32','q8']:
+ for row in json.loads((root/f'{variant}-results.json').read_text())['rows']:
+  result=subprocess.check_output(['curl','-fsS','--max-time','60',a.endpoint,'-F','file=@'+str(root/row['file']),'-F','model='+a.model,'-F','response_format=json'])
+  text=json.loads(result)['text'];ref=words(row['text']);n=edits(ref,words(text));row.update(transcript=text,word_edits=n,reference_words=len(ref),wer=n/len(ref));rows.append(row)
+(root/'transcripts.json').write_text(json.dumps(rows,ensure_ascii=False,indent=2))
+for variant in ['fp32','q8']:
+ r=[x for x in rows if x['variant']==variant];print(variant,sum(x['word_edits'] for x in r)/sum(x['reference_words'] for x in r))

evaluation/upstream.json

@@ -0,0 +1,70 @@
+{
+  "mlx-community/chatterbox-multilingual-v3": {
+    "revision": "03565773edd72e949572557597af8063bb49a18a",
+    "files": [
+      {
+        "name": ".gitattributes",
+        "size": 1519,
+        "lfs": null
+      },
+      {
+        "name": "Cangjie5_TC.json",
+        "size": 1920163,
+        "lfs": null
+      },
+      {
+        "name": "README.md",
+        "size": 1289,
+        "lfs": null
+      },
+      {
+        "name": "config.json",
+        "size": 666,
+        "lfs": null
+      },
+      {
+        "name": "model.safetensors",
+        "size": 2711113780,
+        "lfs": {
+          "size": 2711113780,
+          "sha256": "e702f2c441e040bd360e59a86c85d462539759d665e41cfd1938adadd74187a3",
+          "pointer_size": 135
+        }
+      },
+      {
+        "name": "tokenizer.json",
+        "size": 69989,
+        "lfs": null
+      }
+    ]
+  },
+  "mlx-community/S3TokenizerV2": {
+    "revision": "e0c9886f0e1c35ae85b1f27277416fb19fc72bec",
+    "files": [
+      {
+        "name": ".gitattributes",
+        "size": 1519,
+        "lfs": null
+      },
+      {
+        "name": "README.md",
+        "size": 459,
+        "lfs": null
+      },
+      {
+        "name": "config.json",
+        "size": 126,
+        "lfs": null
+      },
+      {
+        "name": "model.safetensors",
+        "size": 494868984,
+        "lfs": {
+          "size": 494868984,
+          "sha256": "928726bc1f206a613d36b8f49e297eae9c5593a21bf9b92ddfe2c23f85eb92cc",
+          "pointer_size": 134
+        }
+      }
+    ]
+  }
+}

evaluation/weight-validation.json

@@ -0,0 +1,25 @@
+{
+  "source_repo": "mlx-community/chatterbox-multilingual-v3",
+  "source_revision": "03565773edd72e949572557597af8063bb49a18a",
+  "source_sha256": "e702f2c441e040bd360e59a86c85d462539759d665e41cfd1938adadd74187a3",
+  "q8_sha256": "aa938735e36edfa807531d274baa608ec168f8f06ad6c835a3c4071effcf172e",
+  "source_bytes": 2711113780,
+  "q8_bytes": 877793962,
+  "quantized_main_matrices": 651,
+  "bitwise_unchanged_tensor_count": 1836,
+  "bitwise_unchanged_tensor_bytes": 159837884,
+  "component_counts": {
+    "ve": 1,
+    "s3gen": 428,
+    "t3": 222
+  },
+  "external_s3_repo": "mlx-community/S3TokenizerV2",
+  "external_s3_revision": "e0c9886f0e1c35ae85b1f27277416fb19fc72bec",
+  "external_s3_sha256": "928726bc1f206a613d36b8f49e297eae9c5593a21bf9b92ddfe2c23f85eb92cc",
+  "external_s3_bytes": 494868984,
+  "external_s3_q8_runtime_matrices": 37,
+  "quantizer": "oMLX _quantize_chunked (native MLX affine path), revision 70f44cfd",
+  "bits": 8,
+  "group_size": 64,
+  "mode": "affine"
+}

load_q8.py

@@ -0,0 +1,20 @@
+"""Load the main Q8 checkpoint and quantize external S3Tokenizer matrices to Q8."""
+import json
+from pathlib import Path
+import mlx.core as mx
+import mlx.nn as nn
+from mlx_audio.tts.models.chatterbox.chatterbox import Model
+
+def load_model(path=None):
+    path=Path(path) if path else Path(__file__).resolve().parent
+    model=Model.from_pretrained(path)
+    nn.quantize(model._s3_tokenizer,group_size=64,bits=8,
+        class_predicate=lambda n,m:hasattr(m,'to_quantized') and hasattr(m,'weight') and m.weight.shape[-1]%64==0)
+    mx.eval(model._s3_tokenizer.parameters())
+    modules=dict(model.named_modules())
+    policy=json.loads((path/'config.json').read_text())['mixed_quantization']
+    for name in policy:
+        assert modules[name].bits==8,name
+    external=[m for n,m in model._s3_tokenizer.named_modules() if hasattr(m,'bits')]
+    assert len(external)==37 and all(m.bits==8 for m in external)
+    return model

quantize_q8.py

@@ -0,0 +1,21 @@
+"""Rebuild native MLX affine Q8 matrices from the pinned FP32 source and published policy.
+
+The original artifact was packed using oMLX _quantize_chunked's native MLX
+(non-importance-weighted) affine path. This recipe uses the same MLX primitive.
+Output content is validated separately; serialization hash may depend on MLX.
+"""
+import argparse,json,shutil
+from pathlib import Path
+import mlx.core as mx
+p=argparse.ArgumentParser();p.add_argument('--source',required=True);p.add_argument('--out',required=True);a=p.parse_args();src=Path(a.source);dst=Path(a.out)
+if dst.exists():raise RuntimeError('Choose a new output directory; existing files are never overwritten')
+config=json.loads((Path(__file__).parent/'config.json').read_text());policy=config['mixed_quantization'];weights=mx.load(str(src/'model.safetensors'))
+for name,item in policy.items():
+ key=name+'.weight';assert item['bits']==8
+ packed,scales,biases=mx.quantize(weights[key],group_size=64,bits=8,mode='affine')
+ mx.eval(packed,scales,biases);weights[key]=packed;weights[name+'.scales']=scales;weights[name+'.biases']=biases
+mx.eval(*weights.values());dst.mkdir();mx.save_safetensors(str(dst/'model.safetensors'),weights)
+(dst/'config.json').write_text(json.dumps(config,ensure_ascii=False,indent=2))
+for name in ['tokenizer.json','Cangjie5_TC.json']:shutil.copy2(src/name,dst/name)
+shutil.copy2(Path(__file__).parent/'load_q8.py',dst/'load_q8.py')
+print(dst)

requirements.txt

@@ -0,0 +1,5 @@
+mlx-audio==0.5.7
+mlx==0.32.3
+numpy==2.4.6
+soundfile==0.14.0
+huggingface-hub==1.33.0

tokenizer.json

@@ -0,0 +1,3806 @@
+{
+  "version": "1.0",
+  "truncation": null,
+  "padding": null,
+  "added_tokens": [
+    {
+      "id": 0,
+      "special": true,
+      "content": "[STOP]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false
+    },
+    {
+      "id": 1,
+      "special": true,
+      "content": "[UNK]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false
+    },
+    {
+      "id": 2,
+      "special": true,
+      "content": "[SPACE]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false
+    },
+    {
+      "id": 255,
+      "special": true,
+      "content": "[START]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false
+    },
+    {
+      "id": 604,
+      "content": "[UH]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 605,
+      "content": "[UM]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 606,
+      "content": "[giggle]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 607,
+      "content": "[laughter]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 608,
+      "content": "[guffaw]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 609,
+      "content": "[inhale]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 610,
+      "content": "[exhale]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 611,
+      "content": "[sigh]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 612,
+      "content": "[cry]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 613,
+      "content": "[bark]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 614,
+      "content": "[howl]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 615,
+      "content": "[meow]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 616,
+      "content": "[singing]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 617,
+      "content": "[music]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 618,
+      "content": "[whistle]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 619,
+      "content": "[humming]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 620,
+      "content": "[gasp]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 621,
+      "content": "[groan]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 622,
+      "content": "[whisper]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 623,
+      "content": "[mumble]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 624,
+      "content": "[sniff]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 625,
+      "content": "[sneeze]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 626,
+      "content": "[cough]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 627,
+      "content": "[snore]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 628,
+      "content": "[chew]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 629,
+      "content": "[sip]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 630,
+      "content": "[clear_throat]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 631,
+      "content": "[kiss]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 632,
+      "content": "[shhh]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 633,
+      "content": "[gibberish]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 634,
+      "content": "[fr]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 635,
+      "content": "[es]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 636,
+      "content": "[de]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 637,
+      "content": "[it]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 638,
+      "content": "[ipa]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 639,
+      "content": "[end_of_label]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 695,
+      "content": "[PLACEHOLDER55]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 696,
+      "content": "[PLACEHOLDER56]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 697,
+      "content": "[PLACEHOLDER57]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 698,
+      "content": "[PLACEHOLDER58]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 699,
+      "content": "[PLACEHOLDER59]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 700,
+      "content": "[PLACEHOLDER60]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 701,
+      "content": "[PLACEHOLDER61]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 702,
+      "content": "[PLACEHOLDER62]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 703,
+      "content": "[PLACEHOLDER63]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 704,
+      "content": "[MASK]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 705,
+      "content": "[PAD]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 706,
+      "content": "[SEP]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 707,
+      "content": "[CLS]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 708,
+      "content": "[en]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 709,
+      "content": "[nl]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 710,
+      "content": "[pt]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 711,
+      "content": "[el]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 712,
+      "content": "[tr]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 713,
+      "content": "[sv]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 714,
+      "content": "[no]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 715,
+      "content": "[da]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 716,
+      "content": "[ru]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 717,
+      "content": "[pl]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 718,
+      "content": "[sk]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 719,
+      "content": "[cs]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 720,
+      "content": "[hu]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 721,
+      "content": "[ar]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 722,
+      "content": "[hi]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 723,
+      "content": "[ja]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 724,
+      "content": "[ko]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 725,
+      "content": "[zh]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 726,
+      "content": "[ro]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 727,
+      "content": "[bg]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 729,
+      "content": "[ea]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 730,
+      "content": "[sw]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 732,
+      "content": "[vi]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 733,
+      "content": "[cj_a]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 734,
+      "content": "[cj_b]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 735,
+      "content": "[cj_c]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 736,
+      "content": "[cj_d]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 737,
+      "content": "[cj_e]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 738,
+      "content": "[cj_f]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 739,
+      "content": "[cj_g]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 740,
+      "content": "[cj_h]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 741,
+      "content": "[cj_i]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 742,
+      "content": "[cj_j]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 743,
+      "content": "[cj_k]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 744,
+      "content": "[cj_l]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 745,
+      "content": "[cj_m]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 746,
+      "content": "[cj_n]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 747,
+      "content": "[cj_o]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 748,
+      "content": "[cj_p]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 749,
+      "content": "[cj_q]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 750,
+      "content": "[cj_r]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 751,
+      "content": "[cj_s]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 752,
+      "content": "[cj_t]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 753,
+      "content": "[cj_u]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 754,
+      "content": "[cj_v]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 755,
+      "content": "[cj_w]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 756,
+      "content": "[cj_x]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 757,
+      "content": "[cj_y]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 758,
+      "content": "[cj_z]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 759,
+      "content": "[cj_0]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 760,
+      "content": "[cj_1]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 761,
+      "content": "[cj_2]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 2052,
+      "content": "[cj_3]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 2053,
+      "content": "[cj_4]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 2059,
+      "content": "[cj_5]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 2060,
+      "content": "[cj_6]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 2061,
+      "content": "[cj_7]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 2062,
+      "content": "[cj_8]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 2063,
+      "content": "[cj_9]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 2064,
+      "content": "[cj_.]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    },
+    {
+      "id": 2065,
+      "content": "₹",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 2107,
+      "content": "[fi]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 2108,
+      "content": "[ta]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 2109,
+      "content": "[ms]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": false
+    },
+    {
+      "id": 2110,
+      "content": "[he]",
+      "single_word": false,
+      "lstrip": false,
+      "rstrip": false,
+      "normalized": false,
+      "special": true
+    }
+  ],
+  "normalizer": null,
+  "pre_tokenizer": {
+    "type": "Whitespace"
+  },
+  "post_processor": null,
+  "decoder": null,
+  "model": {
+    "type": "BPE",
+    "dropout": null,
+    "unk_token": "[UNK]",
+    "continuing_subword_prefix": null,
+    "end_of_word_suffix": null,
+    "fuse_unk": false,
+    "vocab": {
+      "[STOP]": 0,
+      "[UNK]": 1,
+      "[SPACE]": 2,
+      "!": 3,
+      "'": 4,
+      "(": 5,
+      ")": 6,
+      ",": 7,
+      "-": 8,
+      ".": 9,
+      "/": 10,
+      ":": 11,
+      ";": 12,
+      "?": 13,
+      "a": 14,
+      "b": 15,
+      "c": 16,
+      "d": 17,
+      "e": 18,
+      "f": 19,
+      "g": 20,
+      "h": 21,
+      "i": 22,
+      "j": 23,
+      "k": 24,
+      "l": 25,
+      "m": 26,
+      "n": 27,
+      "o": 28,
+      "p": 29,
+      "q": 30,
+      "r": 31,
+      "s": 32,
+      "t": 33,
+      "u": 34,
+      "v": 35,
+      "w": 36,
+      "x": 37,
+      "y": 38,
+      "z": 39,
+      "th": 40,
+      "in": 41,
+      "the": 42,
+      "an": 43,
+      "er": 44,
+      "ou": 45,
+      "re": 46,
+      "on": 47,
+      "at": 48,
+      "ed": 49,
+      "en": 50,
+      "to": 51,
+      "ing": 52,
+      "and": 53,
+      "is": 54,
+      "as": 55,
+      "al": 56,
+      "or": 57,
+      "of": 58,
+      "ar": 59,
+      "it": 60,
+      "es": 61,
+      "he": 62,
+      "st": 63,
+      "le": 64,
+      "om": 65,
+      "se": 66,
+      "be": 67,
+      "ad": 68,
+      "ow": 69,
+      "ly": 70,
+      "ch": 71,
+      "wh": 72,
+      "that": 73,
+      "you": 74,
+      "li": 75,
+      "ve": 76,
+      "ac": 77,
+      "ti": 78,
+      "ld": 79,
+      "me": 80,
+      "was": 81,
+      "gh": 82,
+      "id": 83,
+      "ll": 84,
+      "wi": 85,
+      "ent": 86,
+      "for": 87,
+      "ay": 88,
+      "ro": 89,
+      "ver": 90,
+      "ic": 91,
+      "her": 92,
+      "ke": 93,
+      "his": 94,
+      "no": 95,
+      "ut": 96,
+      "un": 97,
+      "ir": 98,
+      "lo": 99,
+      "we": 100,
+      "ri": 101,
+      "ha": 102,
+      "with": 103,
+      "ght": 104,
+      "out": 105,
+      "im": 106,
+      "ion": 107,
+      "all": 108,
+      "ab": 109,
+      "one": 110,
+      "ne": 111,
+      "ge": 112,
+      "ould": 113,
+      "ter": 114,
+      "mo": 115,
+      "had": 116,
+      "ce": 117,
+      "she": 118,
+      "go": 119,
+      "sh": 120,
+      "ur": 121,
+      "am": 122,
+      "so": 123,
+      "pe": 124,
+      "my": 125,
+      "de": 126,
+      "are": 127,
+      "but": 128,
+      "ome": 129,
+      "fr": 130,
+      "ther": 131,
+      "fe": 132,
+      "su": 133,
+      "do": 134,
+      "con": 135,
+      "te": 136,
+      "ain": 137,
+      "ere": 138,
+      "po": 139,
+      "if": 140,
+      "they": 141,
+      "us": 142,
+      "ag": 143,
+      "tr": 144,
+      "now": 145,
+      "oun": 146,
+      "this": 147,
+      "have": 148,
+      "not": 149,
+      "sa": 150,
+      "il": 151,
+      "up": 152,
+      "thing": 153,
+      "from": 154,
+      "ap": 155,
+      "him": 156,
+      "ack": 157,
+      "ation": 158,
+      "ant": 159,
+      "our": 160,
+      "op": 161,
+      "like": 162,
+      "ust": 163,
+      "ess": 164,
+      "bo": 165,
+      "ok": 166,
+      "ul": 167,
+      "ind": 168,
+      "ex": 169,
+      "com": 170,
+      "some": 171,
+      "there": 172,
+      "ers": 173,
+      "co": 174,
+      "res": 175,
+      "man": 176,
+      "ard": 177,
+      "pl": 178,
+      "wor": 179,
+      "way": 180,
+      "tion": 181,
+      "fo": 182,
+      "ca": 183,
+      "were": 184,
+      "by": 185,
+      "ate": 186,
+      "pro": 187,
+      "ted": 188,
+      "ound": 189,
+      "own": 190,
+      "would": 191,
+      "ts": 192,
+      "what": 193,
+      "qu": 194,
+      "ally": 195,
+      "ight": 196,
+      "ck": 197,
+      "gr": 198,
+      "when": 199,
+      "ven": 200,
+      "can": 201,
+      "ough": 202,
+      "ine": 203,
+      "end": 204,
+      "per": 205,
+      "ous": 206,
+      "od": 207,
+      "ide": 208,
+      "know": 209,
+      "ty": 210,
+      "very": 211,
+      "si": 212,
+      "ak": 213,
+      "who": 214,
+      "about": 215,
+      "ill": 216,
+      "them": 217,
+      "est": 218,
+      "red": 219,
+      "ye": 220,
+      "could": 221,
+      "ong": 222,
+      "your": 223,
+      "their": 224,
+      "em": 225,
+      "just": 226,
+      "other": 227,
+      "into": 228,
+      "any": 229,
+      "whi": 230,
+      "um": 231,
+      "tw": 232,
+      "ast": 233,
+      "der": 234,
+      "did": 235,
+      "ie": 236,
+      "been": 237,
+      "ace": 238,
+      "ink": 239,
+      "ity": 240,
+      "back": 241,
+      "ting": 242,
+      "br": 243,
+      "more": 244,
+      "ake": 245,
+      "pp": 246,
+      "then": 247,
+      "sp": 248,
+      "el": 249,
+      "use": 250,
+      "bl": 251,
+      "said": 252,
+      "over": 253,
+      "get": 254,
+      "[START]": 255,
+      "\"": 256,
+      "#": 257,
+      "$": 258,
+      "%": 259,
+      "&": 260,
+      "*": 261,
+      "+": 262,
+      "0": 263,
+      "1": 264,
+      "2": 265,
+      "3": 266,
+      "4": 267,
+      "5": 268,
+      "6": 269,
+      "7": 270,
+      "8": 271,
+      "9": 272,
+      "<": 273,
+      "=": 274,
+      ">": 275,
+      "@": 276,
+      "A": 277,
+      "B": 278,
+      "C": 279,
+      "D": 280,
+      "E": 281,
+      "F": 282,
+      "G": 283,
+      "H": 284,
+      "I": 285,
+      "J": 286,
+      "K": 287,
+      "L": 288,
+      "M": 289,
+      "N": 290,
+      "O": 291,
+      "P": 292,
+      "Q": 293,
+      "R": 294,
+      "S": 295,
+      "T": 296,
+      "U": 297,
+      "V": 298,
+      "W": 299,
+      "X": 300,
+      "Y": 301,
+      "Z": 302,
+      "[": 303,
+      "\\": 304,
+      "]": 305,
+      "^": 306,
+      "_": 307,
+      "`": 308,
+      "{": 309,
+      "|": 310,
+      "}": 311,
+      "~": 312,
+      "‐": 313,
+      "‑": 314,
+      "‒": 315,
+      "–": 316,
+      "—": 317,
+      "―": 318,
+      "‖": 319,
+      "‗": 320,
+      "‘": 321,
+      "’": 322,
+      "‚": 323,
+      "‛": 324,
+      "“": 325,
+      "”": 326,
+      "„": 327,
+      "‟": 328,
+      " ": 329,
+      "¡": 330,
+      "¢": 331,
+      "£": 332,
+      "¤": 333,
+      "¥": 334,
+      "¦": 335,
+      "§": 336,
+      "¨": 337,
+      "©": 338,
+      "ª": 339,
+      "«": 340,
+      "¬": 341,
+      "­": 342,
+      "®": 343,
+      "¯": 344,
+      "°": 345,
+      "±": 346,
+      "²": 347,
+      "³": 348,
+      "´": 349,
+      "µ": 350,
+      "¶": 351,
+      "·": 352,
+      "¸": 353,
+      "¹": 354,
+      "º": 355,
+      "»": 356,
+      "¼": 357,
+      "½": 358,
+      "¾": 359,
+      "¿": 360,
+      "À": 361,
+      "Á": 362,
+      "Â": 363,
+      "Ã": 364,
+      "Ä": 365,
+      "Å": 366,
+      "Æ": 367,
+      "Ç": 368,
+      "È": 369,
+      "É": 370,
+      "Ê": 371,
+      "Ë": 372,
+      "Ì": 373,
+      "Í": 374,
+      "Î": 375,
+      "Ï": 376,
+      "Ð": 377,
+      "Ñ": 378,
+      "Ò": 379,
+      "Ó": 380,
+      "Ô": 381,
+      "Õ": 382,
+      "Ö": 383,
+      "×": 384,
+      "Ø": 385,
+      "Ù": 386,
+      "Ú": 387,
+      "Û": 388,
+      "Ü": 389,
+      "Ý": 390,
+      "Þ": 391,
+      "ß": 392,
+      "à": 393,
+      "á": 394,
+      "â": 395,
+      "ã": 396,
+      "ä": 397,
+      "å": 398,
+      "æ": 399,
+      "ç": 400,
+      "è": 401,
+      "é": 402,
+      "ê": 403,
+      "ë": 404,
+      "ì": 405,
+      "í": 406,
+      "î": 407,
+      "ï": 408,
+      "ð": 409,
+      "ñ": 410,
+      "ò": 411,
+      "ó": 412,
+      "ô": 413,
+      "õ": 414,
+      "ö": 415,
+      "÷": 416,
+      "ø": 417,
+      "ù": 418,
+      "ú": 419,
+      "û": 420,
+      "ü": 421,
+      "ý": 422,
+      "þ": 423,
+      "ÿ": 424,
+      "ɐ": 425,
+      "ɑ": 426,
+      "ɒ": 427,
+      "ɓ": 428,
+      "ɔ": 429,
+      "ɕ": 430,
+      "ɖ": 431,
+      "ɗ": 432,
+      "ɘ": 433,
+      "ə": 434,
+      "ɚ": 435,
+      "ɛ": 436,
+      "ɜ": 437,
+      "ɝ": 438,
+      "ɞ": 439,
+      "ɟ": 440,
+      "ɠ": 441,
+      "ɡ": 442,
+      "ɢ": 443,
+      "ɣ": 444,
+      "ɤ": 445,
+      "ɥ": 446,
+      "ɦ": 447,
+      "ɧ": 448,
+      "ɨ": 449,
+      "ɩ": 450,
+      "ɪ": 451,
+      "ɫ": 452,
+      "ɬ": 453,
+      "ɭ": 454,
+      "ɮ": 455,
+      "ɯ": 456,
+      "ɰ": 457,
+      "ɱ": 458,
+      "ɲ": 459,
+      "ɳ": 460,
+      "ɴ": 461,
+      "ɵ": 462,
+      "ɶ": 463,
+      "ɷ": 464,
+      "ɸ": 465,
+      "ɹ": 466,
+      "ɺ": 467,
+      "ɻ": 468,
+      "ɼ": 469,
+      "ɽ": 470,
+      "ɾ": 471,
+      "ɿ": 472,
+      "ʀ": 473,
+      "ʁ": 474,
+      "ʂ": 475,
+      "ʃ": 476,
+      "ʄ": 477,
+      "ʅ": 478,
+      "ʆ": 479,
+      "ʇ": 480,
+      "ʈ": 481,
+      "ʉ": 482,
+      "ʊ": 483,
+      "ʋ": 484,
+      "ʌ": 485,
+      "ʍ": 486,
+      "ʎ": 487,
+      "ʏ": 488,
+      "ʐ": 489,
+      "ʑ": 490,
+      "ʒ": 491,
+      "ʓ": 492,
+      "ʔ": 493,
+      "ʕ": 494,
+      "ʖ": 495,
+      "ʗ": 496,
+      "ʘ": 497,
+      "ʙ": 498,
+      "ʚ": 499,
+      "ʛ": 500,
+      "ʜ": 501,
+      "ʝ": 502,
+      "ʞ": 503,
+      "ʟ": 504,
+      "ʠ": 505,
+      "ʡ": 506,
+      "ʢ": 507,
+      "ʣ": 508,
+      "ʤ": 509,
+      "ʥ": 510,
+      "ʦ": 511,
+      "ʧ": 512,
+      "ʨ": 513,
+      "ʩ": 514,
+      "ʪ": 515,
+      "ʫ": 516,
+      "ʬ": 517,
+      "ʭ": 518,
+      "ʮ": 519,
+      "ʯ": 520,
+      "ʰ": 521,
+      "ʱ": 522,
+      "ʲ": 523,
+      "ʳ": 524,
+      "ʴ": 525,
+      "ʵ": 526,
+      "ʶ": 527,
+      "ʷ": 528,
+      "ʸ": 529,
+      "ʹ": 530,
+      "ʺ": 531,
+      "ʻ": 532,
+      "ʼ": 533,
+      "ʽ": 534,
+      "ʾ": 535,
+      "ʿ": 536,
+      "ˀ": 537,
+      "ˁ": 538,
+      "˂": 539,
+      "˃": 540,
+      "˄": 541,
+      "˅": 542,
+      "ˆ": 543,
+      "ˇ": 544,
+      "ˈ": 545,
+      "ˉ": 546,
+      "ˊ": 547,
+      "ˋ": 548,
+      "ˌ": 549,
+      "ˍ": 550,
+      "ˎ": 551,
+      "ˏ": 552,
+      "ː": 553,
+      "ˑ": 554,
+      "˒": 555,
+      "˓": 556,
+      "˔": 557,
+      "˕": 558,
+      "˖": 559,
+      "˗": 560,
+      "˘": 561,
+      "˙": 562,
+      "˚": 563,
+      "˛": 564,
+      "˜": 565,
+      "˝": 566,
+      "˞": 567,
+      "˟": 568,
+      "ˠ": 569,
+      "ˡ": 570,
+      "ˢ": 571,
+      "ˣ": 572,
+      "ˤ": 573,
+      "˥": 574,
+      "˦": 575,
+      "˧": 576,
+      "˨": 577,
+      "˩": 578,
+      "˪": 579,
+      "˫": 580,
+      "ˬ": 581,
+      "˭": 582,
+      "ˮ": 583,
+      "˯": 584,
+      "˰": 585,
+      "˱": 586,
+      "˲": 587,
+      "˳": 588,
+      "˴": 589,
+      "˵": 590,
+      "˶": 591,
+      "˷": 592,
+      "˸": 593,
+      "˹": 594,
+      "˺": 595,
+      "˻": 596,
+      "˼": 597,
+      "˽": 598,
+      "˾": 599,
+      "˿": 600,
+      "ā": 601,
+      "ō": 602,
+      "…": 603,
+      "[UH]": 604,
+      "[UM]": 605,
+      "[giggle]": 606,
+      "[laughter]": 607,
+      "[guffaw]": 608,
+      "[inhale]": 609,
+      "[exhale]": 610,
+      "[sigh]": 611,
+      "[cry]": 612,
+      "[bark]": 613,
+      "[howl]": 614,
+      "[meow]": 615,
+      "[singing]": 616,
+      "[music]": 617,
+      "[whistle]": 618,
+      "[humming]": 619,
+      "[gasp]": 620,
+      "[groan]": 621,
+      "[whisper]": 622,
+      "[mumble]": 623,
+      "[sniff]": 624,
+      "[sneeze]": 625,
+      "[cough]": 626,
+      "[snore]": 627,
+      "[chew]": 628,
+      "[sip]": 629,
+      "[clear_throat]": 630,
+      "[kiss]": 631,
+      "[shhh]": 632,
+      "[gibberish]": 633,
+      "[fr]": 634,
+      "[es]": 635,
+      "[de]": 636,
+      "[it]": 637,
+      "[ipa]": 638,
+      "[end_of_label]": 639,
+      "ŋ": 640,
+      "ᵻ": 641,
+      "θ": 642,
+      "̩": 643,
+      "̃": 644,
+      "ɑː": 645,
+      "iː": 646,
+      "uː": 647,
+      "ɜː": 648,
+      "ɔː": 649,
+      "oː": 650,
+      "eɪ": 651,
+      "oʊ": 652,
+      "aɪ": 653,
+      "aʊ": 654,
+      "ɔɪ": 655,
+      "dʒ": 656,
+      "tʃ": 657,
+      "ɪŋ": 658,
+      "ᵻd": 659,
+      "ˈiː": 660,
+      "ˌiː": 661,
+      "ˈɪ": 662,
+      "ˌɪ": 663,
+      "ˈeɪ": 664,
+      "ˌeɪ": 665,
+      "ˈɛ": 666,
+      "ˌɛ": 667,
+      "ˈæ": 668,
+      "ˌæ": 669,
+      "ˈɑː": 670,
+      "ˌɑː": 671,
+      "ˈɔː": 672,
+      "ˌɔː": 673,
+      "oːɹ": 674,
+      "ˈoːɹ": 675,
+      "ˌoːɹ": 676,
+      "ˈoʊ": 677,
+      "ˌoʊ": 678,
+      "ˈʊ": 679,
+      "ˌʊ": 680,
+      "ˈuː": 681,
+      "ˌuː": 682,
+      "ˈɜː": 683,
+      "ˌɜː": 684,
+      "ˈʌ": 685,
+      "ˌʌ": 686,
+      "ˈaɪ": 687,
+      "ˌaɪ": 688,
+      "ˈaʊ": 689,
+      "ˌaʊ": 690,
+      "ˈɔɪ": 691,
+      "ˌɔɪ": 692,
+      "ˈɚ": 693,
+      "ˌɐ": 694,
+      "[PLACEHOLDER55]": 695,
+      "[PLACEHOLDER56]": 696,
+      "[PLACEHOLDER57]": 697,
+      "[PLACEHOLDER58]": 698,
+      "[PLACEHOLDER59]": 699,
+      "[PLACEHOLDER60]": 700,
+      "[PLACEHOLDER61]": 701,
+      "[PLACEHOLDER62]": 702,
+      "[PLACEHOLDER63]": 703,
+      "[MASK]": 704,
+      "[PAD]": 705,
+      "[SEP]": 706,
+      "[CLS]": 707,
+      "[en]": 708,
+      "[nl]": 709,
+      "[pt]": 710,
+      "[el]": 711,
+      "[tr]": 712,
+      "[sv]": 713,
+      "[no]": 714,
+      "[da]": 715,
+      "[ru]": 716,
+      "[pl]": 717,
+      "[sk]": 718,
+      "[cs]": 719,
+      "[hu]": 720,
+      "[ar]": 721,
+      "[hi]": 722,
+      "[ja]": 723,
+      "[ko]": 724,
+      "[zh]": 725,
+      "[ro]": 726,
+      "[bg]": 727,
+      " ": 728,
+      "[ea]": 729,
+      "[sw]": 730,
+      "─": 731,
+      "[vi]": 732,
+      "[cj_a]": 733,
+      "[cj_b]": 734,
+      "[cj_c]": 735,
+      "[cj_d]": 736,
+      "[cj_e]": 737,
+      "[cj_f]": 738,
+      "[cj_g]": 739,
+      "[cj_h]": 740,
+      "[cj_i]": 741,
+      "[cj_j]": 742,
+      "[cj_k]": 743,
+      "[cj_l]": 744,
+      "[cj_m]": 745,
+      "[cj_n]": 746,
+      "[cj_o]": 747,
+      "[cj_p]": 748,
+      "[cj_q]": 749,
+      "[cj_r]": 750,
+      "[cj_s]": 751,
+      "[cj_t]": 752,
+      "[cj_u]": 753,
+      "[cj_v]": 754,
+      "[cj_w]": 755,
+      "[cj_x]": 756,
+      "[cj_y]": 757,
+      "[cj_z]": 758,
+      "[cj_0]": 759,
+      "[cj_1]": 760,
+      "[cj_2]": 761,
+      "̈": 762,
+      "̄": 763,
+      "́": 764,
+      "μ": 765,
+      "̧": 766,
+      "⁄": 767,
+      "̀": 768,
+      "̂": 769,
+      "̊": 770,
+      "̆": 771,
+      "̨": 772,
+      "̇": 773,
+      "̌": 774,
+      "Đ": 775,
+      "đ": 776,
+      "Ħ": 777,
+      "ħ": 778,
+      "ı": 779,
+      "ĸ": 780,
+      "Ł": 781,
+      "ł": 782,
+      "Ŋ": 783,
+      "̋": 784,
+      "Œ": 785,
+      "œ": 786,
+      "Ŧ": 787,
+      "ŧ": 788,
+      "ƀ": 789,
+      "Ɓ": 790,
+      "Ƃ": 791,
+      "ƃ": 792,
+      "Ƅ": 793,
+      "ƅ": 794,
+      "Ɔ": 795,
+      "Ƈ": 796,
+      "ƈ": 797,
+      "Ɖ": 798,
+      "Ɗ": 799,
+      "Ƌ": 800,
+      "ƌ": 801,
+      "ƍ": 802,
+      "Ǝ": 803,
+      "Ə": 804,
+      "Ɛ": 805,
+      "Ƒ": 806,
+      "ƒ": 807,
+      "Ɠ": 808,
+      "Ɣ": 809,
+      "ƕ": 810,
+      "Ɩ": 811,
+      "Ɨ": 812,
+      "Ƙ": 813,
+      "ƙ": 814,
+      "ƚ": 815,
+      "ƛ": 816,
+      "Ɯ": 817,
+      "Ɲ": 818,
+      "ƞ": 819,
+      "Ɵ": 820,
+      "̛": 821,
+      "Ƣ": 822,
+      "ƣ": 823,
+      "Ƥ": 824,
+      "ƥ": 825,
+      "Ʀ": 826,
+      "Ƨ": 827,
+      "ƨ": 828,
+      "Ʃ": 829,
+      "ƪ": 830,
+      "ƫ": 831,
+      "Ƭ": 832,
+      "ƭ": 833,
+      "Ʈ": 834,
+      "Ʊ": 835,
+      "Ʋ": 836,
+      "Ƴ": 837,
+      "ƴ": 838,
+      "Ƶ": 839,
+      "ƶ": 840,
+      "Ʒ": 841,
+      "Ƹ": 842,
+      "ƹ": 843,
+      "ƺ": 844,
+      "ƻ": 845,
+      "Ƽ": 846,
+      "ƽ": 847,
+      "ƾ": 848,
+      "ƿ": 849,
+      "ǀ": 850,
+      "ǁ": 851,
+      "ǂ": 852,
+      "ǃ": 853,
+      "ǝ": 854,
+      "Ǥ": 855,
+      "ǥ": 856,
+      "Ƕ": 857,
+      "Ƿ": 858,
+      "̏": 859,
+      "̑": 860,
+      "̦": 861,
+      "Ȝ": 862,
+      "ȝ": 863,
+      "Ƞ": 864,
+      "ȡ": 865,
+      "Ȣ": 866,
+      "ȣ": 867,
+      "Ȥ": 868,
+      "ȥ": 869,
+      "ȴ": 870,
+      "ȵ": 871,
+      "ȶ": 872,
+      "ȷ": 873,
+      "ȸ": 874,
+      "ȹ": 875,
+      "Ⱥ": 876,
+      "Ȼ": 877,
+      "ȼ": 878,
+      "Ƚ": 879,
+      "Ⱦ": 880,
+      "ȿ": 881,
+      "ɀ": 882,
+      "Ɂ": 883,
+      "ɂ": 884,
+      "Ƀ": 885,
+      "Ʉ": 886,
+      "Ʌ": 887,
+      "Ɇ": 888,
+      "ɇ": 889,
+      "Ɉ": 890,
+      "ɉ": 891,
+      "Ɋ": 892,
+      "ɋ": 893,
+      "Ɍ": 894,
+      "ɍ": 895,
+      "Ɏ": 896,
+      "ɏ": 897,
+      "̅": 898,
+      "̉": 899,
+      "̍": 900,
+      "̎": 901,
+      "̐": 902,
+      "̒": 903,
+      "̓": 904,
+      "̔": 905,
+      "̕": 906,
+      "̖": 907,
+      "̗": 908,
+      "̘": 909,
+      "̙": 910,
+      "̚": 911,
+      "̜": 912,
+      "̝": 913,
+      "̞": 914,
+      "̟": 915,
+      "̠": 916,
+      "̡": 917,
+      "̢": 918,
+      "̣": 919,
+      "̤": 920,
+      "̥": 921,
+      "̪": 922,
+      "̫": 923,
+      "̬": 924,
+      "̭": 925,
+      "̮": 926,
+      "̯": 927,
+      "̰": 928,
+      "̱": 929,
+      "̲": 930,
+      "̳": 931,
+      "̴": 932,
+      "̵": 933,
+      "̶": 934,
+      "̷": 935,
+      "̸": 936,
+      "̹": 937,
+      "̺": 938,
+      "̻": 939,
+      "̼": 940,
+      "̽": 941,
+      "̾": 942,
+      "̿": 943,
+      "͂": 944,
+      "ͅ": 945,
+      "͆": 946,
+      "͇": 947,
+      "͈": 948,
+      "͉": 949,
+      "͊": 950,
+      "͋": 951,
+      "͌": 952,
+      "͍": 953,
+      "͎": 954,
+      "͏": 955,
+      "͐": 956,
+      "͑": 957,
+      "͒": 958,
+      "͓": 959,
+      "͔": 960,
+      "͕": 961,
+      "͖": 962,
+      "͗": 963,
+      "͘": 964,
+      "͙": 965,
+      "͚": 966,
+      "͛": 967,
+      "͜": 968,
+      "͝": 969,
+      "͞": 970,
+      "͟": 971,
+      "͠": 972,
+      "͡": 973,
+      "͢": 974,
+      "ͣ": 975,
+      "ͤ": 976,
+      "ͥ": 977,
+      "ͦ": 978,
+      "ͧ": 979,
+      "ͨ": 980,
+      "ͩ": 981,
+      "ͪ": 982,
+      "ͫ": 983,
+      "ͬ": 984,
+      "ͭ": 985,
+      "ͮ": 986,
+      "ͯ": 987,
+      "Ͱ": 988,
+      "ͱ": 989,
+      "Ͳ": 990,
+      "ͳ": 991,
+      "͵": 992,
+      "Ͷ": 993,
+      "ͷ": 994,
+      "ͻ": 995,
+      "ͼ": 996,
+      "ͽ": 997,
+      "Ϳ": 998,
+      "Α": 999,
+      "Ε": 1000,
+      "Η": 1001,
+      "Ι": 1002,
+      "Ο": 1003,
+      "Υ": 1004,
+      "Ω": 1005,
+      "ι": 1006,
+      "Β": 1007,
+      "Γ": 1008,
+      "Δ": 1009,
+      "Ζ": 1010,
+      "Θ": 1011,
+      "Κ": 1012,
+      "Λ": 1013,
+      "Μ": 1014,
+      "Ν": 1015,
+      "Ξ": 1016,
+      "Π": 1017,
+      "Ρ": 1018,
+      "Σ": 1019,
+      "Τ": 1020,
+      "Φ": 1021,
+      "Χ": 1022,
+      "Ψ": 1023,
+      "α": 1024,
+      "ε": 1025,
+      "η": 1026,
+      "υ": 1027,
+      "β": 1028,
+      "γ": 1029,
+      "δ": 1030,
+      "ζ": 1031,
+      "κ": 1032,
+      "λ": 1033,
+      "ν": 1034,
+      "ξ": 1035,
+      "ο": 1036,
+      "π": 1037,
+      "ρ": 1038,
+      "ς": 1039,
+      "σ": 1040,
+      "τ": 1041,
+      "φ": 1042,
+      "χ": 1043,
+      "ψ": 1044,
+      "ω": 1045,
+      "Ϗ": 1046,
+      "ϗ": 1047,
+      "Ϙ": 1048,
+      "ϙ": 1049,
+      "Ϛ": 1050,
+      "ϛ": 1051,
+      "Ϝ": 1052,
+      "ϝ": 1053,
+      "Ϟ": 1054,
+      "ϟ": 1055,
+      "Ϡ": 1056,
+      "ϡ": 1057,
+      "Ϣ": 1058,
+      "ϣ": 1059,
+      "Ϥ": 1060,
+      "ϥ": 1061,
+      "Ϧ": 1062,
+      "ϧ": 1063,
+      "Ϩ": 1064,
+      "ϩ": 1065,
+      "Ϫ": 1066,
+      "ϫ": 1067,
+      "Ϭ": 1068,
+      "ϭ": 1069,
+      "Ϯ": 1070,
+      "ϯ": 1071,
+      "ϳ": 1072,
+      "϶": 1073,
+      "Ϸ": 1074,
+      "ϸ": 1075,
+      "Ϻ": 1076,
+      "ϻ": 1077,
+      "ϼ": 1078,
+      "Ͻ": 1079,
+      "Ͼ": 1080,
+      "Ͽ": 1081,
+      "Е": 1082,
+      "Ђ": 1083,
+      "Г": 1084,
+      "Є": 1085,
+      "Ѕ": 1086,
+      "І": 1087,
+      "Ј": 1088,
+      "Љ": 1089,
+      "Њ": 1090,
+      "Ћ": 1091,
+      "К": 1092,
+      "И": 1093,
+      "У": 1094,
+      "Џ": 1095,
+      "А": 1096,
+      "Б": 1097,
+      "В": 1098,
+      "Д": 1099,
+      "Ж": 1100,
+      "З": 1101,
+      "Л": 1102,
+      "М": 1103,
+      "Н": 1104,
+      "О": 1105,
+      "П": 1106,
+      "Р": 1107,
+      "С": 1108,
+      "Т": 1109,
+      "Ф": 1110,
+      "Х": 1111,
+      "Ц": 1112,
+      "Ч": 1113,
+      "Ш": 1114,
+      "Щ": 1115,
+      "Ъ": 1116,
+      "Ы": 1117,
+      "Ь": 1118,
+      "Э": 1119,
+      "Ю": 1120,
+      "Я": 1121,
+      "а": 1122,
+      "б": 1123,
+      "в": 1124,
+      "г": 1125,
+      "д": 1126,
+      "е": 1127,
+      "ж": 1128,
+      "з": 1129,
+      "и": 1130,
+      "к": 1131,
+      "л": 1132,
+      "м": 1133,
+      "н": 1134,
+      "о": 1135,
+      "п": 1136,
+      "р": 1137,
+      "с": 1138,
+      "т": 1139,
+      "у": 1140,
+      "ф": 1141,
+      "х": 1142,
+      "ц": 1143,
+      "ч": 1144,
+      "ш": 1145,
+      "щ": 1146,
+      "ъ": 1147,
+      "ы": 1148,
+      "ь": 1149,
+      "э": 1150,
+      "ю": 1151,
+      "я": 1152,
+      "ђ": 1153,
+      "є": 1154,
+      "ѕ": 1155,
+      "і": 1156,
+      "ј": 1157,
+      "љ": 1158,
+      "њ": 1159,
+      "ћ": 1160,
+      "џ": 1161,
+      "Ѡ": 1162,
+      "ѡ": 1163,
+      "Ѣ": 1164,
+      "ѣ": 1165,
+      "Ѥ": 1166,
+      "ѥ": 1167,
+      "Ѧ": 1168,
+      "ѧ": 1169,
+      "Ѩ": 1170,
+      "ѩ": 1171,
+      "Ѫ": 1172,
+      "ѫ": 1173,
+      "Ѭ": 1174,
+      "ѭ": 1175,
+      "Ѯ": 1176,
+      "ѯ": 1177,
+      "Ѱ": 1178,
+      "ѱ": 1179,
+      "Ѳ": 1180,
+      "ѳ": 1181,
+      "Ѵ": 1182,
+      "ѵ": 1183,
+      "Ѹ": 1184,
+      "ѹ": 1185,
+      "Ѻ": 1186,
+      "ѻ": 1187,
+      "Ѽ": 1188,
+      "ѽ": 1189,
+      "Ѿ": 1190,
+      "ѿ": 1191,
+      "Ҁ": 1192,
+      "ҁ": 1193,
+      "҂": 1194,
+      "҃": 1195,
+      "҄": 1196,
+      "҅": 1197,
+      "҆": 1198,
+      "҇": 1199,
+      "҈": 1200,
+      "҉": 1201,
+      "Ҋ": 1202,
+      "ҋ": 1203,
+      "Ҍ": 1204,
+      "ҍ": 1205,
+      "Ҏ": 1206,
+      "ҏ": 1207,
+      "Ґ": 1208,
+      "ґ": 1209,
+      "Ғ": 1210,
+      "ғ": 1211,
+      "Ҕ": 1212,
+      "ҕ": 1213,
+      "Җ": 1214,
+      "җ": 1215,
+      "Ҙ": 1216,
+      "ҙ": 1217,
+      "Қ": 1218,
+      "қ": 1219,
+      "Ҝ": 1220,
+      "ҝ": 1221,
+      "Ҟ": 1222,
+      "ҟ": 1223,
+      "Ҡ": 1224,
+      "ҡ": 1225,
+      "Ң": 1226,
+      "ң": 1227,
+      "Ҥ": 1228,
+      "ҥ": 1229,
+      "Ҧ": 1230,
+      "ҧ": 1231,
+      "Ҩ": 1232,
+      "ҩ": 1233,
+      "Ҫ": 1234,
+      "ҫ": 1235,
+      "Ҭ": 1236,
+      "ҭ": 1237,
+      "Ү": 1238,
+      "ү": 1239,
+      "Ұ": 1240,
+      "ұ": 1241,
+      "Ҳ": 1242,
+      "ҳ": 1243,
+      "Ҵ": 1244,
+      "ҵ": 1245,
+      "Ҷ": 1246,
+      "ҷ": 1247,
+      "Ҹ": 1248,
+      "ҹ": 1249,
+      "Һ": 1250,
+      "һ": 1251,
+      "Ҽ": 1252,
+      "ҽ": 1253,
+      "Ҿ": 1254,
+      "ҿ": 1255,
+      "Ӏ": 1256,
+      "Ӄ": 1257,
+      "ӄ": 1258,
+      "Ӆ": 1259,
+      "ӆ": 1260,
+      "Ӈ": 1261,
+      "ӈ": 1262,
+      "Ӊ": 1263,
+      "ӊ": 1264,
+      "Ӌ": 1265,
+      "ӌ": 1266,
+      "Ӎ": 1267,
+      "ӎ": 1268,
+      "ӏ": 1269,
+      "Ӕ": 1270,
+      "ӕ": 1271,
+      "Ә": 1272,
+      "ә": 1273,
+      "Ӡ": 1274,
+      "ӡ": 1275,
+      "Ө": 1276,
+      "ө": 1277,
+      "Ӷ": 1278,
+      "ӷ": 1279,
+      "Ӻ": 1280,
+      "ӻ": 1281,
+      "Ӽ": 1282,
+      "ӽ": 1283,
+      "Ӿ": 1284,
+      "ӿ": 1285,
+      "Ԁ": 1286,
+      "ԁ": 1287,
+      "Ԃ": 1288,
+      "ԃ": 1289,
+      "Ԅ": 1290,
+      "ԅ": 1291,
+      "Ԇ": 1292,
+      "ԇ": 1293,
+      "Ԉ": 1294,
+      "ԉ": 1295,
+      "Ԋ": 1296,
+      "ԋ": 1297,
+      "Ԍ": 1298,
+      "ԍ": 1299,
+      "Ԏ": 1300,
+      "ԏ": 1301,
+      "Ԑ": 1302,
+      "ԑ": 1303,
+      "Ԓ": 1304,
+      "ԓ": 1305,
+      "Ԕ": 1306,
+      "ԕ": 1307,
+      "Ԗ": 1308,
+      "ԗ": 1309,
+      "Ԙ": 1310,
+      "ԙ": 1311,
+      "Ԛ": 1312,
+      "ԛ": 1313,
+      "Ԝ": 1314,
+      "ԝ": 1315,
+      "Ԟ": 1316,
+      "ԟ": 1317,
+      "Ԡ": 1318,
+      "ԡ": 1319,
+      "Ԣ": 1320,
+      "ԣ": 1321,
+      "Ԥ": 1322,
+      "ԥ": 1323,
+      "Ԧ": 1324,
+      "ԧ": 1325,
+      "Ԩ": 1326,
+      "ԩ": 1327,
+      "Ԫ": 1328,
+      "ԫ": 1329,
+      "Ԭ": 1330,
+      "ԭ": 1331,
+      "Ԯ": 1332,
+      "ԯ": 1333,
+      "֑": 1334,
+      "֒": 1335,
+      "֓": 1336,
+      "֔": 1337,
+      "֕": 1338,
+      "֖": 1339,
+      "֗": 1340,
+      "֘": 1341,
+      "֙": 1342,
+      "֚": 1343,
+      "֛": 1344,
+      "֜": 1345,
+      "֝": 1346,
+      "֞": 1347,
+      "֟": 1348,
+      "֠": 1349,
+      "֡": 1350,
+      "֢": 1351,
+      "֣": 1352,
+      "֤": 1353,
+      "֥": 1354,
+      "֦": 1355,
+      "֧": 1356,
+      "֨": 1357,
+      "֩": 1358,
+      "֪": 1359,
+      "֫": 1360,
+      "֬": 1361,
+      "֭": 1362,
+      "֮": 1363,
+      "֯": 1364,
+      "ְ": 1365,
+      "ֱ": 1366,
+      "ֲ": 1367,
+      "ֳ": 1368,
+      "ִ": 1369,
+      "ֵ": 1370,
+      "ֶ": 1371,
+      "ַ": 1372,
+      "ָ": 1373,
+      "ֹ": 1374,
+      "ֺ": 1375,
+      "ֻ": 1376,
+      "ּ": 1377,
+      "ֽ": 1378,
+      "־": 1379,
+      "ֿ": 1380,
+      "׀": 1381,
+      "ׁ": 1382,
+      "ׂ": 1383,
+      "׃": 1384,
+      "ׄ": 1385,
+      "ׅ": 1386,
+      "׆": 1387,
+      "ׇ": 1388,
+      "א": 1389,
+      "ב": 1390,
+      "ג": 1391,
+      "ד": 1392,
+      "ה": 1393,
+      "ו": 1394,
+      "ז": 1395,
+      "ח": 1396,
+      "ט": 1397,
+      "י": 1398,
+      "ך": 1399,
+      "כ": 1400,
+      "ל": 1401,
+      "ם": 1402,
+      "מ": 1403,
+      "ן": 1404,
+      "נ": 1405,
+      "ס": 1406,
+      "ע": 1407,
+      "ף": 1408,
+      "פ": 1409,
+      "ץ": 1410,
+      "צ": 1411,
+      "ק": 1412,
+      "ר": 1413,
+      "ש": 1414,
+      "ת": 1415,
+      "ׯ": 1416,
+      "װ": 1417,
+      "ױ": 1418,
+      "ײ": 1419,
+      "׳": 1420,
+      "״": 1421,
+      "؀": 1422,
+      "؁": 1423,
+      "؂": 1424,
+      "؃": 1425,
+      "؄": 1426,
+      "؅": 1427,
+      "؆": 1428,
+      "؇": 1429,
+      "؈": 1430,
+      "؉": 1431,
+      "؊": 1432,
+      "؋": 1433,
+      "،": 1434,
+      "؍": 1435,
+      "؎": 1436,
+      "؏": 1437,
+      "ؐ": 1438,
+      "ؑ": 1439,
+      "ؒ": 1440,
+      "ؓ": 1441,
+      "ؔ": 1442,
+      "ؕ": 1443,
+      "ؖ": 1444,
+      "ؗ": 1445,
+      "ؘ": 1446,
+      "ؙ": 1447,
+      "ؚ": 1448,
+      "؛": 1449,
+      "؜": 1450,
+      "؝": 1451,
+      "؞": 1452,
+      "؟": 1453,
+      "ؠ": 1454,
+      "ء": 1455,
+      "ا": 1456,
+      "ٓ": 1457,
+      "ٔ": 1458,
+      "و": 1459,
+      "ٕ": 1460,
+      "ي": 1461,
+      "ب": 1462,
+      "ة": 1463,
+      "ت": 1464,
+      "ث": 1465,
+      "ج": 1466,
+      "ح": 1467,
+      "خ": 1468,
+      "د": 1469,
+      "ذ": 1470,
+      "ر": 1471,
+      "ز": 1472,
+      "س": 1473,
+      "ش": 1474,
+      "ص": 1475,
+      "ض": 1476,
+      "ط": 1477,
+      "ظ": 1478,
+      "ع": 1479,
+      "غ": 1480,
+      "ػ": 1481,
+      "ؼ": 1482,
+      "ؽ": 1483,
+      "ؾ": 1484,
+      "ؿ": 1485,
+      "ـ": 1486,
+      "ف": 1487,
+      "ق": 1488,
+      "ك": 1489,
+      "ل": 1490,
+      "م": 1491,
+      "ن": 1492,
+      "ه": 1493,
+      "ى": 1494,
+      "ً": 1495,
+      "ٌ": 1496,
+      "ٍ": 1497,
+      "َ": 1498,
+      "ُ": 1499,
+      "ِ": 1500,
+      "ّ": 1501,
+      "ْ": 1502,
+      "ٖ": 1503,
+      "ٗ": 1504,
+      "٘": 1505,
+      "ٙ": 1506,
+      "ٚ": 1507,
+      "ٛ": 1508,
+      "ٜ": 1509,
+      "ٝ": 1510,
+      "ٞ": 1511,
+      "ٟ": 1512,
+      "٠": 1513,
+      "١": 1514,
+      "٢": 1515,
+      "٣": 1516,
+      "٤": 1517,
+      "٥": 1518,
+      "٦": 1519,
+      "٧": 1520,
+      "٨": 1521,
+      "٩": 1522,
+      "٪": 1523,
+      "٫": 1524,
+      "٬": 1525,
+      "٭": 1526,
+      "ٮ": 1527,
+      "ٯ": 1528,
+      "ٰ": 1529,
+      "ٱ": 1530,
+      "ٲ": 1531,
+      "ٳ": 1532,
+      "ٴ": 1533,
+      "ۇ": 1534,
+      "ٹ": 1535,
+      "ٺ": 1536,
+      "ٻ": 1537,
+      "ټ": 1538,
+      "ٽ": 1539,
+      "پ": 1540,
+      "ٿ": 1541,
+      "ڀ": 1542,
+      "ځ": 1543,
+      "ڂ": 1544,
+      "ڃ": 1545,
+      "ڄ": 1546,
+      "څ": 1547,
+      "چ": 1548,
+      "ڇ": 1549,
+      "ڈ": 1550,
+      "ډ": 1551,
+      "ڊ": 1552,
+      "ڋ": 1553,
+      "ڌ": 1554,
+      "ڍ": 1555,
+      "ڎ": 1556,
+      "ڏ": 1557,
+      "ڐ": 1558,
+      "ڑ": 1559,
+      "ڒ": 1560,
+      "ړ": 1561,
+      "ڔ": 1562,
+      "ڕ": 1563,
+      "ږ": 1564,
+      "ڗ": 1565,
+      "ژ": 1566,
+      "ڙ": 1567,
+      "ښ": 1568,
+      "ڛ": 1569,
+      "ڜ": 1570,
+      "ڝ": 1571,
+      "ڞ": 1572,
+      "ڟ": 1573,
+      "ڠ": 1574,
+      "ڡ": 1575,
+      "ڢ": 1576,
+      "ڣ": 1577,
+      "ڤ": 1578,
+      "ڥ": 1579,
+      "ڦ": 1580,
+      "ڧ": 1581,
+      "ڨ": 1582,
+      "ک": 1583,
+      "ڪ": 1584,
+      "ګ": 1585,
+      "ڬ": 1586,
+      "ڭ": 1587,
+      "ڮ": 1588,
+      "گ": 1589,
+      "ڰ": 1590,
+      "ڱ": 1591,
+      "ڲ": 1592,
+      "ڳ": 1593,
+      "ڴ": 1594,
+      "ڵ": 1595,
+      "ڶ": 1596,
+      "ڷ": 1597,
+      "ڸ": 1598,
+      "ڹ": 1599,
+      "ں": 1600,
+      "ڻ": 1601,
+      "ڼ": 1602,
+      "ڽ": 1603,
+      "ھ": 1604,
+      "ڿ": 1605,
+      "ە": 1606,
+      "ہ": 1607,
+      "ۃ": 1608,
+      "ۄ": 1609,
+      "ۅ": 1610,
+      "ۆ": 1611,
+      "ۈ": 1612,
+      "ۉ": 1613,
+      "ۊ": 1614,
+      "ۋ": 1615,
+      "ی": 1616,
+      "ۍ": 1617,
+      "ێ": 1618,
+      "ۏ": 1619,
+      "ې": 1620,
+      "ۑ": 1621,
+      "ے": 1622,
+      "۔": 1623,
+      "ۖ": 1624,
+      "ۗ": 1625,
+      "ۘ": 1626,
+      "ۙ": 1627,
+      "ۚ": 1628,
+      "ۛ": 1629,
+      "ۜ": 1630,
+      "۝": 1631,
+      "۞": 1632,
+      "۟": 1633,
+      "۠": 1634,
+      "ۡ": 1635,
+      "ۢ": 1636,
+      "ۣ": 1637,
+      "ۤ": 1638,
+      "ۥ": 1639,
+      "ۦ": 1640,
+      "ۧ": 1641,
+      "ۨ": 1642,
+      "۩": 1643,
+      "۪": 1644,
+      "۫": 1645,
+      "۬": 1646,
+      "ۭ": 1647,
+      "ۮ": 1648,
+      "ۯ": 1649,
+      "۰": 1650,
+      "۱": 1651,
+      "۲": 1652,
+      "۳": 1653,
+      "۴": 1654,
+      "۵": 1655,
+      "۶": 1656,
+      "۷": 1657,
+      "۸": 1658,
+      "۹": 1659,
+      "ۺ": 1660,
+      "ۻ": 1661,
+      "ۼ": 1662,
+      "۽": 1663,
+      "۾": 1664,
+      "ۿ": 1665,
+      "ऀ": 1666,
+      "ँ": 1667,
+      "ं": 1668,
+      "ः": 1669,
+      "ऄ": 1670,
+      "अ": 1671,
+      "आ": 1672,
+      "इ": 1673,
+      "ई": 1674,
+      "उ": 1675,
+      "ऊ": 1676,
+      "ऋ": 1677,
+      "ऌ": 1678,
+      "ऍ": 1679,
+      "ऎ": 1680,
+      "ए": 1681,
+      "ऐ": 1682,
+      "ऑ": 1683,
+      "ऒ": 1684,
+      "ओ": 1685,
+      "औ": 1686,
+      "क": 1687,
+      "ख": 1688,
+      "ग": 1689,
+      "घ": 1690,
+      "ङ": 1691,
+      "च": 1692,
+      "छ": 1693,
+      "ज": 1694,
+      "झ": 1695,
+      "ञ": 1696,
+      "ट": 1697,
+      "ठ": 1698,
+      "ड": 1699,
+      "ढ": 1700,
+      "ण": 1701,
+      "त": 1702,
+      "थ": 1703,
+      "द": 1704,
+      "ध": 1705,
+      "न": 1706,
+      "़": 1707,
+      "प": 1708,
+      "फ": 1709,
+      "ब": 1710,
+      "भ": 1711,
+      "म": 1712,
+      "य": 1713,
+      "र": 1714,
+      "ल": 1715,
+      "ळ": 1716,
+      "व": 1717,
+      "श": 1718,
+      "ष": 1719,
+      "स": 1720,
+      "ह": 1721,
+      "ऺ": 1722,
+      "ऻ": 1723,
+      "ऽ": 1724,
+      "ा": 1725,
+      "ि": 1726,
+      "ी": 1727,
+      "ु": 1728,
+      "ू": 1729,
+      "ृ": 1730,
+      "ॄ": 1731,
+      "ॅ": 1732,
+      "ॆ": 1733,
+      "े": 1734,
+      "ै": 1735,
+      "ॉ": 1736,
+      "ॊ": 1737,
+      "ो": 1738,
+      "ौ": 1739,
+      "्": 1740,
+      "ॎ": 1741,
+      "ॏ": 1742,
+      "ॐ": 1743,
+      "॑": 1744,
+      "॒": 1745,
+      "॓": 1746,
+      "॔": 1747,
+      "ॕ": 1748,
+      "ॖ": 1749,
+      "ॗ": 1750,
+      "ॠ": 1751,
+      "ॡ": 1752,
+      "ॢ": 1753,
+      "ॣ": 1754,
+      "।": 1755,
+      "॥": 1756,
+      "०": 1757,
+      "१": 1758,
+      "२": 1759,
+      "३": 1760,
+      "४": 1761,
+      "५": 1762,
+      "६": 1763,
+      "७": 1764,
+      "८": 1765,
+      "९": 1766,
+      "॰": 1767,
+      "ॱ": 1768,
+      "ॲ": 1769,
+      "ॳ": 1770,
+      "ॴ": 1771,
+      "ॵ": 1772,
+      "ॶ": 1773,
+      "ॷ": 1774,
+      "ॸ": 1775,
+      "ॹ": 1776,
+      "ॺ": 1777,
+      "ॻ": 1778,
+      "ॼ": 1779,
+      "ॽ": 1780,
+      "ॾ": 1781,
+      "ॿ": 1782,
+      "ᄀ": 1783,
+      "ᄁ": 1784,
+      "ᄂ": 1785,
+      "ᄃ": 1786,
+      "ᄄ": 1787,
+      "ᄅ": 1788,
+      "ᄆ": 1789,
+      "ᄇ": 1790,
+      "ᄈ": 1791,
+      "ᄉ": 1792,
+      "ᄊ": 1793,
+      "ᄋ": 1794,
+      "ᄌ": 1795,
+      "ᄍ": 1796,
+      "ᄎ": 1797,
+      "ᄏ": 1798,
+      "ᄐ": 1799,
+      "ᄑ": 1800,
+      "ᄒ": 1801,
+      "ᄓ": 1802,
+      "ᄔ": 1803,
+      "ᄕ": 1804,
+      "ᄖ": 1805,
+      "ᄗ": 1806,
+      "ᄘ": 1807,
+      "ᄙ": 1808,
+      "ᄚ": 1809,
+      "ᄛ": 1810,
+      "ᄜ": 1811,
+      "ᄝ": 1812,
+      "ᄞ": 1813,
+      "ᄟ": 1814,
+      "ᄠ": 1815,
+      "ᄡ": 1816,
+      "ᄢ": 1817,
+      "ᄣ": 1818,
+      "ᄤ": 1819,
+      "ᄥ": 1820,
+      "ᄦ": 1821,
+      "ᄧ": 1822,
+      "ᄨ": 1823,
+      "ᄩ": 1824,
+      "ᄪ": 1825,
+      "ᄫ": 1826,
+      "ᄬ": 1827,
+      "ᄭ": 1828,
+      "ᄮ": 1829,
+      "ᄯ": 1830,
+      "ᄰ": 1831,
+      "ᄱ": 1832,
+      "ᄲ": 1833,
+      "ᄳ": 1834,
+      "ᄴ": 1835,
+      "ᄵ": 1836,
+      "ᄶ": 1837,
+      "ᄷ": 1838,
+      "ᄸ": 1839,
+      "ᄹ": 1840,
+      "ᄺ": 1841,
+      "ᄻ": 1842,
+      "ᄼ": 1843,
+      "ᄽ": 1844,
+      "ᄾ": 1845,
+      "ᄿ": 1846,
+      "ᅀ": 1847,
+      "ᅁ": 1848,
+      "ᅂ": 1849,
+      "ᅃ": 1850,
+      "ᅄ": 1851,
+      "ᅅ": 1852,
+      "ᅆ": 1853,
+      "ᅇ": 1854,
+      "ᅈ": 1855,
+      "ᅉ": 1856,
+      "ᅊ": 1857,
+      "ᅋ": 1858,
+      "ᅌ": 1859,
+      "ᅍ": 1860,
+      "ᅎ": 1861,
+      "ᅏ": 1862,
+      "ᅐ": 1863,
+      "ᅑ": 1864,
+      "ᅒ": 1865,
+      "ᅓ": 1866,
+      "ᅔ": 1867,
+      "ᅕ": 1868,
+      "ᅖ": 1869,
+      "ᅗ": 1870,
+      "ᅘ": 1871,
+      "ᅙ": 1872,
+      "ᅚ": 1873,
+      "ᅛ": 1874,
+      "ᅜ": 1875,
+      "ᅝ": 1876,
+      "ᅞ": 1877,
+      "ᅟ": 1878,
+      "ᅠ": 1879,
+      "ᅡ": 1880,
+      "ᅢ": 1881,
+      "ᅣ": 1882,
+      "ᅤ": 1883,
+      "ᅥ": 1884,
+      "ᅦ": 1885,
+      "ᅧ": 1886,
+      "ᅨ": 1887,
+      "ᅩ": 1888,
+      "ᅪ": 1889,
+      "ᅫ": 1890,
+      "ᅬ": 1891,
+      "ᅭ": 1892,
+      "ᅮ": 1893,
+      "ᅯ": 1894,
+      "ᅰ": 1895,
+      "ᅱ": 1896,
+      "ᅲ": 1897,
+      "ᅳ": 1898,
+      "ᅴ": 1899,
+      "ᅵ": 1900,
+      "ᅶ": 1901,
+      "ᅷ": 1902,
+      "ᅸ": 1903,
+      "ᅹ": 1904,
+      "ᅺ": 1905,
+      "ᅻ": 1906,
+      "ᅼ": 1907,
+      "ᅽ": 1908,
+      "ᅾ": 1909,
+      "ᅿ": 1910,
+      "ᆀ": 1911,
+      "ᆁ": 1912,
+      "ᆂ": 1913,
+      "ᆃ": 1914,
+      "ᆄ": 1915,
+      "ᆅ": 1916,
+      "ᆆ": 1917,
+      "ᆇ": 1918,
+      "ᆈ": 1919,
+      "ᆉ": 1920,
+      "ᆊ": 1921,
+      "ᆋ": 1922,
+      "ᆌ": 1923,
+      "ᆍ": 1924,
+      "ᆎ": 1925,
+      "ᆏ": 1926,
+      "ᆐ": 1927,
+      "ᆑ": 1928,
+      "ᆒ": 1929,
+      "ᆓ": 1930,
+      "ᆔ": 1931,
+      "ᆕ": 1932,
+      "ᆖ": 1933,
+      "ᆗ": 1934,
+      "ᆘ": 1935,
+      "ᆙ": 1936,
+      "ᆚ": 1937,
+      "ᆛ": 1938,
+      "ᆜ": 1939,
+      "ᆝ": 1940,
+      "ᆞ": 1941,
+      "ᆟ": 1942,
+      "ᆠ": 1943,
+      "ᆡ": 1944,
+      "ᆢ": 1945,
+      "ᆣ": 1946,
+      "ᆤ": 1947,
+      "ᆥ": 1948,
+      "ᆦ": 1949,
+      "ᆧ": 1950,
+      "ᆨ": 1951,
+      "ᆩ": 1952,
+      "ᆪ": 1953,
+      "ᆫ": 1954,
+      "ᆬ": 1955,
+      "ᆭ": 1956,
+      "ᆮ": 1957,
+      "ᆯ": 1958,
+      "ᆰ": 1959,
+      "ᆱ": 1960,
+      "ᆲ": 1961,
+      "ᆳ": 1962,
+      "ᆴ": 1963,
+      "ᆵ": 1964,
+      "ᆶ": 1965,
+      "ᆷ": 1966,
+      "ᆸ": 1967,
+      "ᆹ": 1968,
+      "ᆺ": 1969,
+      "ᆻ": 1970,
+      "ᆼ": 1971,
+      "ᆽ": 1972,
+      "ᆾ": 1973,
+      "ᆿ": 1974,
+      "ᇀ": 1975,
+      "ᇁ": 1976,
+      "ᇂ": 1977,
+      "ᇃ": 1978,
+      "ᇄ": 1979,
+      "ᇅ": 1980,
+      "ᇆ": 1981,
+      "ᇇ": 1982,
+      "ᇈ": 1983,
+      "ᇉ": 1984,
+      "ᇊ": 1985,
+      "ᇋ": 1986,
+      "ᇌ": 1987,
+      "ᇍ": 1988,
+      "ᇎ": 1989,
+      "ᇏ": 1990,
+      "ᇐ": 1991,
+      "ᇑ": 1992,
+      "ᇒ": 1993,
+      "ᇓ": 1994,
+      "ᇔ": 1995,
+      "ᇕ": 1996,
+      "ᇖ": 1997,
+      "ᇗ": 1998,
+      "ᇘ": 1999,
+      "ᇙ": 2000,
+      "ᇚ": 2001,
+      "ᇛ": 2002,
+      "ᇜ": 2003,
+      "ᇝ": 2004,
+      "ᇞ": 2005,
+      "ᇟ": 2006,
+      "ᇠ": 2007,
+      "ᇡ": 2008,
+      "ᇢ": 2009,
+      "ᇣ": 2010,
+      "ᇤ": 2011,
+      "ᇥ": 2012,
+      "ᇦ": 2013,
+      "ᇧ": 2014,
+      "ᇨ": 2015,
+      "ᇩ": 2016,
+      "ᇪ": 2017,
+      "ᇫ": 2018,
+      "ᇬ": 2019,
+      "ᇭ": 2020,
+      "ᇮ": 2021,
+      "ᇯ": 2022,
+      "ᇰ": 2023,
+      "ᇱ": 2024,
+      "ᇲ": 2025,
+      "ᇳ": 2026,
+      "ᇴ": 2027,
+      "ᇵ": 2028,
+      "ᇶ": 2029,
+      "ᇷ": 2030,
+      "ᇸ": 2031,
+      "ᇹ": 2032,
+      "ᇺ": 2033,
+      "ᇻ": 2034,
+      "ᇼ": 2035,
+      "ᇽ": 2036,
+      "ᇾ": 2037,
+      "ᇿ": 2038,
+      "ẜ": 2039,
+      "ẝ": 2040,
+      "ẞ": 2041,
+      "ẟ": 2042,
+      "Ỻ": 2043,
+      "ỻ": 2044,
+      "Ỽ": 2045,
+      "ỽ": 2046,
+      "Ỿ": 2047,
+      "ỿ": 2048,
+      "​": 2049,
+      "‌": 2050,
+      "‍": 2051,
+      "[cj_3]": 2052,
+      "[cj_4]": 2053,
+      "†": 2054,
+      "‡": 2055,
+      "•": 2056,
+      "‣": 2057,
+      "‧": 2058,
+      "[cj_5]": 2059,
+      "[cj_6]": 2060,
+      "[cj_7]": 2061,
+      "[cj_8]": 2062,
+      "[cj_9]": 2063,
+      "[cj_.]": 2064,
+      "₹": 2065,
+      "‰": 2066,
+      "‱": 2067,
+      "′": 2068,
+      "‵": 2069,
+      "‸": 2070,
+      "‹": 2071,
+      "›": 2072,
+      "※": 2073,
+      "‽": 2074,
+      "‿": 2075,
+      "⁀": 2076,
+      "⁁": 2077,
+      "⁂": 2078,
+      "⁃": 2079,
+      "⁅": 2080,
+      "⁆": 2081,
+      "⁊": 2082,
+      "⁋": 2083,
+      "⁌": 2084,
+      "⁍": 2085,
+      "⁎": 2086,
+      "⁏": 2087,
+      "⁐": 2088,
+      "⁑": 2089,
+      "⁒": 2090,
+      "⁓": 2091,
+      "⁔": 2092,
+      "⁕": 2093,
+      "⁖": 2094,
+      "⁘": 2095,
+      "⁙": 2096,
+      "⁚": 2097,
+      "⁛": 2098,
+      "⁜": 2099,
+      "⁝": 2100,
+      "⁞": 2101,
+      "⁠": 2102,
+      "⁡": 2103,
+      "⁢": 2104,
+      "⁣": 2105,
+      "⁤": 2106,
+      "[fi]": 2107,
+      "[ta]": 2108,
+      "[ms]": 2109,
+      "[he]": 2110,
+      "": 2111,
+      "": 2112,
+      "": 2113,
+      "": 2114,
+      "": 2115,
+      "": 2116,
+      "−": 2117,
+      "、": 2118,
+      "。": 2119,
+      "〃": 2120,
+      "〄": 2121,
+      "々": 2122,
+      "〆": 2123,
+      "〇": 2124,
+      "〈": 2125,
+      "〉": 2126,
+      "《": 2127,
+      "》": 2128,
+      "「": 2129,
+      "」": 2130,
+      "『": 2131,
+      "』": 2132,
+      "【": 2133,
+      "】": 2134,
+      "〒": 2135,
+      "〓": 2136,
+      "〔": 2137,
+      "〕": 2138,
+      "〖": 2139,
+      "〗": 2140,
+      "〘": 2141,
+      "〙": 2142,
+      "〚": 2143,
+      "〛": 2144,
+      "〜": 2145,
+      "〝": 2146,
+      "〞": 2147,
+      "〟": 2148,
+      "ぁ": 2149,
+      "あ": 2150,
+      "ぃ": 2151,
+      "い": 2152,
+      "ぅ": 2153,
+      "う": 2154,
+      "ぇ": 2155,
+      "え": 2156,
+      "ぉ": 2157,
+      "お": 2158,
+      "か": 2159,
+      "゙": 2160,
+      "き": 2161,
+      "く": 2162,
+      "け": 2163,
+      "こ": 2164,
+      "さ": 2165,
+      "し": 2166,
+      "す": 2167,
+      "せ": 2168,
+      "そ": 2169,
+      "た": 2170,
+      "ち": 2171,
+      "っ": 2172,
+      "つ": 2173,
+      "て": 2174,
+      "と": 2175,
+      "な": 2176,
+      "に": 2177,
+      "ぬ": 2178,
+      "ね": 2179,
+      "の": 2180,
+      "は": 2181,
+      "゚": 2182,
+      "ひ": 2183,
+      "ふ": 2184,
+      "へ": 2185,
+      "ほ": 2186,
+      "ま": 2187,
+      "み": 2188,
+      "む": 2189,
+      "め": 2190,
+      "も": 2191,
+      "ゃ": 2192,
+      "や": 2193,
+      "ゅ": 2194,
+      "ゆ": 2195,
+      "ょ": 2196,
+      "よ": 2197,
+      "ら": 2198,
+      "り": 2199,
+      "る": 2200,
+      "れ": 2201,
+      "ろ": 2202,
+      "ゎ": 2203,
+      "わ": 2204,
+      "ゐ": 2205,
+      "ゑ": 2206,
+      "を": 2207,
+      "ん": 2208,
+      "ゕ": 2209,
+      "ゖ": 2210,
+      "ゝ": 2211,
+      "゠": 2212,
+      "ァ": 2213,
+      "ア": 2214,
+      "ィ": 2215,
+      "イ": 2216,
+      "ゥ": 2217,
+      "ウ": 2218,
+      "ェ": 2219,
+      "エ": 2220,
+      "ォ": 2221,
+      "オ": 2222,
+      "カ": 2223,
+      "キ": 2224,
+      "ク": 2225,
+      "ケ": 2226,
+      "コ": 2227,
+      "サ": 2228,
+      "シ": 2229,
+      "ス": 2230,
+      "セ": 2231,
+      "ソ": 2232,
+      "タ": 2233,
+      "チ": 2234,
+      "ッ": 2235,
+      "ツ": 2236,
+      "テ": 2237,
+      "ト": 2238,
+      "ナ": 2239,
+      "ニ": 2240,
+      "ヌ": 2241,
+      "ネ": 2242,
+      "ノ": 2243,
+      "ハ": 2244,
+      "ヒ": 2245,
+      "フ": 2246,
+      "ヘ": 2247,
+      "ホ": 2248,
+      "マ": 2249,
+      "ミ": 2250,
+      "ム": 2251,
+      "メ": 2252,
+      "モ": 2253,
+      "ャ": 2254,
+      "ヤ": 2255,
+      "ュ": 2256,
+      "ユ": 2257,
+      "ョ": 2258,
+      "ヨ": 2259,
+      "ラ": 2260,
+      "リ": 2261,
+      "ル": 2262,
+      "レ": 2263,
+      "ロ": 2264,
+      "ヮ": 2265,
+      "ワ": 2266,
+      "ヰ": 2267,
+      "ヱ": 2268,
+      "ヲ": 2269,
+      "ン": 2270,
+      "ヵ": 2271,
+      "ヶ": 2272,
+      "・": 2273,
+      "ー": 2274,
+      "ヽ": 2275,
+      "ㄅ": 2276,
+      "ㄆ": 2277,
+      "ㄇ": 2278,
+      "ㄈ": 2279,
+      "ㄉ": 2280,
+      "ㄊ": 2281,
+      "ㄋ": 2282,
+      "ㄌ": 2283,
+      "ㄍ": 2284,
+      "ㄎ": 2285,
+      "ㄏ": 2286,
+      "ㄐ": 2287,
+      "ㄑ": 2288,
+      "ㄒ": 2289,
+      "ㄓ": 2290,
+      "ㄔ": 2291,
+      "ㄕ": 2292,
+      "ㄖ": 2293,
+      "ㄗ": 2294,
+      "ㄘ": 2295,
+      "ㄙ": 2296,
+      "ㄚ": 2297,
+      "ㄛ": 2298,
+      "ㄜ": 2299,
+      "ㄝ": 2300,
+      "ㄞ": 2301,
+      "ㄟ": 2302,
+      "ㄠ": 2303,
+      "ㄡ": 2304,
+      "ㄢ": 2305,
+      "ㄣ": 2306,
+      "ㄤ": 2307,
+      "ㄥ": 2308,
+      "ㄦ": 2309,
+      "ㄧ": 2310,
+      "ㄨ": 2311,
+      "ㄩ": 2312,
+      "ㄪ": 2313,
+      "ㄫ": 2314,
+      "ㄬ": 2315,
+      "ㄭ": 2316,
+      "ㄮ": 2317,
+      "ㄯ": 2318,
+      "ph": 2319,
+      "rr": 2320,
+      "gn": 2321,
+      "ng": 2322,
+      "dt": 2323,
+      "sj": 2324,
+      "uw": 2325,
+      "ff": 2326,
+      "gg": 2327,
+      "kk": 2328,
+      "nn": 2329,
+      "mm": 2330,
+      "ss": 2331,
+      "tt": 2332,
+      "zz": 2333,
+      "ds": 2334,
+      "ai": 2335,
+      "au": 2336,
+      "ea": 2337,
+      "ee": 2338,
+      "ei": 2339,
+      "eu": 2340,
+      "ew": 2341,
+      "ij": 2342,
+      "oa": 2343,
+      "oi": 2344,
+      "oo": 2345,
+      "ue": 2346,
+      "eau": 2347,
+      "tch": 2348,
+      "sch": 2349,
+      "🙊": 2350,
+      "🤭": 2351,
+      "€": 2352,
+      "أ": 2353,
+      "إ": 2354,
+      "ئ": 2355,
+      "آ": 2356,
+      "ؤ": 2357,
+      "ﻻ": 2358,
+      "ﺃ": 2359,
+      "ę": 2360,
+      "ą": 2361,
+      "ż": 2362,
+      "ś": 2363,
+      "ć": 2364,
+      "ń": 2365,
+      "ź": 2366,
+      "Ś": 2367,
+      "Ź": 2368,
+      "Ż": 2369,
+      "Ć": 2370,
+      "Š": 2371,
+      "Ő": 2372,
+      "й": 2373,
+      "ё": 2374,
+      "Й": 2375,
+      "Ё": 2376,
+      "が": 2377,
+      "で": 2378,
+      "じ": 2379,
+      "だ": 2380,
+      "ど": 2381,
+      "ば": 2382,
+      "げ": 2383,
+      "ご": 2384,
+      "ぶ": 2385,
+      "ぎ": 2386,
+      "，": 2387,
+      "（": 2388,
+      "：": 2389,
+      "；": 2390,
+      "？": 2391,
+      "！": 2392,
+      "＃": 2393,
+      " ）": 2394,
+      "ά": 2395,
+      "ό": 2396,
+      "ί": 2397,
+      "έ": 2398,
+      "ή": 2399,
+      "ύ": 2400,
+      "ώ": 2401,
+      "Έ": 2402,
+      "Ό": 2403,
+      "Ή": 2404, 
+      "ž": 2405,
+      "š": 2406,
+      "ū": 2407,
+      "ş": 2408,
+      "Ō": 2409,
+      "ī": 2410,
+      "č": 2411,
+      "ř": 2412,
+      "ă": 2413,
+      "이": 2414,
+      "기": 2415,
+      "요": 2416,
+      "에": 2417,
+      "다": 2418,
+      "을": 2419,
+      "은": 2420,
+      "서": 2421,
+      "니": 2422,
+      "어": 2423,
+      "ě": 2424,
+      "ů": 2425,
+      "Č": 2426,
+      "ň": 2427,
+      "ď": 2428,
+      "ť": 2429,
+      "♭": 2430,
+      "ľ": 2431,
+      "ĺ": 2432,
+      "ğ": 2433,
+      "İ": 2434,
+      "Ş": 2435,
+      "ड़": 2436,
+      "ढ़": 2437,
+      "ज़": 2438,
+      "फ़": 2439,
+      "ख़": 2440,
+      "क़": 2441,
+      "ग़": 2442,
+      "Ά": 2443,
+      "ϊ": 2444,
+      "Ί": 2445,
+      "Ύ": 2446,
+      "Ώ": 2447,
+      "ΐ": 2448,
+      "ϋ": 2449,
+      "ũ": 2450,
+      "ụ": 2451,
+      "ọ": 2452,
+      "ạ": 2453
+          },
+    "merges": [
+      "t h",
+      "i n",
+      "th e",
+      "a n",
+      "e r",
+      "o u",
+      "r e",
+      "o n",
+      "a t",
+      "e d",
+      "e n",
+      "t o",
+      "in g",
+      "an d",
+      "i s",
+      "a s",
+      "a l",
+      "o r",
+      "o f",
+      "a r",
+      "i t",
+      "e s",
+      "h e",
+      "s t",
+      "l e",
+      "o m",
+      "s e",
+      "b e",
+      "a d",
+      "o w",
+      "l y",
+      "c h",
+      "w h",
+      "th at",
+      "y ou",
+      "l i",
+      "v e",
+      "a c",
+      "t i",
+      "l d",
+      "m e",
+      "w as",
+      "g h",
+      "i d",
+      "l l",
+      "w i",
+      "en t",
+      "f or",
+      "a y",
+      "r o",
+      "v er",
+      "i c",
+      "h er",
+      "k e",
+      "h is",
+      "n o",
+      "u t",
+      "u n",
+      "i r",
+      "l o",
+      "w e",
+      "r i",
+      "h a",
+      "wi th",
+      "gh t",
+      "ou t",
+      "i m",
+      "i on",
+      "al l",
+      "a b",
+      "on e",
+      "n e",
+      "g e",
+      "ou ld",
+      "t er",
+      "m o",
+      "h ad",
+      "c e",
+      "s he",
+      "g o",
+      "s h",
+      "u r",
+      "a m",
+      "s o",
+      "p e",
+      "m y",
+      "d e",
+      "a re",
+      "b ut",
+      "om e",
+      "f r",
+      "the r",
+      "f e",
+      "s u",
+      "d o",
+      "c on",
+      "t e",
+      "a in",
+      "er e",
+      "p o",
+      "i f",
+      "the y",
+      "u s",
+      "a g",
+      "t r",
+      "n ow",
+      "ou n",
+      "th is",
+      "ha ve",
+      "no t",
+      "s a",
+      "i l",
+      "u p",
+      "th ing",
+      "fr om",
+      "a p",
+      "h im",
+      "ac k",
+      "at ion",
+      "an t",
+      "ou r",
+      "o p",
+      "li ke",
+      "u st",
+      "es s",
+      "b o",
+      "o k",
+      "u l",
+      "in d",
+      "e x",
+      "c om",
+      "s ome",
+      "the re",
+      "er s",
+      "c o",
+      "re s",
+      "m an",
+      "ar d",
+      "p l",
+      "w or",
+      "w ay",
+      "ti on",
+      "f o",
+      "c a",
+      "w ere",
+      "b y",
+      "at e",
+      "p ro",
+      "t ed",
+      "oun d",
+      "ow n",
+      "w ould",
+      "t s",
+      "wh at",
+      "q u",
+      "al ly",
+      "i ght",
+      "c k",
+      "g r",
+      "wh en",
+      "v en",
+      "c an",
+      "ou gh",
+      "in e",
+      "en d",
+      "p er",
+      "ou s",
+      "o d",
+      "id e",
+      "k now",
+      "t y",
+      "ver y",
+      "s i",
+      "a k",
+      "wh o",
+      "ab out",
+      "i ll",
+      "the m",
+      "es t",
+      "re d",
+      "y e",
+      "c ould",
+      "on g",
+      "you r",
+      "the ir",
+      "e m",
+      "j ust",
+      "o ther",
+      "in to",
+      "an y",
+      "wh i",
+      "u m",
+      "t w",
+      "as t",
+      "d er",
+      "d id",
+      "i e",
+      "be en",
+      "ac e",
+      "in k",
+      "it y",
+      "b ack",
+      "t ing",
+      "b r",
+      "mo re",
+      "a ke",
+      "p p",
+      "the n",
+      "s p",
+      "e l",
+      "u se",
+      "b l",
+      "sa id",
+      "o ver",
+      "ge t",
+      "ɑ ː",
+      "i ː",
+      "u ː",
+      "ɜ ː",
+      "ɔ ː",
+      "o ː",
+      "e ɪ",
+      "o ʊ",
+      "a ɪ",
+      "a ʊ",
+      "ɔ ɪ",
+      "d ʒ",
+      "t ʃ",
+      "ɪ ŋ",
+      "ᵻ d",
+      "ˈ iː",
+      "ˌ iː",
+      "ˈ ɪ",
+      "ˌ ɪ",
+      "ˈ eɪ",
+      "ˌ eɪ",
+      "ˈ ɛ",
+      "ˌ ɛ",
+      "ˈ æ",
+      "ˌ æ",
+      "ˈ ɑː",
+      "ˌ ɑː",
+      "ˈ ɔː",
+      "ˌ ɔː",
+      "oː ɹ",
+      "ˈ oːɹ",
+      "ˌ oːɹ",
+      "ˈ oʊ",
+      "ˌ oʊ",
+      "ˈ ʊ",
+      "ˌ ʊ",
+      "ˈ uː",
+      "ˌ uː",
+      "ˈ ɜː",
+      "ˌ ɜː",
+      "ˈ ʌ",
+      "ˌ ʌ",
+      "ˈ aɪ",
+      "ˌ aɪ",
+      "ˈ aʊ",
+      "ˌ aʊ",
+      "ˈ ɔɪ",
+      "ˌ ɔɪ",
+      "ˈ ɚ",
+      "ˌ ɐ"
+    ]
+  }
+}