Qwen3.5 4B W4 pack for the QAIRT 2.51 NPU runtime at e22fbfef (V81, V79, V75; NPU memory measured on V81 and V79 phones, V75 provisional); beside the Qwen3.5 4B pack for the runtime every app carries
Browse files- README.md +3 -1
- npu_pack_index.json +30 -0
README.md
CHANGED
|
@@ -44,6 +44,7 @@ pack; it cannot change the files of a pack your phone already checked.
|
|
| 44 |
| Qwen3.5 4B Claude 4.6 Opus Abliterated | [darkmaniac7/Qwen3.5-4B-Claude-4.6-Opus-abliterated-NPU-catalogpair](https://huggingface.co/darkmaniac7/Qwen3.5-4B-Claude-4.6-Opus-abliterated-NPU-catalogpair/tree/e3378b577741af08332e5908cac285140ba8c954) at `e3378b577741` | V81 3.67 GB, V75 3.65 GB | V81 5.90 GB, V75 5.85 GB | measured on phones for V81 and V75 |
|
| 45 |
| Qwen3.5 0.8B | [darkmaniac7/Qwen3.5-0.8B-NPU-catalogpair](https://huggingface.co/darkmaniac7/Qwen3.5-0.8B-NPU-catalogpair/tree/56aac1e38f036de3483e2c0261fb08acad7a1f6c) at `56aac1e38f03` | V81 0.53 GB, V75 0.52 GB | V81 2.17 GB, V75 2.10 GB | measured on phones for V81 and V75 |
|
| 46 |
| Qwen3.5 9B (QAIRT 2.51) | [darkmaniac7/Qwen3.5-9B-NPU-catalogpair](https://huggingface.co/darkmaniac7/Qwen3.5-9B-NPU-catalogpair/tree/9daa5ec6f6721a31082327e891693cc5c38dbef9) at `9daa5ec6f672` | V81 3.97 GB | V81 6.63 GB | measured on phones for V81 |
|
|
|
|
| 47 |
|
| 48 |
V81 is the Snapdragon 8 Elite Gen 5 (SM8850), V79 the Snapdragon 8 Elite (SM8750), V75 the Snapdragon 8 Gen 3 (SM8650). A chip
|
| 49 |
that has a download for a pack but is not in its `measured_arches` has not been tested on a phone by us yet; TokForge says so
|
|
@@ -54,7 +55,8 @@ uses that from then on.
|
|
| 54 |
|
| 55 |
Packs marked QAIRT 2.51 were prepared with the QAIRT 2.51 NPU runtime, which TokForge carries from version 1.3.9.6
|
| 56 |
(the app loads that runtime for them after one restart); older versions of the app skip those entries. The 9B pack is
|
| 57 |
-
V81 only and needs a 24 GB phone.
|
|
|
|
| 58 |
|
| 59 |
## What each entry holds
|
| 60 |
|
|
|
|
| 44 |
| Qwen3.5 4B Claude 4.6 Opus Abliterated | [darkmaniac7/Qwen3.5-4B-Claude-4.6-Opus-abliterated-NPU-catalogpair](https://huggingface.co/darkmaniac7/Qwen3.5-4B-Claude-4.6-Opus-abliterated-NPU-catalogpair/tree/e3378b577741af08332e5908cac285140ba8c954) at `e3378b577741` | V81 3.67 GB, V75 3.65 GB | V81 5.90 GB, V75 5.85 GB | measured on phones for V81 and V75 |
|
| 45 |
| Qwen3.5 0.8B | [darkmaniac7/Qwen3.5-0.8B-NPU-catalogpair](https://huggingface.co/darkmaniac7/Qwen3.5-0.8B-NPU-catalogpair/tree/56aac1e38f036de3483e2c0261fb08acad7a1f6c) at `56aac1e38f03` | V81 0.53 GB, V75 0.52 GB | V81 2.17 GB, V75 2.10 GB | measured on phones for V81 and V75 |
|
| 46 |
| Qwen3.5 9B (QAIRT 2.51) | [darkmaniac7/Qwen3.5-9B-NPU-catalogpair](https://huggingface.co/darkmaniac7/Qwen3.5-9B-NPU-catalogpair/tree/9daa5ec6f6721a31082327e891693cc5c38dbef9) at `9daa5ec6f672` | V81 3.97 GB | V81 6.63 GB | measured on phones for V81 |
|
| 47 |
+
| Qwen3.5 4B W4 (QAIRT 2.51) | [darkmaniac7/Qwen3.5-4B-NPU-catalogpair-qairt251](https://huggingface.co/darkmaniac7/Qwen3.5-4B-NPU-catalogpair-qairt251/tree/e22fbfefdcd8f2bc2ba9133fd07026673db1be88) at `e22fbfefdcd8` | V81 2.09 GB, V79 2.08 GB, V75 2.08 GB | V81 4.63 GB, V79 4.34 GB, V75 4.63 GB | measured on phones for V81 and V79; V75 provisional (the V81 figure), not tested on a phone yet |
|
| 48 |
|
| 49 |
V81 is the Snapdragon 8 Elite Gen 5 (SM8850), V79 the Snapdragon 8 Elite (SM8750), V75 the Snapdragon 8 Gen 3 (SM8650). A chip
|
| 50 |
that has a download for a pack but is not in its `measured_arches` has not been tested on a phone by us yet; TokForge says so
|
|
|
|
| 55 |
|
| 56 |
Packs marked QAIRT 2.51 were prepared with the QAIRT 2.51 NPU runtime, which TokForge carries from version 1.3.9.6
|
| 57 |
(the app loads that runtime for them after one restart); older versions of the app skip those entries. The 9B pack is
|
| 58 |
+
V81 only and needs a 24 GB phone. The 4B W4 pack is the Qwen3.5 4B at its exact catalog weights in a smaller download
|
| 59 |
+
with less NPU memory; the 4B pack above stays for the runtime every version of the app carries.
|
| 60 |
|
| 61 |
## What each entry holds
|
| 62 |
|
npu_pack_index.json
CHANGED
|
@@ -169,6 +169,36 @@
|
|
| 169 |
}
|
| 170 |
}
|
| 171 |
}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 172 |
}
|
| 173 |
]
|
| 174 |
}
|
|
|
|
| 169 |
}
|
| 170 |
}
|
| 171 |
}
|
| 172 |
+
},
|
| 173 |
+
{
|
| 174 |
+
"model_id": "qwen3.5-4b-mnn",
|
| 175 |
+
"name": "Qwen3.5-4B-MNN-catalogpair",
|
| 176 |
+
"family": "qwen3_5/qairt-2.51",
|
| 177 |
+
"qnn_sdk_version": "2.51.40.260930",
|
| 178 |
+
"pack_repo": "darkmaniac7/Qwen3.5-4B-NPU-catalogpair-qairt251",
|
| 179 |
+
"pack_revision": "e22fbfefdcd8f2bc2ba9133fd07026673db1be88",
|
| 180 |
+
"manifest_sha256": "63127219aa66f8b894b630cd23178f3a5430d4b5af394cee8b8aee0c23d0eb38",
|
| 181 |
+
"arch_bytes": {
|
| 182 |
+
"v81": 2093554269,
|
| 183 |
+
"v79": 2079808661,
|
| 184 |
+
"v75": 2079677543
|
| 185 |
+
},
|
| 186 |
+
"resident_bytes": {
|
| 187 |
+
"v81": 4630000000,
|
| 188 |
+
"v79": 4340000000,
|
| 189 |
+
"v75": 4630000000
|
| 190 |
+
},
|
| 191 |
+
"measured_arches": [
|
| 192 |
+
"v81",
|
| 193 |
+
"v79"
|
| 194 |
+
],
|
| 195 |
+
"pairs_with": {
|
| 196 |
+
"repo": "darkmaniac7/Qwen3.5-4B-MNN",
|
| 197 |
+
"revision": "85364606553d2ece47af5b3ed850a8832e1da0e8",
|
| 198 |
+
"llm_mnn_sha256": "45eebc9dc433a55f0388453250a05a728a206650294be92f48e4fdd1b0348e0f",
|
| 199 |
+
"weight_bytes": 2629387626,
|
| 200 |
+
"weight_sha256": "a31d50e5668ce6b22655ff4750cfd48b972790ae883f2c154ba34b9173b38de1"
|
| 201 |
+
}
|
| 202 |
}
|
| 203 |
]
|
| 204 |
}
|