darkmaniac7 commited on
Commit
c59898b
·
verified ·
1 Parent(s): 0017988

Qwen3.5 4B W4 pack for the QAIRT 2.51 NPU runtime at e22fbfef (V81, V79, V75; NPU memory measured on V81 and V79 phones, V75 provisional); beside the Qwen3.5 4B pack for the runtime every app carries

Browse files
Files changed (2) hide show
  1. README.md +3 -1
  2. npu_pack_index.json +30 -0
README.md CHANGED
@@ -44,6 +44,7 @@ pack; it cannot change the files of a pack your phone already checked.
44
  | Qwen3.5 4B Claude 4.6 Opus Abliterated | [darkmaniac7/Qwen3.5-4B-Claude-4.6-Opus-abliterated-NPU-catalogpair](https://huggingface.co/darkmaniac7/Qwen3.5-4B-Claude-4.6-Opus-abliterated-NPU-catalogpair/tree/e3378b577741af08332e5908cac285140ba8c954) at `e3378b577741` | V81 3.67 GB, V75 3.65 GB | V81 5.90 GB, V75 5.85 GB | measured on phones for V81 and V75 |
45
  | Qwen3.5 0.8B | [darkmaniac7/Qwen3.5-0.8B-NPU-catalogpair](https://huggingface.co/darkmaniac7/Qwen3.5-0.8B-NPU-catalogpair/tree/56aac1e38f036de3483e2c0261fb08acad7a1f6c) at `56aac1e38f03` | V81 0.53 GB, V75 0.52 GB | V81 2.17 GB, V75 2.10 GB | measured on phones for V81 and V75 |
46
  | Qwen3.5 9B (QAIRT 2.51) | [darkmaniac7/Qwen3.5-9B-NPU-catalogpair](https://huggingface.co/darkmaniac7/Qwen3.5-9B-NPU-catalogpair/tree/9daa5ec6f6721a31082327e891693cc5c38dbef9) at `9daa5ec6f672` | V81 3.97 GB | V81 6.63 GB | measured on phones for V81 |
 
47
 
48
  V81 is the Snapdragon 8 Elite Gen 5 (SM8850), V79 the Snapdragon 8 Elite (SM8750), V75 the Snapdragon 8 Gen 3 (SM8650). A chip
49
  that has a download for a pack but is not in its `measured_arches` has not been tested on a phone by us yet; TokForge says so
@@ -54,7 +55,8 @@ uses that from then on.
54
 
55
  Packs marked QAIRT 2.51 were prepared with the QAIRT 2.51 NPU runtime, which TokForge carries from version 1.3.9.6
56
  (the app loads that runtime for them after one restart); older versions of the app skip those entries. The 9B pack is
57
- V81 only and needs a 24 GB phone.
 
58
 
59
  ## What each entry holds
60
 
 
44
  | Qwen3.5 4B Claude 4.6 Opus Abliterated | [darkmaniac7/Qwen3.5-4B-Claude-4.6-Opus-abliterated-NPU-catalogpair](https://huggingface.co/darkmaniac7/Qwen3.5-4B-Claude-4.6-Opus-abliterated-NPU-catalogpair/tree/e3378b577741af08332e5908cac285140ba8c954) at `e3378b577741` | V81 3.67 GB, V75 3.65 GB | V81 5.90 GB, V75 5.85 GB | measured on phones for V81 and V75 |
45
  | Qwen3.5 0.8B | [darkmaniac7/Qwen3.5-0.8B-NPU-catalogpair](https://huggingface.co/darkmaniac7/Qwen3.5-0.8B-NPU-catalogpair/tree/56aac1e38f036de3483e2c0261fb08acad7a1f6c) at `56aac1e38f03` | V81 0.53 GB, V75 0.52 GB | V81 2.17 GB, V75 2.10 GB | measured on phones for V81 and V75 |
46
  | Qwen3.5 9B (QAIRT 2.51) | [darkmaniac7/Qwen3.5-9B-NPU-catalogpair](https://huggingface.co/darkmaniac7/Qwen3.5-9B-NPU-catalogpair/tree/9daa5ec6f6721a31082327e891693cc5c38dbef9) at `9daa5ec6f672` | V81 3.97 GB | V81 6.63 GB | measured on phones for V81 |
47
+ | Qwen3.5 4B W4 (QAIRT 2.51) | [darkmaniac7/Qwen3.5-4B-NPU-catalogpair-qairt251](https://huggingface.co/darkmaniac7/Qwen3.5-4B-NPU-catalogpair-qairt251/tree/e22fbfefdcd8f2bc2ba9133fd07026673db1be88) at `e22fbfefdcd8` | V81 2.09 GB, V79 2.08 GB, V75 2.08 GB | V81 4.63 GB, V79 4.34 GB, V75 4.63 GB | measured on phones for V81 and V79; V75 provisional (the V81 figure), not tested on a phone yet |
48
 
49
  V81 is the Snapdragon 8 Elite Gen 5 (SM8850), V79 the Snapdragon 8 Elite (SM8750), V75 the Snapdragon 8 Gen 3 (SM8650). A chip
50
  that has a download for a pack but is not in its `measured_arches` has not been tested on a phone by us yet; TokForge says so
 
55
 
56
  Packs marked QAIRT 2.51 were prepared with the QAIRT 2.51 NPU runtime, which TokForge carries from version 1.3.9.6
57
  (the app loads that runtime for them after one restart); older versions of the app skip those entries. The 9B pack is
58
+ V81 only and needs a 24 GB phone. The 4B W4 pack is the Qwen3.5 4B at its exact catalog weights in a smaller download
59
+ with less NPU memory; the 4B pack above stays for the runtime every version of the app carries.
60
 
61
  ## What each entry holds
62
 
npu_pack_index.json CHANGED
@@ -169,6 +169,36 @@
169
  }
170
  }
171
  }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
172
  }
173
  ]
174
  }
 
169
  }
170
  }
171
  }
172
+ },
173
+ {
174
+ "model_id": "qwen3.5-4b-mnn",
175
+ "name": "Qwen3.5-4B-MNN-catalogpair",
176
+ "family": "qwen3_5/qairt-2.51",
177
+ "qnn_sdk_version": "2.51.40.260930",
178
+ "pack_repo": "darkmaniac7/Qwen3.5-4B-NPU-catalogpair-qairt251",
179
+ "pack_revision": "e22fbfefdcd8f2bc2ba9133fd07026673db1be88",
180
+ "manifest_sha256": "63127219aa66f8b894b630cd23178f3a5430d4b5af394cee8b8aee0c23d0eb38",
181
+ "arch_bytes": {
182
+ "v81": 2093554269,
183
+ "v79": 2079808661,
184
+ "v75": 2079677543
185
+ },
186
+ "resident_bytes": {
187
+ "v81": 4630000000,
188
+ "v79": 4340000000,
189
+ "v75": 4630000000
190
+ },
191
+ "measured_arches": [
192
+ "v81",
193
+ "v79"
194
+ ],
195
+ "pairs_with": {
196
+ "repo": "darkmaniac7/Qwen3.5-4B-MNN",
197
+ "revision": "85364606553d2ece47af5b3ed850a8832e1da0e8",
198
+ "llm_mnn_sha256": "45eebc9dc433a55f0388453250a05a728a206650294be92f48e4fdd1b0348e0f",
199
+ "weight_bytes": 2629387626,
200
+ "weight_sha256": "a31d50e5668ce6b22655ff4750cfd48b972790ae883f2c154ba34b9173b38de1"
201
+ }
202
  }
203
  ]
204
  }