Hugging Face's logo

qualcomm
/
ResNet18

Image Classification
PyTorch
LiteRT
backbone
android
Model card Files
xet
Community
qaihm-bot commited on
Commit
c962621
·
verified ·
1 Parent(s): b33e4c9

v0.42.0

Browse files

See https://github.com/quic/ai-hub-models/releases/v0.42.0 for changelog.

Files changed (6) hide show
  1. README.md +72 -68
  2. ResNet18_float.dlc +2 -2
  3. ResNet18_float.onnx.zip +1 -1
  4. ResNet18_w8a8.dlc +2 -2
  5. ResNet18_w8a8.onnx.zip +1 -1
  6. ResNet18_w8a8.tflite +1 -1
README.md CHANGED
@@ -37,70 +37,74 @@ More details on model performance across various devices, can be found
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
- | ResNet18 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 6.141 ms | 0 - 20 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
41
- | ResNet18 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 5.893 ms | 1 - 17 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
42
- | ResNet18 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.996 ms | 0 - 49 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
43
- | ResNet18 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.359 ms | 1 - 27 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
44
- | ResNet18 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.363 ms | 0 - 218 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
45
- | ResNet18 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.276 ms | 0 - 88 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
46
- | ResNet18 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 1.252 ms | 0 - 78 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
47
- | ResNet18 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 9.014 ms | 0 - 20 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
48
- | ResNet18 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.968 ms | 1 - 18 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
49
- | ResNet18 | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 6.141 ms | 0 - 20 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
50
- | ResNet18 | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 5.893 ms | 1 - 17 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
51
- | ResNet18 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.361 ms | 0 - 222 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
52
- | ResNet18 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.274 ms | 0 - 90 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
53
- | ResNet18 | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.504 ms | 0 - 25 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
54
- | ResNet18 | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.256 ms | 1 - 23 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
55
- | ResNet18 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.364 ms | 0 - 219 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
56
- | ResNet18 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.274 ms | 0 - 84 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
57
- | ResNet18 | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 9.014 ms | 0 - 20 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
58
- | ResNet18 | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.968 ms | 1 - 18 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
59
- | ResNet18 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.944 ms | 0 - 52 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
60
- | ResNet18 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.89 ms | 0 - 30 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
61
- | ResNet18 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.874 ms | 0 - 29 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
62
- | ResNet18 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.755 ms | 0 - 27 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
63
- | ResNet18 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.703 ms | 1 - 24 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
64
- | ResNet18 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 0.732 ms | 0 - 22 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
65
- | ResNet18 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.645 ms | 0 - 27 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
66
- | ResNet18 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.592 ms | 1 - 24 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
67
- | ResNet18 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 0.668 ms | 1 - 23 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
68
- | ResNet18 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.399 ms | 88 - 88 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
69
- | ResNet18 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.142 ms | 23 - 23 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
70
- | ResNet18 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 1.056 ms | 0 - 18 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
71
- | ResNet18 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 1.278 ms | 0 - 18 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
72
- | ResNet18 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 0.473 ms | 0 - 41 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
73
- | ResNet18 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 0.741 ms | 0 - 49 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
74
- | ResNet18 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 0.404 ms | 0 - 89 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
75
- | ResNet18 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 0.553 ms | 0 - 89 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
76
- | ResNet18 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 0.768 ms | 0 - 85 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
77
- | ResNet18 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 0.575 ms | 0 - 18 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
78
- | ResNet18 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 0.712 ms | 0 - 18 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
79
- | ResNet18 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 1.394 ms | 0 - 33 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
80
- | ResNet18 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 11.577 ms | 8 - 21 MB | CPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
81
- | ResNet18 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 7.316 ms | 0 - 3 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
82
- | ResNet18 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 10.205 ms | 8 - 32 MB | CPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
83
- | ResNet18 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 1.056 ms | 0 - 18 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
84
- | ResNet18 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 1.278 ms | 0 - 18 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
85
- | ResNet18 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 0.407 ms | 0 - 87 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
86
- | ResNet18 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 0.551 ms | 0 - 89 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
87
- | ResNet18 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 0.757 ms | 0 - 24 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
88
- | ResNet18 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 0.921 ms | 0 - 25 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
89
- | ResNet18 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 0.408 ms | 0 - 90 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
90
- | ResNet18 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 0.552 ms | 0 - 4 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
91
- | ResNet18 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 0.575 ms | 0 - 18 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
92
- | ResNet18 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 0.712 ms | 0 - 18 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
93
- | ResNet18 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.31 ms | 0 - 41 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
94
- | ResNet18 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.409 ms | 0 - 43 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
95
- | ResNet18 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.531 ms | 0 - 46 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
96
- | ResNet18 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.253 ms | 0 - 20 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
97
- | ResNet18 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.297 ms | 0 - 25 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
98
- | ResNet18 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 0.473 ms | 0 - 21 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
99
- | ResNet18 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.238 ms | 0 - 21 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
100
- | ResNet18 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.276 ms | 0 - 21 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
101
- | ResNet18 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 0.462 ms | 0 - 23 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
102
- | ResNet18 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 0.627 ms | 71 - 71 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
103
- | ResNet18 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 0.64 ms | 12 - 12 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
 
 
 
 
104
 
105
 
106
 
@@ -114,9 +118,9 @@ pip install qai-hub-models
114
  ```
115
 
116
 
117
- ## Configure Qualcomm® AI Hub to run this model on a cloud-hosted device
118
 
119
- Sign-in to [Qualcomm® AI Hub](https://app.aihub.qualcomm.com/) with your
120
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
121
 
122
  With this API token, you can configure your client to run models on the cloud
@@ -124,7 +128,7 @@ hosted devices.
124
  ```bash
125
  qai-hub configure --api_token API_TOKEN
126
  ```
127
- Navigate to [docs](https://app.aihub.qualcomm.com/docs/) for more information.
128
 
129
 
130
 
@@ -235,7 +239,7 @@ With the output of the model, you can compute like PSNR, relative errors or
235
  spot check the output with expected output.
236
 
237
  **Note**: This on-device profiling and inference requires access to Qualcomm®
238
- AI Hub. [Sign up for access](https://myaccount.qualcomm.com/signup).
239
 
240
 
241
 
 
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
+ | ResNet18 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 6.088 ms | 0 - 22 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
41
+ | ResNet18 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 5.861 ms | 1 - 19 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
42
+ | ResNet18 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.996 ms | 0 - 54 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
43
+ | ResNet18 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.361 ms | 1 - 28 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
44
+ | ResNet18 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.368 ms | 0 - 220 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
45
+ | ResNet18 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.275 ms | 0 - 85 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
46
+ | ResNet18 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 1.29 ms | 0 - 83 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
47
+ | ResNet18 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 2.12 ms | 0 - 21 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
48
+ | ResNet18 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 8.279 ms | 1 - 19 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
49
+ | ResNet18 | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 6.088 ms | 0 - 22 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
50
+ | ResNet18 | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 5.861 ms | 1 - 19 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
51
+ | ResNet18 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.369 ms | 0 - 224 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
52
+ | ResNet18 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.274 ms | 0 - 83 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
53
+ | ResNet18 | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.505 ms | 0 - 27 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
54
+ | ResNet18 | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.256 ms | 1 - 25 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
55
+ | ResNet18 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.365 ms | 0 - 202 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
56
+ | ResNet18 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.277 ms | 0 - 83 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
57
+ | ResNet18 | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 2.12 ms | 0 - 21 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
58
+ | ResNet18 | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 8.279 ms | 1 - 19 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
59
+ | ResNet18 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.949 ms | 0 - 52 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
60
+ | ResNet18 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.895 ms | 1 - 29 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
61
+ | ResNet18 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.883 ms | 0 - 28 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
62
+ | ResNet18 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.754 ms | 0 - 30 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
63
+ | ResNet18 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.701 ms | 1 - 30 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
64
+ | ResNet18 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 0.731 ms | 0 - 22 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
65
+ | ResNet18 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.646 ms | 0 - 28 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
66
+ | ResNet18 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.595 ms | 0 - 25 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
67
+ | ResNet18 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 0.653 ms | 1 - 23 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
68
+ | ResNet18 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.384 ms | 74 - 74 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
69
+ | ResNet18 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.147 ms | 23 - 23 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
70
+ | ResNet18 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 1.048 ms | 0 - 19 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
71
+ | ResNet18 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 1.283 ms | 0 - 19 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
72
+ | ResNet18 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 0.488 ms | 0 - 45 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
73
+ | ResNet18 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 0.748 ms | 0 - 43 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
74
+ | ResNet18 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 0.405 ms | 0 - 86 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
75
+ | ResNet18 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 0.551 ms | 0 - 87 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
76
+ | ResNet18 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 0.74 ms | 0 - 87 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
77
+ | ResNet18 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 0.577 ms | 0 - 20 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
78
+ | ResNet18 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.606 ms | 0 - 19 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
79
+ | ResNet18 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 1.41 ms | 0 - 34 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
80
+ | ResNet18 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 1.984 ms | 0 - 31 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
81
+ | ResNet18 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 11.555 ms | 8 - 21 MB | CPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
82
+ | ResNet18 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 7.444 ms | 0 - 3 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
83
+ | ResNet18 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 10.235 ms | 8 - 31 MB | CPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
84
+ | ResNet18 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 1.048 ms | 0 - 19 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
85
+ | ResNet18 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 1.283 ms | 0 - 19 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
86
+ | ResNet18 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 0.405 ms | 0 - 87 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
87
+ | ResNet18 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 0.552 ms | 0 - 88 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
88
+ | ResNet18 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 0.756 ms | 0 - 25 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
89
+ | ResNet18 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 0.915 ms | 0 - 26 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
90
+ | ResNet18 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 0.407 ms | 0 - 90 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
91
+ | ResNet18 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 0.551 ms | 0 - 89 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
92
+ | ResNet18 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 0.577 ms | 0 - 20 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
93
+ | ResNet18 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.606 ms | 0 - 19 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
94
+ | ResNet18 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.306 ms | 0 - 41 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
95
+ | ResNet18 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.408 ms | 0 - 41 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
96
+ | ResNet18 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.523 ms | 0 - 43 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
97
+ | ResNet18 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.256 ms | 0 - 26 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
98
+ | ResNet18 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.302 ms | 0 - 23 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
99
+ | ResNet18 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 0.475 ms | 0 - 23 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
100
+ | ResNet18 | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | TFLITE | 0.602 ms | 0 - 35 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
101
+ | ResNet18 | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | QNN_DLC | 0.693 ms | 0 - 35 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
102
+ | ResNet18 | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | ONNX | 11.081 ms | 9 - 24 MB | CPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
103
+ | ResNet18 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.238 ms | 0 - 25 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
104
+ | ResNet18 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.281 ms | 0 - 22 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
105
+ | ResNet18 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 0.464 ms | 0 - 27 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
106
+ | ResNet18 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 0.616 ms | 71 - 71 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
107
+ | ResNet18 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 0.637 ms | 12 - 12 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
108
 
109
 
110
 
 
118
  ```
119
 
120
 
121
+ ## Configure Qualcomm® AI Hub Workbench to run this model on a cloud-hosted device
122
 
123
+ Sign-in to [Qualcomm® AI Hub Workbench](https://workbench.aihub.qualcomm.com/) with your
124
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
125
 
126
  With this API token, you can configure your client to run models on the cloud
 
128
  ```bash
129
  qai-hub configure --api_token API_TOKEN
130
  ```
131
+ Navigate to [docs](https://workbench.aihub.qualcomm.com/docs/) for more information.
132
 
133
 
134
 
 
239
  spot check the output with expected output.
240
 
241
  **Note**: This on-device profiling and inference requires access to Qualcomm®
242
+ AI Hub Workbench. [Sign up for access](https://myaccount.qualcomm.com/signup).
243
 
244
 
245
 
ResNet18_float.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c4f87a963bdfba169a765d74ba4906b1b65c70d9a25f10bc7986d3cc020d40ec
3
- size 46803244
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63cd8c16614f7937d231a11c373713b02a0901d89d29ae5a86714671f32e72d6
3
+ size 46803348
ResNet18_float.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:28a85c11cd4990a92fb0f3b4f410d1735ecd5a8fa0dfbe876f91533283124556
3
  size 43534295
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0cf9611e88ee3b418bc7db1459d14d9a6ee28d31b32e9ba93c43f8a97f94383a
3
  size 43534295
ResNet18_w8a8.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:00c95637ab17f57c0f0b6f5183ef8d066e4de73218a7ee3c6d4da650a0ad7cc9
3
- size 12038268
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7499b6b5d460573683509bbe517f3c76e87d7e76f837345e89794c1528bd3738
3
+ size 12038372
ResNet18_w8a8.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8b71ec61fda60ef950b8973aaae26dc3c7263da409474d2015c948b64b116f80
3
  size 19310437
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd83b2ac5236d70a1b84fa9431af160dd57f4ac1e42c44258cf2694241f537ae
3
  size 19310437
ResNet18_w8a8.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f7986f14745422ee6f75220dfa069a7ae4cd9fe2c6de6e08b3a79aa72fd77867
3
  size 11848936
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6044d42b8047e821faf2cf769b774f2fbe16b71923fc2b89cda803d6c12484c
3
  size 11848936