Yolo-v7: Optimized for Qualcomm Devices
YoloV7 is a machine learning model that predicts bounding boxes and classes of objects in an image.
This is based on the implementation of Yolo-v7 found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.
Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.
Getting Started
Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:
- Custom weights (e.g., fine-tuned checkpoints)
- Custom input shapes
- Target device and runtime configurations
See our repository for Yolo-v7 on GitHub for usage instructions.
Model Details
Model Type: Model_use_case.object_detection
Model Stats:
- Input resolution: 640x640
- Model checkpoint: YoloV7 Tiny
- Model size (float): 23.8 MB
- Model size (w8a16): 6.66 MB
- Model size (w8a8): 6.23 MB
- Number of parameters: 6.24M
Performance Summary
| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit |
|---|---|---|---|---|---|---|
| Yolo-v7 | ONNX | float | Snapdragon® X2 Elite | 5.792 ms | 5 - 5 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® X Elite | 10.779 ms | 8 - 8 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 7.69 ms | 6 - 193 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 17.664 ms | 6 - 197 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | 11.892 ms | 5 - 8 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 10.548 ms | 0 - 11 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® QCS8450 | 17.664 ms | 6 - 197 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 12.706 ms | 5 - 7 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 10.779 ms | 8 - 8 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 6.552 ms | 3 - 174 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® 8 Elite Mobile | 6.552 ms | 3 - 174 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.902 ms | 2 - 176 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® X2 Elite | 1.998 ms | 2 - 2 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® X Elite | 4.786 ms | 5 - 5 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.914 ms | 0 - 215 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 8 Gen 1 Mobile | 7.204 ms | 3 - 220 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 17.448 ms | 2 - 5 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 4.116 ms | 2 - 6 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 4.495 ms | 0 - 119 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® QCS8450 | 7.204 ms | 3 - 220 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 4.92 ms | 2 - 5 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 4.786 ms | 5 - 5 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 32.966 ms | 3 - 220 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 5.544 ms | 3 - 188 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 2.222 ms | 0 - 189 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 2.222 ms | 0 - 189 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.764 ms | 0 - 194 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 5.544 ms | 3 - 188 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® X2 Elite | 1.072 ms | 1 - 1 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® X Elite | 2.447 ms | 5 - 5 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.52 ms | 0 - 78 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 3.224 ms | 0 - 80 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 8.292 ms | 1 - 4 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 2.334 ms | 0 - 4 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.339 ms | 0 - 8 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® QCS8450 | 3.224 ms | 0 - 80 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 2.575 ms | 0 - 3 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 2.447 ms | 5 - 5 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 16.919 ms | 2 - 174 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 3.442 ms | 2 - 171 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.23 ms | 0 - 53 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 1.23 ms | 0 - 53 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.985 ms | 0 - 62 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 3.442 ms | 2 - 171 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® X2 Elite | 9.094 ms | 5 - 5 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® X Elite | 10.061 ms | 5 - 5 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 6.92 ms | 5 - 183 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 16.216 ms | 5 - 184 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 10.739 ms | 5 - 12 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 9.268 ms | 5 - 6 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® SA8775P | 11.48 ms | 1 - 159 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® SA8650P | 11.48 ms | 1 - 159 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® SA8255P | 11.48 ms | 1 - 159 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® QCS8450 | 16.216 ms | 5 - 184 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 11.391 ms | 5 - 11 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 10.061 ms | 5 - 5 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 6.328 ms | 5 - 164 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® SA7255P | 23.348 ms | 1 - 155 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® SA8295P | 13.284 ms | 0 - 152 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 6.328 ms | 5 - 164 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.646 ms | 5 - 165 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 2.046 ms | 2 - 2 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® X Elite | 3.982 ms | 2 - 2 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.536 ms | 2 - 194 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 8 Gen 1 Mobile | 5.566 ms | 2 - 203 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 15.425 ms | 1 - 5 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 3.591 ms | 2 - 7 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 3.592 ms | 2 - 13 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® SA8775P | 4.314 ms | 0 - 166 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® SA8650P | 4.314 ms | 0 - 166 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® SA8255P | 4.314 ms | 0 - 166 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® QCS8450 | 5.566 ms | 2 - 203 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 3.965 ms | 3 - 7 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 3.982 ms | 2 - 2 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 31.288 ms | 3 - 170 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 4.829 ms | 2 - 172 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 1.893 ms | 2 - 166 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® SA7255P | 8.593 ms | 1 - 166 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® SA8295P | 5.279 ms | 2 - 172 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 1.893 ms | 2 - 166 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.56 ms | 2 - 175 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 4.829 ms | 2 - 172 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 0.98 ms | 1 - 1 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® X Elite | 2.309 ms | 1 - 1 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.324 ms | 1 - 58 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2.806 ms | 1 - 62 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 8.783 ms | 1 - 4 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 1.917 ms | 1 - 5 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.046 ms | 1 - 3 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® SA8775P | 2.395 ms | 1 - 42 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® SA8650P | 2.395 ms | 1 - 42 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® SA8255P | 2.395 ms | 1 - 42 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 2.806 ms | 1 - 62 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 2.148 ms | 3 - 6 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 2.309 ms | 1 - 1 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 13.871 ms | 1 - 157 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 3.34 ms | 1 - 158 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.034 ms | 0 - 42 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® SA7255P | 4.339 ms | 1 - 41 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® SA8295P | 3.313 ms | 0 - 37 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 1.034 ms | 0 - 42 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.777 ms | 1 - 40 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 3.34 ms | 1 - 158 MB | NPU |
| Yolo-v7 | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 6.945 ms | 1 - 188 MB | NPU |
| Yolo-v7 | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 16.155 ms | 1 - 187 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 10.746 ms | 1 - 21 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 9.464 ms | 1 - 3 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA8775P | 11.471 ms | 1 - 163 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA8650P | 11.471 ms | 1 - 163 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA8255P | 11.471 ms | 1 - 163 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® QCS8450 | 16.155 ms | 1 - 187 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 11.284 ms | 1 - 20 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 6.308 ms | 1 - 167 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA7255P | 23.493 ms | 1 - 158 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA8295P | 13.396 ms | 1 - 158 MB | NPU |
| Yolo-v7 | TFLITE | float | Snapdragon® 8 Elite Mobile | 6.308 ms | 1 - 167 MB | NPU |
| Yolo-v7 | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.714 ms | 1 - 168 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.406 ms | 0 - 62 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 3.016 ms | 0 - 66 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 8.1 ms | 0 - 10 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 2.075 ms | 0 - 10 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.055 ms | 0 - 22 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA8775P | 2.574 ms | 0 - 62 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA8650P | 2.574 ms | 0 - 62 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA8255P | 2.574 ms | 0 - 62 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® QCS8450 | 3.016 ms | 0 - 66 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 2.306 ms | 0 - 10 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 14.319 ms | 0 - 157 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 3.498 ms | 0 - 164 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.107 ms | 0 - 66 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA7255P | 79.015 ms | 15 - 44 MB | GPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA8295P | 3.609 ms | 0 - 42 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 1.107 ms | 0 - 66 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.89 ms | 0 - 82 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 3.498 ms | 0 - 164 MB | NPU |
License
- The license for the original implementation of Yolo-v7 can be found here.
References
- YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors
- Source Model Implementation
Community
- Join our AI Hub Slack community to collaborate, post questions and learn more about on-device AI.
- For questions or feedback please reach out to us.
