Hugging Face's logo

qualcomm
/
MobileSam

Image Segmentation
PyTorch
foundation
android
Model card Files
xet
 Community
qaihm-bot commited on
Commit
93c1f93
·
verified ·
1 Parent(s): 9fefdcb

v0.51.0

Browse files

See https://github.com/qualcomm/ai-hub-models/releases/v0.51.0 for changelog.

Files changed (2) hide show
  1. README.md +61 -61
  2. release_assets.json +29 -1
README.md CHANGED
@@ -28,9 +28,9 @@ Below are pre-exported model assets ready for deployment.
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
- | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/releases/v0.50.2/mobilesam-onnx-float.zip)
32
- | QNN_DLC | float | Universal | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/releases/v0.50.2/mobilesam-qnn_dlc-float.zip)
33
- | TFLITE | float | Universal | QAIRT 2.43, TFLite 2.19.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/releases/v0.50.2/mobilesam-tflite-float.zip)
34
 
35
  For more device-specific assets and performance metrics, visit **[MobileSam on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/mobilesam)**.
36
 
@@ -61,64 +61,64 @@ See our repository for [MobileSam on GitHub](https://github.com/qualcomm/ai-hub-
61
  ## Performance Summary
62
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
63
  |---|---|---|---|---|---|---
64
- | decoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.948 ms | 0 - 243 MB | NPU
65
- | decoder | ONNX | float | Snapdragon® X2 Elite | 3.023 ms | 11 - 11 MB | NPU
66
- | decoder | ONNX | float | Snapdragon® X Elite | 7.621 ms | 11 - 11 MB | NPU
67
- | decoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 5.008 ms | 5 - 350 MB | NPU
68
- | decoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 7.11 ms | 0 - 15 MB | NPU
69
- | decoder | ONNX | float | Qualcomm® QCS9075 | 8.436 ms | 4 - 7 MB | NPU
70
- | decoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 3.655 ms | 0 - 222 MB | NPU
71
- | decoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.379 ms | 3 - 203 MB | NPU
72
- | decoder | QNN_DLC | float | Snapdragon® X2 Elite | 2.849 ms | 4 - 4 MB | NPU
73
- | decoder | QNN_DLC | float | Snapdragon® X Elite | 5.973 ms | 4 - 4 MB | NPU
74
- | decoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 3.844 ms | 0 - 311 MB | NPU
75
- | decoder | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 12.991 ms | 1 - 283 MB | NPU
76
- | decoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 5.527 ms | 4 - 6 MB | NPU
77
- | decoder | QNN_DLC | float | Qualcomm® SA8775P | 6.478 ms | 0 - 284 MB | NPU
78
- | decoder | QNN_DLC | float | Qualcomm® QCS9075 | 6.913 ms | 4 - 10 MB | NPU
79
- | decoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 9.63 ms | 2 - 227 MB | NPU
80
- | decoder | QNN_DLC | float | Qualcomm® SA7255P | 12.991 ms | 1 - 283 MB | NPU
81
- | decoder | QNN_DLC | float | Qualcomm® SA8295P | 8.029 ms | 0 - 196 MB | NPU
82
- | decoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.801 ms | 0 - 267 MB | NPU
83
- | decoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.387 ms | 0 - 206 MB | NPU
84
- | decoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 3.904 ms | 0 - 237 MB | NPU
85
- | decoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 13.052 ms | 0 - 201 MB | NPU
86
- | decoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 5.649 ms | 0 - 8 MB | NPU
87
- | decoder | TFLITE | float | Qualcomm® SA8775P | 6.692 ms | 0 - 203 MB | NPU
88
- | decoder | TFLITE | float | Qualcomm® QCS9075 | 6.943 ms | 0 - 19 MB | NPU
89
- | decoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 9.518 ms | 0 - 224 MB | NPU
90
- | decoder | TFLITE | float | Qualcomm® SA7255P | 13.052 ms | 0 - 201 MB | NPU
91
- | decoder | TFLITE | float | Qualcomm® SA8295P | 8.088 ms | 0 - 200 MB | NPU
92
- | decoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.939 ms | 0 - 205 MB | NPU
93
- | encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 84.094 ms | 20 - 1522 MB | NPU
94
- | encoder | ONNX | float | Snapdragon® X2 Elite | 96.11 ms | 14 - 14 MB | NPU
95
- | encoder | ONNX | float | Snapdragon® X Elite | 172.164 ms | 12 - 12 MB | NPU
96
- | encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 125.916 ms | 20 - 3043 MB | NPU
97
- | encoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 177.901 ms | 12 - 40 MB | NPU
98
- | encoder | ONNX | float | Qualcomm® QCS9075 | 200.498 ms | 12 - 15 MB | NPU
99
- | encoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 100.485 ms | 9 - 1390 MB | NPU
100
- | encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 48.926 ms | 12 - 1324 MB | NPU
101
- | encoder | QNN_DLC | float | Snapdragon® X2 Elite | 51.713 ms | 12 - 12 MB | NPU
102
- | encoder | QNN_DLC | float | Snapdragon® X Elite | 100.189 ms | 12 - 12 MB | NPU
103
- | encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 66.047 ms | 10 - 1628 MB | NPU
104
- | encoder | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 209.31 ms | 0 - 1210 MB | NPU
105
- | encoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 97.222 ms | 12 - 15 MB | NPU
106
- | encoder | QNN_DLC | float | Qualcomm® SA8775P | 103.074 ms | 1 - 1209 MB | NPU
107
- | encoder | QNN_DLC | float | Qualcomm® QCS9075 | 121.864 ms | 12 - 30 MB | NPU
108
- | encoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 469.913 ms | 11 - 1740 MB | NPU
109
- | encoder | QNN_DLC | float | Qualcomm® SA7255P | 209.31 ms | 0 - 1210 MB | NPU
110
- | encoder | QNN_DLC | float | Qualcomm® SA8295P | 474.209 ms | 0 - 1258 MB | NPU
111
- | encoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 49.637 ms | 12 - 1215 MB | NPU
112
- | encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 104.259 ms | 32 - 1233 MB | NPU
113
- | encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 167.58 ms | 17 - 1923 MB | NPU
114
- | encoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 360.435 ms | 29 - 1180 MB | NPU
115
- | encoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 216.954 ms | 33 - 37 MB | NPU
116
- | encoder | TFLITE | float | Qualcomm® SA8775P | 240.406 ms | 33 - 1227 MB | NPU
117
- | encoder | TFLITE | float | Qualcomm® QCS9075 | 289.564 ms | 32 - 109 MB | NPU
118
- | encoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 670.636 ms | 23 - 2068 MB | NPU
119
- | encoder | TFLITE | float | Qualcomm® SA7255P | 360.435 ms | 29 - 1180 MB | NPU
120
- | encoder | TFLITE | float | Qualcomm® SA8295P | 523.394 ms | 19 - 1181 MB | NPU
121
- | encoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 131.152 ms | 32 - 1235 MB | NPU
122
 
123
  ## License
124
  * The license for the original implementation of MobileSam can be found
 
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
+ | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/releases/v0.51.0/mobilesam-onnx-float.zip)
32
+ | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/releases/v0.51.0/mobilesam-qnn_dlc-float.zip)
33
+ | TFLITE | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/releases/v0.51.0/mobilesam-tflite-float.zip)
34
 
35
  For more device-specific assets and performance metrics, visit **[MobileSam on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/mobilesam)**.
36
 
 
61
  ## Performance Summary
62
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
63
  |---|---|---|---|---|---|---
64
+ | decoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.952 ms | 0 - 242 MB | NPU
65
+ | decoder | ONNX | float | Snapdragon® X2 Elite | 3.024 ms | 11 - 11 MB | NPU
66
+ | decoder | ONNX | float | Snapdragon® X Elite | 7.626 ms | 11 - 11 MB | NPU
67
+ | decoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 4.959 ms | 5 - 263 MB | NPU
68
+ | decoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 7.123 ms | 0 - 15 MB | NPU
69
+ | decoder | ONNX | float | Qualcomm® QCS9075 | 8.456 ms | 4 - 7 MB | NPU
70
+ | decoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 3.668 ms | 0 - 225 MB | NPU
71
+ | decoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.116 ms | 3 - 191 MB | NPU
72
+ | decoder | QNN_DLC | float | Snapdragon® X2 Elite | 2.545 ms | 4 - 4 MB | NPU
73
+ | decoder | QNN_DLC | float | Snapdragon® X Elite | 5.204 ms | 4 - 4 MB | NPU
74
+ | decoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 3.361 ms | 4 - 213 MB | NPU
75
+ | decoder | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 11.707 ms | 0 - 183 MB | NPU
76
+ | decoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 4.833 ms | 4 - 6 MB | NPU
77
+ | decoder | QNN_DLC | float | Qualcomm® SA8775P | 5.854 ms | 1 - 187 MB | NPU
78
+ | decoder | QNN_DLC | float | Qualcomm® QCS9075 | 5.891 ms | 4 - 10 MB | NPU
79
+ | decoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 10.547 ms | 0 - 212 MB | NPU
80
+ | decoder | QNN_DLC | float | Qualcomm® SA7255P | 11.707 ms | 0 - 183 MB | NPU
81
+ | decoder | QNN_DLC | float | Qualcomm® SA8295P | 7.323 ms | 0 - 188 MB | NPU
82
+ | decoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.579 ms | 0 - 187 MB | NPU
83
+ | decoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.605 ms | 0 - 191 MB | NPU
84
+ | decoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 3.754 ms | 0 - 243 MB | NPU
85
+ | decoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 12.829 ms | 0 - 214 MB | NPU
86
+ | decoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 5.552 ms | 0 - 8 MB | NPU
87
+ | decoder | TFLITE | float | Qualcomm® SA8775P | 6.614 ms | 0 - 216 MB | NPU
88
+ | decoder | TFLITE | float | Qualcomm® QCS9075 | 6.864 ms | 0 - 19 MB | NPU
89
+ | decoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 9.278 ms | 0 - 217 MB | NPU
90
+ | decoder | TFLITE | float | Qualcomm® SA7255P | 12.829 ms | 0 - 214 MB | NPU
91
+ | decoder | TFLITE | float | Qualcomm® SA8295P | 8.823 ms | 0 - 191 MB | NPU
92
+ | decoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.99 ms | 0 - 190 MB | NPU
93
+ | encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 87.786 ms | 20 - 1524 MB | NPU
94
+ | encoder | ONNX | float | Snapdragon® X2 Elite | 95.657 ms | 14 - 14 MB | NPU
95
+ | encoder | ONNX | float | Snapdragon® X Elite | 171.215 ms | 12 - 12 MB | NPU
96
+ | encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 126.694 ms | 16 - 3038 MB | NPU
97
+ | encoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 177.246 ms | 12 - 42 MB | NPU
98
+ | encoder | ONNX | float | Qualcomm® QCS9075 | 201.575 ms | 12 - 15 MB | NPU
99
+ | encoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 101.243 ms | 9 - 1396 MB | NPU
100
+ | encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 45.026 ms | 12 - 1312 MB | NPU
101
+ | encoder | QNN_DLC | float | Snapdragon® X2 Elite | 48.595 ms | 12 - 12 MB | NPU
102
+ | encoder | QNN_DLC | float | Snapdragon® X Elite | 98.363 ms | 12 - 12 MB | NPU
103
+ | encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 66.345 ms | 11 - 1559 MB | NPU
104
+ | encoder | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 209.768 ms | 1 - 1193 MB | NPU
105
+ | encoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 95.439 ms | 8 - 10 MB | NPU
106
+ | encoder | QNN_DLC | float | Qualcomm® SA8775P | 101.195 ms | 0 - 1601 MB | NPU
107
+ | encoder | QNN_DLC | float | Qualcomm® QCS9075 | 120.536 ms | 12 - 30 MB | NPU
108
+ | encoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 316.624 ms | 5 - 1574 MB | NPU
109
+ | encoder | QNN_DLC | float | Qualcomm® SA7255P | 209.768 ms | 1 - 1193 MB | NPU
110
+ | encoder | QNN_DLC | float | Qualcomm® SA8295P | 262.029 ms | 0 - 1210 MB | NPU
111
+ | encoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 49.203 ms | 11 - 1209 MB | NPU
112
+ | encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 109.458 ms | 32 - 1085 MB | NPU
113
+ | encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 170.601 ms | 23 - 2317 MB | NPU
114
+ | encoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 360.275 ms | 33 - 1120 MB | NPU
115
+ | encoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 226.445 ms | 33 - 37 MB | NPU
116
+ | encoder | TFLITE | float | Qualcomm® SA8775P | 242.284 ms | 33 - 1114 MB | NPU
117
+ | encoder | TFLITE | float | Qualcomm® QCS9075 | 294.179 ms | 32 - 109 MB | NPU
118
+ | encoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 514.248 ms | 0 - 1934 MB | NPU
119
+ | encoder | TFLITE | float | Qualcomm® SA7255P | 360.275 ms | 33 - 1120 MB | NPU
120
+ | encoder | TFLITE | float | Qualcomm® SA8295P | 373.937 ms | 33 - 1160 MB | NPU
121
+ | encoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 130.308 ms | 32 - 1113 MB | NPU
122
 
123
  ## License
124
  * The license for the original implementation of MobileSam can be found
release_assets.json CHANGED
@@ -1 +1,29 @@
1
- {"version":"0.50.2","precisions":{"float":{"universal_assets":{"onnx":{"tool_versions":{"qairt":"2.42.0.251225135753_193295","onnx_runtime":"1.24.3"},"download_url":"https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/releases/v0.50.2/mobilesam-onnx-float.zip"},"qnn_dlc":{"tool_versions":{"qairt":"2.43.0.260127150333_193827"},"download_url":"https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/releases/v0.50.2/mobilesam-qnn_dlc-float.zip"},"tflite":{"tool_versions":{"qairt":"2.43.0.260127150333_193827","tflite":"2.19.1"},"download_url":"https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/releases/v0.50.2/mobilesam-tflite-float.zip"}}}}}
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "version": "0.51.0",
3
+ "precisions": {
4
+ "float": {
5
+ "universal_assets": {
6
+ "tflite": {
7
+ "tool_versions": {
8
+ "qairt": "2.45.0.260326154327",
9
+ "litert": "1.4.2"
10
+ },
11
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/releases/v0.51.0/mobilesam-tflite-float.zip"
12
+ },
13
+ "qnn_dlc": {
14
+ "tool_versions": {
15
+ "qairt": "2.45.0.260326154327"
16
+ },
17
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/releases/v0.51.0/mobilesam-qnn_dlc-float.zip"
18
+ },
19
+ "onnx": {
20
+ "tool_versions": {
21
+ "qairt": "2.42.0.251225135753_193295",
22
+ "onnx_runtime": "1.24.3"
23
+ },
24
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/releases/v0.51.0/mobilesam-onnx-float.zip"
25
+ }
26
+ }
27
+ }
28
+ }
29
+ }