Tag: edge deployment
-
MobileNetV3 vs EfficientNet-Lite: ARM CPU Latency Benchmark
MobileNetV3-Small runs 2.9x faster than EfficientNet-Lite0 on Raspberry Pi 4โ23ms vs 67ms. Here's why paper FLOPs don't match real ARM latency.
-
ONNX Runtime Inlining Flags: 8x Latency Cut in 4 Steps
Cut ONNX Runtime latency by 8x with 4 inlining flags. Learn session config tuning for C++/Python inference optimizationโsimple yet powerful.
-
QAT vs PTQ: When 3% Accuracy Drop Kills Your Model
Compare QAT vs PTQ to find when that 3% accuracy gap destroys real-world performanceโand which quantization method saves your model.