Tag: Edge Inference
-
TFLite & ONNX Mobile Setup: 2x Speed Left on Table
Default TFLite and ONNX configs waste 2-8x performance. Here's the exact setupโdelegates, threads, quantizationโthat closes the gap on ARM devices.
Default TFLite and ONNX configs waste 2-8x performance. Here's the exact setupโdelegates, threads, quantizationโthat closes the gap on ARM devices.