Tag: Core ML
-
On-Device Whisper: ONNX and Core ML Inference Guide
ONNX Runtime + CoreML beats native Core ML for Whisper on iOS by 40%. Conversion script, memory pool tricks, and A15/A16 benchmark numbers.
ONNX Runtime + CoreML beats native Core ML for Whisper on iOS by 40%. Conversion script, memory pool tricks, and A15/A16 benchmark numbers.