vMCU MLSys 2024

vMCU Coordinated Memory Management and Kernel Optimization for DNN Inference on MCUs

Posted by Treaseven on April 9, 2025

Motivation

Design

Segment-level Memory Management

Segment-aware Kernel Design

  • kernel design for single layer
  • kernel design for multiple layer

vMCU Compiler Support

  • vector intrinsic support
  • library generation

Evaluation

Reference

vMCU: Coordinated Memory Management and Kernel Optimization for DNN Inference on MCUs