MICSim: A Modular Simulator for Mixed-signal Compute-in-Memory based AI Accelerator
This work provides a tool for researchers and engineers designing AI accelerators, though it is incremental as it builds upon NeuroSim with modular improvements.
The authors tackled the challenge of early-stage evaluation for mixed-signal compute-in-memory AI accelerators by introducing MICSim, an open-source modular simulator that achieved a 9x to 32x speedup over the existing NeuroSim simulator.
This work introduces MICSim, an open-source, pre-circuit simulator designed for early-stage evaluation of chip-level software performance and hardware overhead of mixed-signal compute-in-memory (CIM) accelerators. MICSim features a modular design, allowing easy multi-level co-design and design space exploration. Modularized from the state-of-the-art CIM simulator NeuroSim, MICSim provides a highly configurable simulation framework supporting multiple quantization algorithms, diverse circuit/architecture designs, and different memory devices. This modular approach also allows MICSim to be effectively extended to accommodate new designs. MICSim natively supports evaluating accelerators' software and hardware performance for CNNs and Transformers in Python, leveraging the popular PyTorch and HuggingFace Transformers frameworks. These capabilities make MICSim highly adaptive when simulating different networks and user-friendly. This work demonstrates that MICSim can easily be combined with optimization strategies to perform design space exploration and used for chip-level Transformers CIM accelerators evaluation. Also, MICSim can achieve a 9x - 32x speedup of NeuroSim through a statistic-based average mode proposed by this work.