Sirius: A Dual-Chiplet System for Multimodal Embodied AI with Heterogeneous RVV Cores, Dense and Sparse Accelerators

Abstract: 

Sirius is a dual-chiplet system targeting multimodal embodied AI on resource-constrained platforms. It integrates heterogeneous RISC-V Vector (RVV) cores with dense and sparse accelerators to efficiently execute diverse workloads, including transformers, vision backbones, and robotics pipelines. Sirius addresses deployment challenges through three innovations: (1) support for diverse non-uniform quantization schemes via programmable LUTs and outlieraware dense and sparse (D+S) decomposition, (2) a logically shared, physically distributed scratchpad memory system enabling kernel fusion and heterogeneous streaming, and (3) chiplet-based disaggregation using a custom interconnect. Fabricated in Intel16, Sirius delivers up to 2.24 TFLOPS/W for dense GeMM, 7.11 TFLOPS/W for SpMV, and achieves end-to-end 16 tokens/sec at 23 mJ/token on Qwen2.5-0.5B SLM, and 0.97 TFLOPS/W for robotics perception.

Publication date: 
January 1, 2026
Publication type: 
Conference Paper