InstinctFlash

InstinctFlash is an open-source, high-performance runtime framework designed for serving robotics models efficiently. It supports multiple model families with advanced optimizations including FP8 precision, caching, and kernel fusion, enabling significant speedups on various hardware such as desktop GPUs and Jetson edge devices. It provides both Python API and WebSocket serving for integration with robotics applications.