Janus

Janus is an AI model API router written in Go that runs local GGUF models using Vulkan GPU acceleration or CPU fallback. It exposes an OpenAI-compatible API, enabling integration with OpenAI clients and supports hot-swapping models without restart. Janus requires no dependencies like Python or Docker, providing a simple single binary server for local AI inference.