dlgo

dlgo is an open source Go package and command line tool providing a fast inference engine for running large language models (LLMs), vision-language models, and text-to-image diffusion pipelines locally on CPU or Vulkan GPU without Python dependencies. It supports multiple quantization formats, GPU acceleration, local chat and web server interfaces, and includes features like multimodal inference, voice transcription, and deterministic typed decisions.