PagedServe

PagedServe is an experimental, open-source LLM inference runtime built from scratch to explore advanced techniques like paged KV memory, continuous batching, blockwise attention, and custom GPU kernels. It integrates with Hugging Face PyTorch models and offers an OpenAI-compatible REST API for inference, designed for benchmarking and research in efficient transformer serving.