Modelship

Modelship is an open source self-hosted inference platform compatible with OpenAI APIs, supporting reasoning large language models, universal tool calling, and multimodal models including embeddings, speech, and image generation. It runs multiple AI models efficiently on shared GPUs or CPUs using Ray Serve, enabling easy deployment and scaling of AI agents and applications within your own hardware environment.