Ollama
toolRun local LLMs — open-source model serving with OpenAI-compatible API
Ollama lets you run large language models locally with minimal setup. Supports Llama, Mistral, Gemma, Qwen, DeepSeek, and hundreds of other open-weight models. Includes OpenAI-compatible API, model management, and multi-modal support. Runs on macOS, Linux, and Windows.