LocalAI

Looking for a tool like LocalAI (Drop-in OpenAI-compatible API for local models)? Below are 5 AI tools people use as an alternative to LocalAI, ranked by leaderboard position. Each one is approved by our editors and worth comparing before you decide.

Text Generation Inference

Hugging Face's production server for LLMs

Report

LM Studio

Desktop app for downloading and running local LLMs

Report

llama.cpp

The C++ engine that made local LLMs practical

Report

Ollama

Run open-source LLMs locally with one command

Report

vLLM

The open-source inference engine most self-hosted LLM deployments run on

Report