Altern Altern
Sign in
2569 AIs indexed
AIs Categories Buildboard Tasks Lists Alternatives Leaderboard Add
llama.cpp logo
Alternatives to

llama.cpp

The C++ engine that made local LLMs practical

7 approved alternatives Suggest an alternative
Top Recently added

Looking for a tool like llama.cpp (The C++ engine that made local LLMs practical)? Below are 7 AI tools people use as an alternative to llama.cpp, ranked by leaderboard position. Each one is approved by our editors and worth comparing before you decide.

Modular
Modular

MAX and Mojo for fast portable AI inference

Report
LocalAI
LocalAI

Drop-in OpenAI-compatible API for local models

Report
TensorRT-LLM
TensorRT-LLM

NVIDIA's library for optimized LLM inference

Report
SGLang
SGLang

Fast serving framework for LLMs and multimodal models

Report
vLLM
vLLM

The open-source inference engine most self-hosted LLM deployments run on

Report
Ollama
Ollama

Run open-source LLMs locally with one command

Report
LM Studio
LM Studio

Desktop app for downloading and running local LLMs

Report

Sign in to continue

It's easier when you're signed in — Altern helps you get more out of AI.

Continue with GitHub Continue with Google

By continuing you agree to our Terms and Privacy Policy.