Altern Altern
Sign in
2569 AIs indexed
AIs Categories Buildboard Tasks Lists Alternatives Leaderboard Add
vLLM logo
Alternatives to

vLLM

The open-source inference engine most self-hosted LLM deployments run on

8 approved alternatives Suggest an alternative
Top Recently added

Looking for a tool like vLLM (The open-source inference engine most self-hosted LLM deployments run on)? Below are 8 AI tools people use as an alternative to vLLM, ranked by leaderboard position. Each one is approved by our editors and worth comparing before you decide.

Modular
Modular

MAX and Mojo for fast portable AI inference

Report
LocalAI
LocalAI

Drop-in OpenAI-compatible API for local models

Report
TensorRT-LLM
TensorRT-LLM

NVIDIA's library for optimized LLM inference

Report
SGLang
SGLang

Fast serving framework for LLMs and multimodal models

Report
Text Generation Inference
Text Generation Inference

Hugging Face's production server for LLMs

Report
llama.cpp
llama.cpp

The C++ engine that made local LLMs practical

Report
AlphaSense
AlphaSense

AI search across earnings calls and filings

Report
Jan
Jan

Privacy-first desktop app for running AI models locally

Report

Sign in to continue

It's easier when you're signed in — Altern helps you get more out of AI.

Continue with GitHub Continue with Google

By continuing you agree to our Terms and Privacy Policy.