Altern Altern
Sign in
2569 AIs indexed
AIs Categories Buildboard Tasks Lists Alternatives Leaderboard Add
TensorRT-LLM logo
Alternatives to

TensorRT-LLM

NVIDIA's library for optimized LLM inference

5 approved alternatives Suggest an alternative
Top Recently added

The most recently approved AI tools people use as an alternative to TensorRT-LLM (NVIDIA's library for optimized LLM inference), newest first.

Modular
Modular

MAX and Mojo for fast portable AI inference

Report
Text Generation Inference
Text Generation Inference

Hugging Face's production server for LLMs

Report
SGLang
SGLang

Fast serving framework for LLMs and multimodal models

Report
vLLM
vLLM

The open-source inference engine most self-hosted LLM deployments run on

Report
llama.cpp
llama.cpp

The C++ engine that made local LLMs practical

Report

Sign in to continue

It's easier when you're signed in — Altern helps you get more out of AI.

Continue with GitHub Continue with Google

By continuing you agree to our Terms and Privacy Policy.