2128 AIs indexed
↑↓ navigate
↵ open
The open-source inference engine most self-hosted LLM deployments run on
vLLM is a high-throughput, memory-efficient open-source library for serving large language models, built around its PagedAttention algorithm. It underpins a large share of production and research LLM-serving infrastructure.
No reviews yet — be the first to share your experience.
It's easier when you're signed in — Altern helps you get more out of AI.
By continuing you agree to our Terms and Privacy Policy.