LocalAI
Drop-in OpenAI-compatible API for local models
Oct 13
Text Generation Inference
Hugging Face's production server for LLMs
Oct 13
TensorRT-LLM
NVIDIA's library for optimized LLM inference
Oct 13
SGLang
Fast serving framework for LLMs and multimodal models
Oct 13
llama.cpp
The C++ engine that made local LLMs practical
Oct 13
GPT4All
Run language models privately on your own computer
Oct 13
Nomic
Embeddings and tools to explore large text datasets
Oct 13
Laminar
Open-source tracing and evals for AI agents
Oct 13
OpenLLMetry
OpenTelemetry instrumentation for LLM frameworks
Oct 13
Traceloop
Observability for LLM apps built on OpenTelemetry
Oct 13
Arthur
AI performance monitoring with an open-source evaluation engine
Oct 13
Garak
NVIDIA's open-source scanner for LLM vulnerabilities
Oct 13
Protect AI
Security platform for machine-learning systems
Oct 13
NeMo Guardrails
NVIDIA's toolkit for controlling LLM conversations
Oct 13
Guardrails AI
Open-source framework for validating LLM outputs
Oct 13
Kong AI Gateway
API gateway features for routing and governing LLM traffic
Oct 13
TruLens
Open-source evaluation and tracking for LLM experiments
Oct 13
DeepEval
Pytest-style open-source framework for testing LLM apps
Oct 13
Opik
Comet's open-source LLM tracing and evaluation suite
Oct 13
Arize Phoenix
Open-source tracing and evaluation for LLM apps
Oct 13
Docling
Open-source document converter from IBM Research
Oct 13
Crawl4AI
Open-source crawler that outputs LLM-ready markdown
Oct 13
Apify
Marketplace and platform for web scraping and automation
Oct 13
Skyvern
Computer-vision agents that automate browser workflows
Oct 13
