Home » AI Directory » Developer » vLLM
vLLM
High-throughput open-source LLM serving engine.
Visit vLLM » docs.vllm.ai
| vLLM at a glance | |
|---|---|
| What it does | High-throughput open-source LLM serving engine |
| Category | Developer |
| Website | docs.vllm.ai |
| Checked | Website working when last checked (2026-10-16) |
8 alternatives to vLLM
Other developer tools that do similar things:
Qdrant
Open-source vector database and similarity search engine
Haystack
Open-source framework for LLM and RAG pipelines
LiteLLM
Open-source LLM gateway with a unified API
Helicone
Open-source LLM observability and gateway
Langfuse
Open-source LLM engineering platform for tracing and evals
Arize Phoenix
Open-source LLM tracing and evaluation
Comet Opik
Open-source LLM evaluation and tracing
DeepEval
Open-source framework for evaluating LLM outputs
How to choose
- Try it on your real codebase, not a demo. Results vary a lot by language and project size.
- Decide how much control you want: suggestions you accept line by line, or an agent that makes larger changes for you to review.
- Check your company's rules on sending code to outside AI services before you start.
Full guide to choosing developer tools »
Is this your tool? Get it featured at the top of its category. Something wrong on this page? Tell us.