vLLM logo

vLLM

Fast open-source LLM serving engine.

What is vLLM?

vLLM is an AI product in the Open & local category on my9ai. Fast open-source LLM serving engine. Learn more on the official vLLM page.

vLLM at a glance
Typeproduct
CategoryOpen & local
Official sitedocs.vllm.ai
On my9ai cards0
Similar picksOllama, LM Studio, Open WebUI, SillyTavern

How many people use vLLM?

Nobody has put vLLM on a card yet. The first card with it sets the numbers here.

Numbers update live from the cards people publish. See this week's trending AI.

Other Open & local AI

Do you make vLLM? Add the badge

Show how many people put vLLM in their nine. Paste this on your site or README:

vLLM on my9ai badge
<a href="https://my9ai.com/tools/vllm"><img src="https://my9ai.com/badge/vllm.svg" alt="vLLM on my9ai" height="28"></a>