SemiAnalysis split the world into GPU-rich and GPU-poor. Local-model fans wear the label proudly.
Source · 2023-08L
llama.cpp
Runs LLMs on CPUs and GPUs in plain C++.
What is llama.cpp?
llama.cpp is an AI product in the Open & local category on my9ai. Runs LLMs on CPUs and GPUs in plain C++. Learn more on the official llama.cpp page.
| Type | product |
|---|---|
| Category | Open & local |
| Official site | github.com/ggml-org/llama.cpp |
| On my9ai cards | 0 |
| Similar picks | Ollama, LM Studio, Open WebUI, SillyTavern |
How many people use llama.cpp?
Nobody has put llama.cpp on a card yet. The first card with it sets the numbers here.
Numbers update live from the cards people publish. See this week's trending AI.
Inside jokes about llama.cpp
Other Open & local AI
Do you make llama.cpp? Add the badge
Show how many people put llama.cpp in their nine. Paste this on your site or README:
<a href="https://my9ai.com/tools/llama-cpp"><img src="https://my9ai.com/badge/llama-cpp.svg" alt="llama.cpp on my9ai" height="28"></a>