Home » AI Directory » Developer » llama.cpp
llama.cpp
LLM inference in C/C++ on local hardware.
Visit llama.cpp » github.com/ggml-org/llama.cpp
| llama.cpp at a glance | |
|---|---|
| What it does | LLM inference in C/C++ on local hardware |
| Category | Developer |
| Website | github.com/ggml-org/llama.cpp |
| Checked | Website working when last checked (2026-10-16) |
In their own words
“LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.”
— from the llama.cpp website
8 alternatives to llama.cpp
Other developer tools that do similar things:
Groq
Fast LLM inference on custom LPU hardware
SambaNova
AI inference platform on custom hardware
Goose
Open-source extensible AI agent for local coding and automation
Lakera
Security guardrails for LLM applications against prompt injection
LangChain
Framework and platform for building LLM agents
LangSmith
Observability and evaluation for LLM apps
LlamaIndex
Framework for building LLM apps over your data
Haystack
Open-source framework for LLM and RAG pipelines
How to choose
- Try it on your real codebase, not a demo. Results vary a lot by language and project size.
- Decide how much control you want: suggestions you accept line by line, or an agent that makes larger changes for you to review.
- Check your company's rules on sending code to outside AI services before you start.
Full guide to choosing developer tools »
Is this your tool? Get it featured at the top of its category. Something wrong on this page? Tell us.