About llama.cpp
llama.cpp is a C++ implementation for running large language model inference. Inference is the process of using a trained model to produce outputs from new input, such as generating or continuing text. The project’s purpose is to provide an implementation of that model-running process in C++, making it relevant to applications and tools that need to execute language models. The supplied description identifies the implementation language and function but does not list supported model formats, hardware acceleration, interfaces, or performance characteristics. Those details vary across builds and model configurations. The product should therefore be understood here as an inference implementation rather than a complete conversational application or model collection. Users need a compatible model and runtime configuration to use it for a particular task.
Categories
Platforms
Website & Downloads
Trusted package or store listing
Related software
- 5ire — 5ire is an AI assistant and MCP client designed to connect language models with tools and data sources.
- AI Browser Toolkit — AI Browser Toolkit is a JSON-over-HTTP server that lets an AI agent control a real Chrome or Edge browser window.
- AI Context Builder — AI Context Builder converts C# and .NET solutions into compact Markdown context for coding agents.
- AI Limits — AI Limits is a small Windows 11 overlay that displays usage limits for supported AI providers.
- AI Usage Dashboard — AI Usage Dashboard is a local Windows application for viewing usage windows and balances across supported AI services.
- AI Viewer — AI Viewer opens and previews Adobe Illustrator (.ai) graphic files and can convert them to other image formats such as JPEG, bitmap, GIF, and PNG.
