About llml
llml is a terminal interface for discovering local large language models and launching inference servers. It can work with llama.cpp, vLLM, Ollama, and MLX, providing a common interface for finding available models and starting them with a selected backend. The tool is aimed at users who run language models locally and want to manage discovery and launch from a terminal. The supplied description does not list model repositories, configuration options, or server monitoring features. Its capabilities depend on the available local models and backend software installed on the computer. The available backends include several tools for local inference and model serving.
Categories
Platforms
Website & Downloads
Trusted package or store listing
Related software
- 5ire — 5ire is an AI assistant and MCP client designed to connect language models with tools and data sources.
- AI Browser Toolkit — AI Browser Toolkit is a JSON-over-HTTP server that lets an AI agent control a real Chrome or Edge browser window.
- AI Context Builder — AI Context Builder converts C# and .NET solutions into compact Markdown context for coding agents.
- AI Limits — AI Limits is a small Windows 11 overlay that displays usage limits for supported AI providers.
- AI Usage Dashboard — AI Usage Dashboard is a local Windows application for viewing usage windows and balances across supported AI services.
- AI Viewer — AI Viewer opens and previews Adobe Illustrator (.ai) graphic files and can convert them to other image formats such as JPEG, bitmap, GIF, and PNG.
