LlamaIndex
LlamaIndex builds document parsing and extraction software plus open-source tools for AI applications, helping teams turn enterprise documents into usable data for AI agents and workflows.

LocalAI is an open-source AI engine that runs language, voice, vision, image, video, and agent workloads on your own hardware through an OpenAI-compatible API, with no GPU required.
LocalAI is an open-source AI engine for running text, voice, vision, image, video, 3D, and agent workloads on hardware you already own, and it is aimed at developers and teams that want a local, OpenAI-compatible endpoint without a mandatory GPU. The project is MIT-licensed and listed at v4.8.0 on its site.
LocalAI ships as one binary with an OpenAI-compatible API in front of it. Point an existing client at the endpoint and the calls keep working, except the model now runs on your machine. It also speaks the Anthropic, Ollama, and ElevenLabs APIs, so many tools need only a URL change.
The engine behind that API is swappable. One model can run on llama.cpp while the next loads on vLLM, SGLang, or MLX, and the client sees the same endpoint and the same request. Switching engines is one line in the model's config. A small core pulls each engine in as a separate backend only when a model asks for it, which keeps one install from turning into a 9 GB download.
Every feature ships a CPU path first, and that path is tested in CI on hardware most people already have. It is not a degraded fallback: a GPU makes things faster but is not required. The supported targets include x86_64, ARM64, CUDA, ROCm, SYCL, Metal, and Vulkan.
That matters most for realtime work. Speech in, tool calls in the middle, and speech out over WebRTC can feel like a conversation, and transcription, diarization, and speech synthesis all run without a GPU.
A chat model can only work with what someone types at it. LocalAI's engines change what the model can access: live transcription with speaker labels and timestamps, 527 kinds of sound event, voice and face recognition, plain-language object queries that return coordinates, distance in metres from one photo, and full 3D reconstruction from a handful of images. Speech synthesis supports long-form speech in a cloned voice across dozens of languages at up to 48 kHz, and echo cancellation, noise suppression, and dereverberation help a voice loop survive a real room. One session can hear the room, work out who is talking, read what is on the desk, call a tool, and answer out loud through one API on one machine.
Adding a second machine is the runtime's problem rather than yours. Routing, VRAM-aware placement, prefix-cache affinity, autoscaling, P2P, NATS, and failover are handled by the runtime, so you add hardware and the cluster works out what to do with it.
Weights decide whether a model runs at all, so the project builds those too. APEX assigns a different precision to every tensor and layer: a 35B mixture-of-experts model goes from 64.6 GB to 12.2 GB, and from 30.4 to 74.4 tokens a second, while perplexity moves from 6.537 to 7.088. The file is an ordinary GGUF, so stock llama.cpp opens it without patches, and 201 APEX models are already in the LocalAI gallery.
local-ai chat opens a terminal agent that runs against your LocalAI server. It is not a separate tool: the agent is compiled into the local-ai binary, so if you have LocalAI you already have it. It works in the shell you already have open, reads your files, runs commands on your machine, delegates to sub-agents, and loads MCP servers, plugins, and skills. Read-only work happens on its own; anything that can change something asks you first. The agent is nib embedded in LocalAI, which is why its plugin, skill, and MCP ecosystem works unchanged.
This is a breaking change from the old plain chat prompt. The agent now executes shell commands behind an approval gate, the old /clear command is gone, and /compact is the nearest equivalent. Read-only tools run without asking, covering reads, searches, and read-only shell commands such as ls and cat. Everything else prompts for approval, and you can approve, deny, or trust the tool for the rest of the session. --yolo, or LOCALAI_CHAT_YOLO=1, approves every tool call without asking, which is the right setting for a sandbox and the wrong one for your laptop.
--cli makes the agent answer a piped question and exit. Read-only tools still run, so a piped question can inspect a repository or a log file. A tool call that is not read-only is denied because nobody is at the keyboard to approve it, and the session exits 3, deliberately not 1, so a script can tell "I refused to act" apart from "I crashed." Pipe a question in without --cli and the agent refuses, naming --cli.
Config, plugins, and skills live in ~/.config/localai/chat/, or under $XDG_CONFIG_HOME when set, and can be overridden with --config-dir or LOCALAI_CHAT_CONFIG_DIR. The directory is user-scoped rather than server-scoped because the agent is a client and may point at a remote LocalAI. Management commands are passed through, and Claude Code plugins install as they are. In scripts, pass --yes: plugin install without it in a non-interactive context installs the plugin but leaves it disabled, prints that it did, and still exits 0.
LocalAI runs in about a minute: a container on any platform, a DMG on macOS, a binary on Linux, or a Helm chart on Kubernetes. Backends download themselves the first time a model asks for one, so the base install stays small. The install script detects the platform, fetches the latest release binary, and local-ai run pulls the backend and starts an API on localhost:8080.
Subscription pricing is not listed.
Features, pricing and availability may change. Always verify details on the official website. Maintained by steven · Last updated Oct 16, 2026 →
LlamaIndex builds document parsing and extraction software plus open-source tools for AI applications, helping teams turn enterprise documents into usable data for AI agents and workflows.
Flowith is an agentic AI workspace that combines a whiteboard-style canvas, access to 40+ image and video models, and mini apps for design, e-commerce, and social content.
Fine-tune open models faster with far less memory
Groq is an AI inference cloud for developers and enterprises that need low-latency model responses at scale, delivered through custom LPU hardware and a tiered platform spanning bare metal, inference, and enterprise controls.