ChromaDB

Chroma is an open-source vector database purpose-built for AI applications that need to store embeddings alongside their metadata and documents, then retrieve them via approximate nearest neighbor search. The core engine was rewritten in Rust for performance, exposing a simple Python and JavaScript/TypeScript client API on top of a client-server architecture that can run embedded in-process for prototyping or as a standalone server (Docker, binary, or Chroma Cloud) for production workloads. It uses HNSW indexing internally, supports cosine, L2, and inner-product distance functions, and allows combined vector similarity search with structured metadata filtering (where clauses) in a single query. Primary use cases include retrieval-augmented generation (RAG) pipelines, semantic search, recommendation systems, and agent memory stores. Chroma integrates natively with LangChain, LlamaIndex, and OpenAI/Cohere/HuggingFace embedding functions, and exposes a REST API alongside its native SDKs, making it easy to swap in as the retrieval layer for LLM applications without managing infrastructure directly. Collections are the core abstraction—groupings of embeddings, documents, and metadata that support upsert, delete, and multi-tenant isolation. Chroma targets application engineers and ML practitioners building LLM-powered products who want a lightweight, developer-friendly vector store rather than a heavyweight distributed system. The self-hosted single-node deployment is popular for local development and small-to-mid production workloads, while Chroma Cloud (built on a distributed, serverless architecture) addresses teams needing managed scaling, high availability, and separation of storage/compute without operating the database themselves.