Chroma
Chroma is an open-source vector database, the store behind retrieval-augmented generation. You embed your documents, Chroma indexes the embeddings, and at question time it returns the passages closest in meaning to the query so a model can answer from your own content with citations. It runs embedded inside a Python process for prototypes or as a standalone server for shared use.
View the repo · chroma-core/chroma ↗Teams building a knowledge assistant or any retrieval system over their own documents, policies, contracts or tickets. It suits projects that want a simple, well-documented store without operating a heavyweight search cluster. If you already run Postgres everywhere, the pgvector extension may be the quieter operational choice, and very large corpora with strict latency demands can justify a dedicated managed vector service instead.
Install itpip install chromadb
# start a server:
chroma run --path ./chroma-data Before production The database is the easy part. Answer quality is decided by chunking, embedding choice, retrieval strategy and evaluation, and each of those needs testing against real questions from your team. Plan for re-indexing, because changing your embedding model later means re-embedding everything. Chroma does not enforce document-level permissions on its own, so if different users may see different documents, that filtering has to be built into the application layer around it.
Where Blash AI comes inWe build the production retrieval layer on top: parsing with Unstructured or Marker from this library, a chunking and metadata scheme that fits your documents, permission filtering, citations in every answer, and an evaluation set that measures accuracy before anyone trusts it. The result is a system whose answers you can check rather than a demo that impresses once.
When you want this running on your real stack, that is the engagement
Book an AI audit →n8n →
n8n is workflow automation you run on your own infrastructure. It connects the applications a business already uses through a visual editor, with hundreds of prebuilt nodes, a code step for anything bespoke, and native support for calling language models mid-flow. Think of it as a self-hosted alternative to Zapier or Make that you own outright, including every piece of data passing through it.
Ollama →
Ollama runs open-weight language models on your own machine or server. One command downloads a model and serves it behind a local API that most existing AI tooling can talk to, so an application built against a hosted provider can point at your own hardware instead. Sensitive data stays inside your network, there are no per-token fees, and it keeps working with no internet connection at all.
LiteLLM →
LiteLLM is a gateway that lets you call models from Anthropic, OpenAI, Google and many other providers through one consistent API. It runs as a Python library inside your code or as a standalone proxy server in front of your whole stack, with cost tracking, per-key budgets, rate limits and automatic fallbacks for when a provider has a bad day.