Comet Lab Atlas

Atlas — by Comet Lab

The AI tooling landscape, mapped.

Every layer of a working AI system, from chat window to hosting underneath. The tools that fill each layer. Curated to what works.

146 tools 15 layers 146 with full write-ups See the stack map

146 of 146

Langfuse

Observability & evals

An open-source platform for tracing, evaluating, and monitoring LLM and agent applications.

Open sourceSelf-hostHosted API

LangGraph

Agent frameworks

A low-level framework for building stateful, multi-step agents as explicit graphs of nodes and edges.

Open sourceSelf-host

LiteLLM

Gateways & routers

An open-source proxy that gives 100+ model providers one OpenAI-compatible API.

Open sourceSelf-host

Llama

Open-weight models

Meta's family of open-weight models — the most widely deployed base for self-hosted AI.

Open weightSelf-host

LlamaIndex

RAG & knowledge

A data framework for connecting language models to your own documents and structured data.

Open sourceSelf-hostHosted API

Model Context Protocol

MCP & connectors

An open standard for connecting AI models to tools and data through a common protocol.

Open sourceSelf-host

n8n

Workflow & automation

A fair-code workflow automation tool with 400+ integrations and AI nodes, self-hostable end to end.

Source-availableSelf-hostHosted API

Ollama

Model serving

The simplest way to download and run open-weight models locally, with one command.

Open sourceSelf-host

Open WebUI

Chat & assistant UIs

A self-hosted, feature-rich chat interface for local and remote models — the most common front door for a private assistant.

Open sourceSelf-host

OpenAI

LLM providers

The most widely adopted frontier-model provider — the usual default for a new AI project.

ProprietaryHosted API

pgvector

Vector databases

A PostgreSQL extension that adds vector similarity search to a database you already run.

Open sourceSelf-host

Playwright

Browser automation

Microsoft's modern browser automation library — the reliable base for driving a real browser.

Open sourceSelf-host

Unstructured

Document extraction

A toolkit and API for turning PDFs, office files, and emails into clean, chunked text for AI.

Open sourceSelf-hostHosted API

Vercel

Hosting & infrastructure

A developer platform for deploying web apps and AI front-ends with minimal configuration.

ProprietaryHosted API

Whisper

Voice & transcription

OpenAI's open-source speech-to-text model — the default starting point for transcription.

Open sourceSelf-host

Activepieces

Workflow & automation

An open-source, no-code automation tool positioned as a self-hostable Zapier alternative.

Open sourceSelf-hostHosted API

Agno

Agent frameworks

A fast, lightweight Python framework for building multi-agent systems with memory and tools.

Open sourceSelf-host

Amazon Bedrock

LLM providers

AWS's managed service for calling many foundation models behind one API.

ProprietaryHosted API

Amazon Web Services

Hosting & infrastructure

The broadest cloud platform — compute, storage, GPUs, and managed AI services at any scale.

ProprietaryHosted API

Anthropic

LLM providers

The maker of Claude, frontier models known for strong reasoning, long context, and tool use.

ProprietaryHosted API

AnythingLLM

Chat & assistant UIs

An all-in-one desktop or self-hosted app that turns a folder of documents into a chat assistant with workspaces.

Open sourceSelf-host

Apache Airflow

Workflow & automation

The long-standing open-source platform for authoring, scheduling, and monitoring data pipelines as code.

Open sourceSelf-hostHosted API

Arcade

MCP & connectors

A platform for giving agents authenticated tool access, handling OAuth and per-user permissions.

ProprietaryHosted API

AssemblyAI

Voice & transcription

A commercial speech-to-text API pairing transcription with audio-intelligence models.

ProprietaryHosted API

AutoGen

Agent frameworks

Microsoft's framework for multi-agent systems built around asynchronous, conversational message passing.

Open sourceSelf-host

Azure AI Foundry

LLM providers

Microsoft's platform for accessing OpenAI and other models within the Azure cloud.

ProprietaryHosted API

Baseten

Model serving

A platform for deploying and serving custom and open models on autoscaling infrastructure.

ProprietaryHosted API

Bifrost

Gateways & routers

A fast, open-source LLM gateway written in Go, with one API across providers.

Open sourceSelf-host

big-AGI

Chat & assistant UIs

A feature-rich open-source AI suite with personas, multi-model chat, and side-by-side response comparison.

Open sourceSelf-host

Braintrust

Observability & evals

A commercial platform for evaluating, logging, and iterating on AI products.

ProprietaryHosted API

Browser Use

Browser automation

An open-source library that lets an AI agent control a browser from natural-language goals.

Open sourceSelf-hostHosted API

Browserbase

Browser automation

A hosted, scalable headless-browser platform purpose-built for AI agents that browse the web.

ProprietaryHosted API

Browserless

Browser automation

A self-hostable service for running headless browsers behind a managed API.

Source-availableSelf-hostHosted API

Cartesia

Voice & transcription

A commercial provider of very low-latency, realistic text-to-speech for real-time voice apps.

ProprietaryHosted API

Chatbox

Chat & assistant UIs

A cross-platform desktop client for chatting with many model providers and local models from one app.

Open sourceSelf-host

Chroma

Vector databases

An open-source embedding database designed to be the simplest way to start with RAG.

Open sourceSelf-hostHosted API

Claude Agent SDK

Agent frameworks

Anthropic's SDK for building agents on Claude, with tools, subagents, and managed context.

Open sourceSelf-host

Cloudflare AI Gateway

Gateways & routers

Cloudflare's proxy for model traffic, adding caching, rate limiting, and analytics at the edge.

ProprietaryHosted API

Cloudflare Workers

Hosting & infrastructure

A serverless platform that runs code at the edge, with AI, storage, and database primitives.

ProprietaryHosted API

Cognita

RAG & knowledge

An open-source, modular RAG framework from TrueFoundry for taking pipelines to production.

Open sourceSelf-host

Cohere

LLM providers

An enterprise-focused AI provider with strong models for retrieval, ranking, and generation.

ProprietaryHosted API

Command R

Open-weight models

Cohere's open-weight models tuned for retrieval-augmented generation and tool use.

Open weightSelf-host

Composio

MCP & connectors

A platform that gives agents authenticated access to hundreds of apps through managed tools.

ProprietaryHosted API

Coolify

Hosting & infrastructure

An open-source, self-hostable platform for deploying apps — a Heroku and Netlify alternative.

Open sourceSelf-hostHosted API

CrewAI

Agent frameworks

A framework for orchestrating role-based agents that collaborate on a task as a crew.

Open sourceSelf-hostHosted API

DeepEval

Observability & evals

An open-source "Pytest for LLMs" — a unit-testing framework for model outputs.

Open sourceSelf-host

Deepgram

Voice & transcription

A commercial speech API built for fast, accurate transcription at scale, including real-time.

ProprietaryHosted API

DeepSeek

Open-weight models

A family of open-weight models known for strong reasoning and coding at a low cost to run.

Open weightSelf-hostHosted API

Dify

Workflow & automation

An open-source platform for building LLM apps and agentic workflows on a visual canvas.

Open sourceSelf-hostHosted API

Docling

Document extraction

IBM's open-source library for parsing documents into a structured, AI-ready representation.

Open sourceSelf-host

DSPy

Agent frameworks

A framework for programming language models with optimizable modules instead of hand-written prompts.

Open sourceSelf-host

Elasticsearch

Vector databases

The widely deployed search engine, now with dense vector and hybrid search built in.

Source-availableSelf-hostHosted API

ElevenLabs

Voice & transcription

A leading text-to-speech and voice platform known for highly natural, expressive synthetic speech.

ProprietaryHosted API

faster-whisper

Voice & transcription

A fast reimplementation of Whisper on CTranslate2, with much lower latency and memory use.

Open sourceSelf-host

FastMCP

MCP & connectors

The most-used framework for building MCP servers in Python, with a fast, decorator-based API.

Open sourceSelf-host

Fireworks AI

Model serving

A hosted inference platform focused on fast, low-cost serving of open models.

ProprietaryHosted API

Fly.io

Hosting & infrastructure

A platform for running containers close to users, with easy global and GPU deployment.

ProprietaryHosted API

Gemma

Open-weight models

Google's family of small, capable open-weight models built from Gemini research.

Open weightSelf-host

Google Cloud

Hosting & infrastructure

Google Cloud — compute, data, and AI infrastructure, including Vertex AI and Gemini.

ProprietaryHosted API

Google Gemini

LLM providers

Google's Gemini models, offering very long context and strong native multimodal support.

ProprietaryHosted API

Groq

Model serving

A hosted inference service running open models on custom hardware for very low latency.

ProprietaryHosted API

Haystack

RAG & knowledge

deepset's open-source framework for composable, production-grade search and RAG pipelines.

Open sourceSelf-host

Helicone

Observability & evals

An open-source observability platform that logs and analyzes LLM calls through a proxy.

Open sourceSelf-hostHosted API

Hollama

Chat & assistant UIs

A minimal, self-hostable web UI for Ollama and OpenAI-compatible endpoints, with no database to run.

Open sourceSelf-host

Inngest

Workflow & automation

A durable workflow engine for developers, with event-driven steps, retries, and flow control as code.

Open sourceSelf-hostHosted API

Jan

Chat & assistant UIs

An open-source, offline-first desktop app for running AI models locally — a private ChatGPT alternative.

Open sourceSelf-host

Klavis AI

MCP & connectors

An open-source project for hosted, production-ready MCP servers with built-in authentication.

Open sourceSelf-hostHosted API

Kokoro

Voice & transcription

A small, open-weight text-to-speech model that produces natural voices on modest hardware.

Open weightSelf-host

LanceDB

Vector databases

An open-source, embedded vector database built on the Lance columnar format.

Open sourceSelf-hostHosted API

LangSmith

Observability & evals

LangChain's platform for tracing, testing, and evaluating LLM and agent applications.

ProprietaryHosted API

LibreChat

Chat & assistant UIs

An open-source ChatGPT-style interface that unifies many model providers behind one familiar, extensible UI.

Open sourceSelf-host

llama.cpp

Model serving

An open-source C/C++ runtime for running LLMs efficiently on CPUs and consumer GPUs.

Open sourceSelf-host

LlamaParse

Document extraction

A hosted parsing service tuned for extracting clean structure from complex, messy PDFs.

ProprietaryHosted API

LLMWare

RAG & knowledge

An open-source framework for enterprise RAG pipelines tuned around small, specialized models.

Open sourceSelf-host

LM Studio

Model serving

A desktop app for discovering, downloading, and running local models with a graphical UI.

ProprietarySelf-host

LobeChat

Chat & assistant UIs

A polished open-source chat UI with a plugin system, custom agents, and broad multi-model support.

Open sourceSelf-host

LocalAI

Model serving

An open-source, OpenAI-compatible API you can run locally over many model backends.

Open sourceSelf-host

Lunary

Observability & evals

An open-source observability and prompt-management platform for LLM applications.

Open sourceSelf-hostHosted API

Make

Workflow & automation

A visual automation platform for connecting apps into multi-step scenarios, with a more flexible canvas than Zapier.

ProprietaryHosted API

Marker

Document extraction

An open-source tool that converts PDFs, ePub, and more into clean Markdown quickly and accurately.

Open sourceSelf-hostHosted API

Mastra

Agent frameworks

A TypeScript framework for agents, workflows, and RAG, from the team behind Gatsby.

Open sourceSelf-host

mcp-use

MCP & connectors

An open-source client library for connecting any LLM to MCP servers in a few lines of code.

Open sourceSelf-host

Microsoft Azure

Hosting & infrastructure

Microsoft's cloud platform, with deep integration for OpenAI models and enterprise workloads.

ProprietaryHosted API

Milvus

Vector databases

An open-source vector database built for billion-scale similarity search.

Open sourceSelf-hostHosted API

MinerU

Document extraction

An open-source tool that extracts structured content from PDFs, preserving layout, tables, and formulas.

Open sourceSelf-host

Mistral (open models)

Open-weight models

Mistral's family of open-weight models, from small efficient ones to mixture-of-experts.

Open weightSelf-host

Mistral AI

LLM providers

A European AI lab offering frontier and efficient models through a developer API.

ProprietaryHosted API

Modal

Model serving

A serverless platform for running Python — including model inference — on cloud GPUs.

ProprietaryHosted API

Msty

Chat & assistant UIs

A desktop app for local and remote models, focused on a frictionless one-click setup.

ProprietarySelf-host

OLMo

Open-weight models

Allen AI's truly open language models, released with full data, code, and training logs.

Open weightSelf-host

OpenAI Agents SDK

Agent frameworks

OpenAI's lightweight framework for building agents with handoffs, guardrails, and built-in tracing.

Open sourceSelf-host

OpenLLMetry

Observability & evals

An open-source set of OpenTelemetry extensions for standardized LLM observability.

Open sourceSelf-host

OpenRouter

Gateways & routers

A hosted marketplace and router that exposes hundreds of models behind one API and one bill.

ProprietaryHosted API

Opik

Observability & evals

Comet's open-source platform for tracing, evaluating, and monitoring LLM applications.

Open sourceSelf-hostHosted API

PaddleOCR

Document extraction

A widely used open-source OCR toolkit supporting many languages and document layouts.

Open sourceSelf-host

Phi

Open-weight models

Microsoft's Phi family of small models trained for strong reasoning at low cost.

Open weightSelf-host

Phoenix

Observability & evals

Arize's open-source tool for tracing, evaluating, and debugging LLM and agent apps.

Source-availableSelf-host

Pinecone

Vector databases

A fully managed vector database that removes all operational work from similarity search.

ProprietaryHosted API

Pipedream

MCP & connectors

A connector platform with thousands of integrations, now exposing tools to agents over MCP.

ProprietaryHosted API

Piper

Voice & transcription

A fast, local open-source text-to-speech system designed to run well on small devices.

Open sourceSelf-host

Playwright MCP

Browser automation

An MCP server that exposes Playwright browser control to any MCP-aware model or agent.

Open sourceSelf-host

Portkey

Gateways & routers

An AI gateway pairing fast model routing with built-in observability, caching, and guardrails.

Open sourceSelf-hostHosted API

Prefect

Workflow & automation

A Python-native orchestration tool for building, running, and observing data and AI workflows.

Open sourceSelf-hostHosted API

PrivateGPT

RAG & knowledge

An open-source project for asking questions of your documents fully offline and private.

Open sourceSelf-hostHosted API

promptfoo

Observability & evals

An open-source tool for testing, evaluating, and red-teaming prompts and models.

Open sourceSelf-host

Puppeteer

Browser automation

A mature open-source library for driving headless Chrome and Firefox from Node.js.

Open sourceSelf-host

Pydantic AI

Agent frameworks

A type-safe Python agent framework from the Pydantic team, built around validated structured outputs.

Open sourceSelf-host

Qdrant

Vector databases

A fast open-source vector database with rich filtering, built for production retrieval.

Open sourceSelf-hostHosted API

Quivr

RAG & knowledge

An open-source RAG framework and "second brain" for chatting with your files and data.

Open sourceSelf-host

Qwen

Open-weight models

Alibaba's open-weight model family, spanning many sizes with strong multilingual coverage.

Open weightSelf-hostHosted API

R2R

RAG & knowledge

An open-source "RAG to riches" engine with ingestion, retrieval, and agentic search built in.

Open sourceSelf-hostHosted API

Ragas

Observability & evals

An open-source framework for evaluating RAG pipelines on faithfulness and relevance.

Open sourceSelf-host

RAGFlow

RAG & knowledge

An open-source RAG engine built on deep document understanding, designed to run as a complete app.

Open sourceSelf-host

Railway

Hosting & infrastructure

A developer platform for deploying apps, databases, and services with minimal configuration.

ProprietaryHosted API

Redis

Vector databases

Vector search inside Redis — similarity search alongside the cache you already run.

Source-availableSelf-hostHosted API

Reducto

Document extraction

A commercial document-ingestion API focused on high-accuracy parsing of complex, regulated documents.

ProprietaryHosted API

Render

Hosting & infrastructure

A managed cloud for deploying web services, static sites, background workers, and databases.

ProprietaryHosted API

Replicate

Model serving

A platform for running and fine-tuning open models behind a simple hosted API.

ProprietaryHosted API

Requesty

Gateways & routers

A routing layer that unifies many models with spend controls and automatic failover.

ProprietaryHosted API

Selenium

Browser automation

The long-established open-source standard for cross-browser automation and testing.

Open sourceSelf-host

Semantic Kernel

Agent frameworks

Microsoft's SDK for composing AI skills, plugins, and agents into enterprise applications.

Open sourceSelf-host

SGLang

Model serving

A fast open-source serving runtime with structured generation and high throughput.

Open sourceSelf-host

Smithery

MCP & connectors

A registry and hosting platform for discovering and deploying MCP servers.

ProprietaryHosted API

smolagents

Agent frameworks

Hugging Face's minimal agent library where agents act by writing and running Python code.

Open sourceSelf-host

SmolLM

Open-weight models

Hugging Face's fully open small-model family, released with open data and training recipes.

Open weightSelf-host

Stagehand

Browser automation

An open-source framework that adds natural-language actions on top of Playwright.

Open sourceSelf-host

Steel

Browser automation

An open-source browser API purpose-built for AI agents that need to use the web.

Open sourceSelf-hostHosted API

Supabase

Hosting & infrastructure

An open-source backend platform built on Postgres — database, auth, and storage in one.

Open sourceSelf-hostHosted API

Surya

Document extraction

An open-source OCR and layout-analysis toolkit covering text, tables, and reading order in many languages.

Open sourceSelf-host

Temporal

Workflow & automation

A durable execution engine that makes long-running, failure-prone workflows reliable by default.

Open sourceSelf-hostHosted API

Text Generation Inference

Model serving

Hugging Face's production server for high-performance LLM serving.

Open sourceSelf-host

Together AI

Model serving

A cloud for running and fine-tuning open models with fast, hosted inference.

ProprietaryHosted API

Trigger.dev

Workflow & automation

An open-source framework for long-running background jobs written as plain TypeScript code.

Source-availableSelf-hostHosted API

turbopuffer

Vector databases

A serverless vector and full-text search engine built on object storage for low cost.

ProprietaryHosted API

txtai

RAG & knowledge

An all-in-one open-source embeddings database for semantic search, RAG, and LLM workflows.

Open sourceSelf-host

TypingMind

Chat & assistant UIs

A commercial front-end that puts your own provider API keys behind one polished chat UI.

Proprietary

Vapi

Voice & transcription

A platform for building, testing, and deploying real-time voice agents over the phone.

ProprietaryHosted API

Verba

RAG & knowledge

Weaviate's open-source RAG application — a ready-to-run chatbot for your own documents.

Open sourceSelf-host

Vercel AI Gateway

Gateways & routers

Vercel's gateway for routing to many model providers through one endpoint and one bill.

ProprietaryHosted API

Vespa

Vector databases

An open-source engine for large-scale search, recommendation, and vector workloads.

Open sourceSelf-hostHosted API

vLLM

Model serving

A high-throughput inference engine for serving open models efficiently in production.

Open sourceSelf-host

Weaviate

Vector databases

An open-source vector database with hybrid search and built-in vectorization modules.

Open sourceSelf-hostHosted API

WhisperX

Voice & transcription

An open-source extension of Whisper adding accurate word-level timestamps and speaker diarization.

Open sourceSelf-host

Windmill

Workflow & automation

An open-source platform that turns scripts into workflows, internal UIs, and scheduled jobs.

Source-availableSelf-hostHosted API

xAI Grok

LLM providers

xAI's Grok family of frontier models, available through a developer API.

ProprietaryHosted API

Zapier

Workflow & automation

The most widely used hosted automation platform, connecting thousands of apps with no code.

ProprietaryHosted API