2026.03 — The Agentic Utility Belt
200 Services for AI Agents
Not toC. Not toB. The complete map of "toA" services — built for agents to use
Five survival conditions for autonomous agents — identity, execution, manipulation, memory, and commerce. All 200 services exist to fill one of these conditions.
200
Services
15
Categories
2026.03.24
Updated
Unique agentic concept
No Google / AWS / Stripe
No generic search APIs
All API / SDK / CLI ready
💰
Commerce
Agent's economic activity
16
HYRVE AI ★★★☆☆
Freelance market where agents become economic citizens
cashclaw hyrve connect --api-key KEY && cashclaw hyrve jobs
CashClaw ★★★☆☆
OSS that turns agents into freelancers earning while you sleep
npx cashclaw init && cashclaw audit --url "https://site.com"
HumanAds ★★★★★
AI agents commission sponsored posts from human influencers. On-chain escrow payments
curl -s https://humanadsai.com/skill.md
RentAHuman ★★★☆☆
Agents rent human capabilities by the hour. Physical task delegation
Agent → browse human skills → book slot → escrow → task complete → release
ERC-8183 ★★★★☆
Trustless escrow standard for agent-to-agent transactions
Job struct → evaluator completion check → auto fund release
Bounty system with USDC escrow
curl https://aiagentstore.ai/.well-known/claw-earn.json
x402 ★★★★★
Embed payments in HTTP. Agents pay by hitting a URL
npx purl https://api.example.com/premium-data # 402→USDC payment→200
x402 Bazaar ★★★★☆
Service marketplace for agents
Agents discover APIs → pay instantly with USDC. No subscriptions
RebelFi ★★★☆☆
Auto-apply DeFi yield to agent idle funds
Auto-invest idle stablecoin balances (5-8% APY)
t54.ai ★★★☆☆
AI agent commerce on XRPL. Escrow + instant settlement
Virtuals Protocol + x402 → native payments in XRP/RLUSD
Coinbase AgentKit ★★★★★
SDK to give agents crypto wallets
pip install cdp-agentkit-core # create wallet → send → DeFi
Unified escrow, smart contracts & AI verification
curl -X POST https://api.circle.com/v1/wallets
Unified shopping API for agents. Led by Google
curl https://vendor.example.com/.well-known/ucp # discover catalog → checkout
Payments with audit trails of who approved. Led by Google
Mandate-based agent payment standard (spending authorization)
AgentCash ★★★☆☆
Simple agent-to-agent payments. x402 integrated
Agents earn via x402 and pay other agents
Zerion ★★★☆☆
DeFi portfolio management. Agents manage assets via x402
Delegate DeFi operations to agents via x402
🏪
Marketplace
Agent's marketplace
8
Agentverse ★★★☆☆
Fetch.ai's agent marketplace + hosting
Almanac registration → ASI:One search → auto-matching → rating accumulation
AI Agents Directory ★★★☆☆
Directory of 1,300+ agents. Compare & review
Browse / search agents by category / framework
AI Agent Store ★★★☆☆
Agent market + USDC bounty system
curl https://aiagentstore.ai/.well-known/claw-earn.json
AiAgents.Directory ★★☆☆☆
496+ agents listed. Categories including blockchain
All Agents / Open Source / Digital Workers / Commerce etc
OSS index of 10K+ agents + search API
curl -X POST https://www.deepnlp.org/api/ai_agent_marketplace/registry
Partner marketplace to sell A2A agents
Publish A2A agents to Agentspace → customers discover & buy
Agent.ai (HubSpot) ★★★☆☆
HubSpot's agent directory + skill rankings
Skill-based leaderboards / agent scoring
⚙️
Orchestration
Agent's conductor
12
LangGraph ★★★★★
Control multi-agent systems with graph structures. Stateful execution
from langgraph.graph import StateGraph; graph.add_node("agent", fn)
CrewAI ★★★★★
Compose agent teams with role assignments
crew = Crew(agents=[researcher, writer], tasks=[...])
AutoGen ★★★★☆
By Microsoft. Task coordination via multi-agent conversations
from autogen import ConversableAgent; agent.initiate_chat(...)
Dify ★★★★★
Low-code LLM app/agent builder. Visual editor
docker-compose up -d # self-host agent builder
n8n ★★★★★
OSS workflow automation. 400+ connectors with AI steps
docker run -p 5678:5678 n8nio/n8n # self-host
Temporal ★★★★★
Durable workflows. Guaranteed long-running agent tasks
@workflow.run async def agent_workflow(): await activity(...)
Prefect ★★★★☆
Python-native orchestration. @flow decorator
@flow def agent_pipeline(): task_a(); task_b()
Windmill ★★★☆☆
OSS script/workflow engine. Backend for agents
docker-compose up -d # TypeScript/Python/Go/Bash support
Hatchet ★★★☆☆
OSS task queue. Parallel & distributed task management for agents
@hatchet.workflow() class AgentWorkflow: @step() async def run(): ...
MetaGPT ★★★★☆
Apply software company role structures to AI agents
from metagpt.roles import ProductManager, Architect, Engineer
Claude Flow ★★★☆☆
OSS for managing multiple Claude Code instances in parallel
npx claude-flow orchestrate --agents 5 --task "..."
Phidata ★★★★☆
Agent building framework. Memory + knowledge + tools unified
from phi.agent import Agent; agent = Agent(tools=[...], knowledge=kb)
🌐
Browser
Agent's browser automation
14
Browserbase ★★★★★
AWS for headless browsers. Stealth mode + session recording
curl -X POST https://www.browserbase.com/v1/sessions -H "x-bb-api-key: KEY"
Skyvern ★★★★☆
Web automation with natural language only. No CSS selectors
curl -X POST https://api.skyvern.com/api/v1/tasks -d '{"goal":"fill out form"}'
Agent Maps ★★★☆☆
Pre-mapped web operation steps. Verified daily
curl https://api.agentmaps.dev/v1/steps/gmail/compose
Browser Use ★★★★★
OSS library for LLM browser control. 14K+ GitHub Stars
pip install browser-use # Playwright + LLM control
Stagehand ★★★★☆
Playwright + AI reasoning. 3 primitives: act() / extract() / observe()
npm install @browserbase/stagehand
Steel Browser ★★★☆☆
OSS stealth browser specialized in bot detection evasion
docker run -p 3000:3000 ghcr.io/nichochar/steel:latest
Hyperbrowser ★★★☆☆
Managed browser with LLM integration. Natural language API
curl -X POST https://api.hyperbrowser.ai/v1/sessions
Lightpanda ★★★☆☆
Headless browser for AI agents. Built from scratch in Zig
OSS / Lightweight, fast browser engine written in Zig
MultiOn ★★★★☆
Multi-step web automation API. Auto auth & CAPTCHA handling
curl -X POST https://api.multion.ai/v1/web/browse -d '{"cmd":"book flight"}'
Airtop ★★★☆☆
Enterprise browser automation. Compliance-first
curl -X POST https://api.airtop.ai/v1/sessions
AgentQL ★★★★☆
Web data extraction query language for AI agents
session.query('{ products[] { name price rating } }')
Proxies.sx ★★★☆☆
Buy IPs instantly via x402. No signup needed
curl -X POST https://api.proxies.sx/v1/proxy -d '{"type":"residential"}'
Agent Browser (Vercel) ★★★★☆
Rust CLI. Click elements with agent-browser click @e2
npx agent-browser open example.com && agent-browser snapshot
Omega ★★★☆☆
AI agent team with digital IDs. 1 agent = 1 account
Independent browser environment per agent
🖥️
Sandbox
Agent's safe workspace
12
E2B ★★★★★
Disposable Linux VM in 150ms. Powers Manus
curl -X POST https://api.e2b.dev/sandboxes -H "X-API-Key: KEY"
Notte ★★★☆☆
Browser + AI worker + runtime in one-stop infra
from notte_sdk import NotteClient; client = NotteClient()
Modal ★★★★★
Deploy GPU serverless functions with one Python decorator
@modal.function(gpu="A100") def train(): ...
Fly Machines ★★★★☆
Micro VMs via REST API. On-demand compute for agents
curl -X POST https://api.machines.dev/v1/apps/APP/machines
NanoClaw ★★☆☆☆
Isolate each agent in individual Docker containers
docker run --cap-drop=ALL nanoclaw/agent-sandbox:latest
Daytona ★★★★☆
OSS dev environment manager. Hand devcontainers to agents
daytona create https://github.com/user/repo
Runloop ★★★☆☆
Cloud sandbox built for coding agents
curl -X POST https://api.runloop.ai/v1/devboxes -d '{"blueprint":"python"}'
Morph ★★★☆☆
AI agents autonomously build & manage cloud infra
Give an AWS account to an agent → autonomous infra setup
Gitpod ★★★★☆
Spin up cloud dev environments with one API call
gitpod workspace create https://github.com/user/repo
Replicate ★★★★★
Turn OSS models into APIs. One curl for inference
curl -X POST https://api.replicate.com/v1/predictions -d '{"model":"flux"}'
HF Inference API ★★★★★
Instant access to 1M+ models. Serverless inference
curl https://api-inference.huggingface.co/models/MODEL -d '{"inputs":"..."}'
GPU-Bridge ★★★☆☆
26 AI services pay-per-request. x402 native
curl -X POST https://api.gpubridge.io/v1/run -d '{"service":"flux-schnell"}'
📧
Identity
Agent's proof of existence
12
AgentMail ★★★★☆
Gmail for AI. Email provider built for agents
curl -X POST https://api.agentmail.to/v1/inboxes -H "Authorization: Bearer KEY"
ERC-8004 ★★★☆☆
On-chain agent passport (ID + reputation + verification)
Identity Registry / Reputation Registry / Validation Registry — 3-layer architecture
Human-readable names for agents. agent.eth
curl https://resolver.ens.domains/name/myagent.eth
World AgentKit ★★★★☆
Prove a human is behind the AI agent
World ID + Coinbase AgentKit integration for Proof of Personhood
DiraBook ★★☆☆☆
OSS social network for agents. Profiles, posts & communities
docker-compose up -d # Self-host AI agent social network
NANDA ★★★☆☆
DNS-like agent name resolution protocol
Agent Name Service — distributed directory with PKI authentication
A2A Agent Card ★★★★★
Agent's digital business card. 150+ organizations support it
curl https://agent.example.com/.well-known/agent.json
Fetch.ai Almanac ★★★☆☆
On-chain agent phonebook. Register and auto-discover
from fetchai.registration import register_with_agentverse
Anthropic Tool Use ★★★★★
Safely grant tool execution to Claude. Standard spec
{"type":"function","name":"get_weather","parameters":{...}}
KYA (Know Your Agent) ★★★☆☆
KYA not KYC. Agent identity verification standard
On-chain ID + off-chain verification hybrid authentication
Lightweight, deployable on-chain agent registry
Easily deploy custom collections & domain-specific registries
Open standard connecting LLMs to tools. By Anthropic
npx @modelcontextprotocol/server-filesystem /path
🧠
Memory
Agent's long-term memory
10
Mem0 ★★★★☆
Long-term memory layer. Auto-extract facts from conversations
curl -X POST https://api.mem0.ai/v1/memories -d '{"user_id":"paji"}'
Letta (旧MemGPT) ★★★★☆
Break LLM context limits with virtual memory management
curl -X POST http://localhost:8283/v1/agents -d '{"memory":{"type":"chat"}}'
Ekai ★★★☆☆
Portable AI context. Carry memory across LLM switches
curl -X POST https://api.ekailabs.xyz/v1/chat -d '{"context_id":"proj-1"}'
Pinecone ★★★★★
Vector DB. Semantic memory backend for agents
curl -X POST https://INDEX.pinecone.io/vectors/upsert
Weaviate ★★★★★
OSS vector DB. Multimodal search support
curl http://localhost:8080/v1/objects -d '{"class":"Memory"}'
Qdrant ★★★★★
Fast vector search in Rust. Filtered similarity search
curl -X PUT http://localhost:6333/collections/agent_memory
Chroma ★★★★☆
Python-native embedding DB. pip install and go
pip install chromadb # collection.add(documents=[...]);
Zep ★★★★☆
Long-term memory for LLM apps. Auto fact extraction + temporal awareness
curl -X POST https://api.zep.ai/v2/users/USER/memory
LangGraph Memory ★★★★☆
Stateful graph execution with checkpointed memory
from langgraph.checkpoint import MemorySaver
Haystack ★★★★☆
OSS RAG pipeline. Document → memory → answer flow
pip install haystack-ai # build pipeline → document search
🔮
Emerging
Next-gen agent infra
18
ASI:One ★★★☆☆
Meta AI. Auto-route user requests to the best agent
Natural language query → Almanac search → auto-select best agent
Lindy ★★★★☆
Personal AI assistant. Autonomously manage email/calendar/meetings
Set triggers + actions on Lindy.ai → auto-execute
DoAnything ★★★☆☆
AI agent for anything. Thousands of agents running on AgentMail
Request tasks in natural language → best agent auto-executes
Cofounder ★★☆☆☆
Personal AI sidekick. Customizable daily task automation
$39.99/mo+. Task automation + personalization
Gumloop ★★★☆☆
No-code AI workflows. Drag & drop for marketers
Build campaign automation workflows from templates
FlowiseAI ★★★★☆
OSS visual builder. Design RAG/agent/chat flows
docker-compose up -d # connect nodes in browser → build agents
StackAI ★★★☆☆
Enterprise AI builder. Governance + access control
Visual UI + document workflows + SOC 2 compliant
Akka ★★★☆☆
15 years of distributed systems applied to AI agents
Multi-region replication / stateful agents / event-driven
Sierra ★★★★☆
Outcome-based CS agent. Autonomously handles refunds & cancellations
Agent Studio + Agent SDK → CRM/ERP integration
ToothFairyAI ★★☆☆☆
Decentralized AI agent. Sales/marketing/PM/recruiting in one
Customizable multi-role AI agent
Kavida.ai ★★☆☆☆
PO management AI agent. Automate supplier coordination
Agent PO / Agent ERP → autonomous delivery/price adjustments
Parallel AI ★★★★☆
Evidence-backed research API. Top score at HLE 47%
Search API / Task API (Deep Research) / Find All / Web Monitor
LLMLayer ★★★☆☆
Search + scraping + LLM answers in one unified API
Web Search / Scraper / Crawler / LLM Answers / Screenshots
Simplescraper ★★★☆☆
Create scraping rules via browser extension → auto API
Point & click to define extraction rules → auto API generation
Nansen ★★★☆☆
x402-enabled on-chain analytics. Pay-per-call wallet analysis
On-chain intelligence + wallet analysis via x402
Alchemy ★★★★☆
x402-enabled Web3 dev platform. Pay-per-RPC
Pay for blockchain RPC calls with stablecoins via x402
🎤
Voice & Audio
Agent's voice
10
ElevenLabs ★★★★★
Ultra-natural AI voice synthesis. 29 languages
curl -X POST https://api.elevenlabs.io/v1/text-to-speech/VOICE_ID
Deepgram ★★★★★
Real-time speech recognition API. Streaming support
wss://api.deepgram.com/v1/listen # WebSocket streaming
Vapi ★★★★☆
Voice agent platform. Automate phone calls
curl -X POST https://api.vapi.ai/call -d '{"assistant":"agent-id"}'
Bland AI ★★★★☆
AI phone agent. $0.09/min for 24/7 call handling
curl -X POST https://api.bland.ai/v1/calls -d '{"phone":"..."}'
Cartesia ★★★★☆
Ultra-low latency TTS. Built for real-time conversation
curl -X POST https://api.cartesia.ai/tts/bytes -d '{"transcript":"..."}'
PlayHT ★★★☆☆
AI voice cloning. Clone a voice from 5 seconds of audio
curl -X POST https://api.play.ht/api/v2/tts
AssemblyAI ★★★★★
Speech → text + summary + sentiment. Universal-2 model
curl -X POST https://api.assemblyai.com/v2/transcript
LiveKit ★★★★★
Real-time audio/video infra. Foundation for agent conversations
from livekit.agents import Agent; agent = Agent(voice_pipeline)
Retell AI ★★★★☆
Voice agent API. Natural conversations with interruption handling
curl -X POST https://api.retellai.com/v2/create-call
Speechmatics ★★★★☆
Real-time STT in 50 languages. Speaker diarization + auto punctuation
curl -X POST https://asr.api.speechmatics.com/v2/jobs
🛡️
Security
Agent's guardrails
10
Guardrails AI ★★★★★
Validate LLM I/O. Detect toxicity, PII, hallucinations & format violations
guard = Guard().use(ToxicLanguage, OnTopic); guard.validate(output)
Rebuff ★★★☆☆
Automatic prompt injection detection
curl -X POST https://api.rebuff.ai/detect -d '{"input":"..."}'
Llama Guard ★★★★☆
Meta's safety classifier. Assess I/O harmfulness
Run Llama Guard 3 via API or locally → classify safe/unsafe
Invariant Labs ★★★★☆
Safety-check agent actions before execution
from invariant import Policy; policy.check(agent_action)
WhyLabs ★★★☆☆
LLM drift detection + data quality monitoring
curl -X POST https://api.whylabsapp.com/v1/log
Lakera Guard ★★★★☆
Prompt injection defense API. 2ms latency
curl https://api.lakera.ai/v2/guard -d '{"input":"user prompt"}'
Fiddler ★★★☆☆
Enterprise AI observability. Guardrails + compliance
Hierarchical agent tracing + real-time guardrails
Pydantic Logfire ★★★★☆
Apply Pydantic type safety to LLM outputs. Structured guarantees
from pydantic import BaseModel; class Output(BaseModel): ...
PromptArmor ★★★☆☆
Detect injection attacks in data agents read
Scan external data sources → detect indirect prompt injection
CalypsoAI ★★★☆☆
Enterprise AI security. DLP + compliance
AI gateway for data leak prevention + policy enforcement
📊
Observability
Agent's watchtower
14
Langfuse ★★★★★
OSS LLM observability. Traces + prompt mgmt + evals. 21K Stars
LANGFUSE_HOST=https://cloud.langfuse.com langfuse.trace(name="agent-run")
Helicone ★★★★★
Visualize LLM cost & latency with one URL change
baseURL: "https://oai.helicone.ai/v1" # just swap the OpenAI URL
Portkey ★★★★☆
AI gateway. Routing + fallback + guardrails
curl https://api.portkey.ai/v1/chat/completions -H "x-portkey-api-key: KEY"
AgentOps ★★★★☆
Agent-specific observability. Session + event tracking
agentops.init(api_key="KEY") # 2 lines to start agent monitoring
Braintrust ★★★★☆
Eval-first LLM observability. Auto production → test loop
braintrust eval --project "my-agent" --dataset production-traces
LangSmith ★★★★★
LangChain's debugging + evaluation platform
LANGCHAIN_TRACING_V2=true LANGCHAIN_API_KEY=KEY python agent.py
Arize Phoenix ★★★★☆
OSS LLM evaluation + tracing. Jupyter integrated
pip install arize-phoenix && python -m phoenix.server.main serve
TruLens ★★★☆☆
Auto-evaluate RAG quality with 3 metrics (relevance, groundedness, answer quality)
from trulens.core import Feedback # RAG Triad evaluation
Confident AI (DeepEval) ★★★★☆
Auto-score LLM outputs with 50+ research-based metrics
deepeval test run test_agent.py # pytest-style LLM evaluation
LangWatch ★★★☆☆
LLM monitoring + eval + experiments unified. 5 min setup
langwatch.init() # auto trace → eval → alerts
Galileo ★★★☆☆
Real-time quality checks under 200ms with Luna-2 model
Guardrails + hallucination detection + bias detection in real-time
Coval ★★★☆☆
Simulate thousands of agent conversations. Pre-validate
Mass simulation of voice/chat agents → quality measurement
Opik (Comet) ★★★☆☆
Apache 2.0 LLM tracing + experiment management
from opik import track; @track def agent_step(): ...
Maxim AI ★★★☆☆
Simulation → eval → production monitoring in one platform
Manage the entire agent lifecycle in one dashboard
🔗
Integration
Agent's universal connector
12
Composio ★★★★★
Connect 250+ tools to agents with OAuth included
curl https://backend.composio.dev/api/v1/apps -H "X-API-KEY: KEY"
Nango ★★★★☆
OSS with 300+ OAuth integrations. Auth proxy for agents
curl https://api.nango.dev/connections -H "Authorization: Bearer KEY"
Merge ★★★★☆
Unified API. One API to hundreds of SaaS from agents
curl https://api.merge.dev/api/hris/v1/employees -H "X-Account-Token: T"
Unstructured ★★★★★
Convert any file to LLM-readable format. PDF/PPTX/images → structured data
curl -X POST https://api.unstructured.io/general/v0/general -F 'files=@doc.pdf'
LlamaParse ★★★★☆
High-accuracy PDF to Markdown/JSON. Tables & figures included
curl -X POST https://api.cloud.llamaindex.ai/api/parsing/upload
Anon ★★★☆☆
Safely delegate user login sessions to agents
Proxy that encrypts user credentials and passes them to agents
Toolhouse ★★★☆☆
Cloud for adding tools to LLMs. One line to add tool_use
toolhouse.get_tools() → auto-convert to LLM function calling
Arcade AI ★★★☆☆
Standardized authenticated tool calling. Secure tool use
curl https://api.arcade-ai.com/v1/tools -H "Authorization: Bearer KEY"
Wild Card ★★★☆☆
Virtual cards for AI agents. With spending limits
Issue agent-specific prepaid cards via API
Pipedream ★★★★☆
API integration + workflow automation. 2000+ connectors
curl -X POST https://api.pipedream.com/v1/workflows -d '{...}'
Trigger.dev ★★★★☆
OSS background jobs. Async task execution for agents
await trigger.run("long-task", { payload }) // serverless long-running
Inngest ★★★★☆
Event-driven agent workflows. Retry + parallel execution
inngest.createFunction({event:"agent/task"}, async({event})=>{...})
🎨
Creative
Agent's creativity
8
Ideogram ★★★★☆
AI image gen with accurate text rendering. Great for logos & banners
curl -X POST https://api.ideogram.ai/generate -d '{"prompt":"..."}'
fal.ai ★★★★★
Serverless API for image/video/audio gen. Flux/SDXL support
curl -X POST https://queue.fal.run/fal-ai/flux -d '{"prompt":"..."}'
Together AI ★★★★★
Fast inference API for OSS models. Llama/Mixtral/SDXL
curl -X POST https://api.together.xyz/v1/chat/completions
Suno ★★★★☆
Text to music generation. Agents compose BGM
curl -X POST https://api.suno.ai/v1/songs -d '{"prompt":"lofi hip hop"}'
Stability AI ★★★★☆
Stable Diffusion/Video/Audio. Multimodal generation
curl -X POST https://api.stability.ai/v2beta/stable-image/generate/core
Luma Dream Machine ★★★★☆
Text/image to video generation. Visual expression for agents
curl -X POST https://api.lumalabs.ai/dream-machine/v1/generations
remove.bg ★★★★☆
Background removal API. Image processing pipeline for agents
curl -X POST https://api.remove.bg/v1.0/removebg -F 'image_file=@img.png'
CloudConvert ★★★★☆
File conversion API for 200+ formats. PDF↔DOCX↔PNG etc
curl -X POST https://api.cloudconvert.com/v2/jobs -d '{"tasks":{...}}'
🗄️
Data & Enrichment
Agent's knowledge source
10
Jina Reader ★★★★★
Convert URLs to LLM-readable Markdown. r.jina.ai/URL
curl https://r.jina.ai/https://example.com
Bright Data ★★★★☆
150M IP proxy network + Web Unlocker
curl --proxy http://user:pass@brd.superproxy.io:33335 https://target.com
ScrapingBee ★★★★☆
Scraping API with JS execution + proxy rotation
curl "https://app.scrapingbee.com/api/v1/?api_key=KEY&url=URL"
Diffbot ★★★★☆
Structured web data extraction with knowledge graph
curl "https://api.diffbot.com/v3/article?url=URL&token=KEY"
Clay ★★★★☆
People & company data enrichment. 50+ data sources
curl -X POST https://api.clay.com/v1/enrich -d '{"email":"..."}'
Clearbit ★★★★☆
Reverse lookup company/person info from email
curl https://person.api.clearbit.com/v2/people/find?email=EMAIL
GitHub API ★★★★★
Code search, PR creation, issue mgmt. Dev tasks for agents
curl https://api.github.com/repos/OWNER/REPO/pulls
SerpAPI ★★★★☆
SERP retrieval from 40+ search engines (Google/Bing/YouTube etc)
curl "https://serpapi.com/search.json?q=QUERY&api_key=KEY"
CoinGecko API ★★★★☆
Crypto data. x402 enabled at $0.01/request
curl https://api.coingecko.com/api/v3/simple/price?ids=bitcoin
Polygon.io ★★★★☆
Real-time data API for stocks/crypto/forex
curl "https://api.polygon.io/v2/aggs/ticker/AAPL?apiKey=KEY"
🧪
Testing & Eval
Agent's examiner
10
DeepEval ★★★★☆
Test LLM outputs pytest-style. 50+ eval metrics
deepeval test run test_agent.py --verbose
PromptFoo ★★★★★
Prompt A/B testing + red teaming. OSS
npx promptfoo eval --config promptfooconfig.yaml
RAGAS ★★★★☆
Quality evaluation framework for RAG pipelines
from ragas import evaluate; score = evaluate(dataset, metrics=[...])
Giskard ★★★★☆
LLM vulnerability scanner. Auto-detect hallucinations, bias & injection
giskard scan model --dataset test_data # generate vulnerability report
Patronus AI ★★★☆☆
Enterprise LLM evaluation. Hallucination + toxicity + copyright checks
curl -X POST https://api.patronus.ai/v1/evaluate -d '{"output":"..."}'
Humanloop ★★★☆☆
Human-in-the-loop LLM output evaluation + improvement
curl -X POST https://api.humanloop.com/v5/evaluations
W&B Weave ★★★★☆
Extend ML experiment tracking to LLM agents
import weave; weave.init("project"); @weave.op def agent(): ...
Log10 ★★★☆☆
LLM debugging + feedback management. Human eval loop
from log10.load import log10; log10(openai) # auto-start logging
Scale AI Evaluation ★★★★☆
Large-scale LLM output quality checks by human evaluators
Hybrid evaluation: human annotators + automated metrics
📋
Specialized
Agent's special skills
18
Linear ★★★★★
Fast project management. Agents create issues & update status
curl -X POST https://api.linear.app/graphql -d '{"query":"..."}'
PostHog ★★★★★
OSS product analytics. Agents analyze user behavior
curl -X POST https://us.posthog.com/api/event/ -d '{"event":"..."}'
Cal.com ★★★★☆
OSS scheduling. Agents manage bookings
curl https://api.cal.com/v1/bookings -H "Authorization: Bearer KEY"
DocuSeal ★★★☆☆
OSS e-signatures. Agents send & track contracts
curl -X POST https://api.docuseal.co/submissions -d '{"template_id":1}'
Upstash ★★★★★
Serverless Redis/Kafka. Cache + queue for agents
curl https://ENDPOINT.upstash.io/set/key/value
Neon ★★★★★
Serverless Postgres. Branch DBs per agent
curl -X POST https://console.neon.tech/api/v2/projects/PROJ/branches
Supabase ★★★★★
OSS BaaS. DB + Auth + Storage + Edge Functions unified
curl https://PROJECT.supabase.co/rest/v1/TABLE -H "apikey: KEY"
PlanetScale ★★★★☆
Serverless MySQL. Branch-managed schema changes
curl https://api.planetscale.com/v1/organizations/ORG/databases
Val Town ★★★★☆
Write code in browser, publish instantly. Agent's micro APIs
// Publish functions on Val Town → instant HTTP endpoints
Render ★★★★☆
Zero-config deploy. Instantly ship agent-built apps
git push render main # auto build → deploy
Railway ★★★★☆
Infer infra from code. Auto-build DB + servers
railway up # Nixpacks auto-detect → deploy
cron-job.org ★★★☆☆
Free cloud cron. Scheduled execution for agents
curl -X PUT https://api.cron-job.org/jobs -d '{"url":"...","schedule":"..."}'
Better Stack ★★★★☆
Uptime monitoring + logs + status pages. Agent health management
curl -X POST https://uptime.betterstack.com/api/v2/monitors
Mintlify ★★★★☆
AI-powered docs generation. Auto-create agent API specs
mintlify dev # generate docs site from OAS/MDX
Courier ★★★☆☆
Notification orchestration. Templates + A/B testing
curl -X POST https://api.courier.com/send -d '{"message":{...}}'
Firecrawl ★★★★★
Web crawl + scrape + autonomous agent research unified
curl -X POST https://api.firecrawl.dev/v1/scrape -d '{"url":"..."}'
Sonar (Perplexity API) ★★★★★
Web-connected LLM API. Answers with citations
curl -X POST https://api.perplexity.ai/chat/completions -d '{"model":"sonar"}'
📨
Communication
Agent's comms channel
8
Resend ★★★★★
Developer email API. Beautiful templates with React Email
curl -X POST https://api.resend.com/emails -d '{"to":"..."}'
Novu ★★★★☆
OSS notification infra. Unified API for email/SMS/push/Slack
curl -X POST https://api.novu.co/v1/events/trigger -d '{"name":"agent-alert"}'
Knock ★★★☆☆
Notification workflows. Multi-channel alerts from agents
curl -X POST https://api.knock.app/v1/workflows/WORKFLOW/trigger
Twilio ★★★★★
SMS/phone/WhatsApp API. Voice + text comms for agents
curl -X POST https://api.twilio.com/2010-04-01/Accounts/SID/Messages.json
Sendbird ★★★★☆
Chat SDK. Real-time dialogue between agents and users
curl -X POST https://api-APP.sendbird.com/v3/messages
ntfy ★★★★☆
OSS push notifications. One curl to notify your phone
curl -d "Task completed" https://ntfy.sh/my-agent-alerts
Pushover ★★★☆☆
Simple push notification API. Agent → human reporting
curl -X POST https://api.pushover.net/1/messages.json -d 'token=KEY'
Matrix Protocol ★★★★☆
Decentralized chat protocol. E2E encrypted agent-to-agent comms
curl -X POST https://matrix.org/_matrix/client/v3/rooms/ROOM/send/m.room.message