agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around agent-evals

Open-source evaluation harness for AI agents. Define YAML task suites, run agents through pluggable runners and tool loops, score outputs, capture traces, compare runs, and track regressions.

Visit github.com ↗Pricing page ↗

Explore the market

Prices and medians update for the tier you select.

Compare at
agent-evals · Pro
No Pro plan
—
Pro-platform median
$47
across 6 priced platforms
vs Pro platforms
No comparison
agent-evals doesn't sell Pro
ⓘ Comparisons are same provider type (platform) and same buyer tier (Pro). Never across tiers.
Market density
83rd pctile
622 competing vendors
Comparable listings · 30d
—
Platforms · Pro median
$47/mo
6 priced · $31.19–$71.5 mid 50%
Price spectrum · Pro plans · 9 of 11 providers priced · log scale · $5 → $208/mo
MCP servers APIs Platforms◻ shaded = middle 50% · line = median (all types)agent-evals has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches agent-evals's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

PPlatforms18Ranked by similarity
agent-evalsthis listing
● PLATFORM
no public price
Agentsproof
● PLATFORM87% similar
$24.17/mo Pro
-49% vs Pro median
Agent Eval Harness
● PLATFORM85% similar
no public price
Daishi Studio
● PLATFORM84% similar
$49/mo Pro
+4% vs Pro median
Agentic Evaluation Platform
● PLATFORM82% similar
no public price
Etna
● PLATFORM81% similar
$208/mo Pro
+341% vs Pro median
AgentLasso
● PLATFORM81% similar
$79/mo Pro
+68% vs Pro median
Pome
● PLATFORM80% similar
no public price
Litefuse
● PLATFORM79% similar
$199/mo Pro
+323% vs Pro median
Ctf Agent Benchmark
● PLATFORM79% similar
no public price
Lantern
● PLATFORM78% similar
no public price
BotGauge
● PLATFORM78% similar
no public price
Veridrome
● PLATFORM77% similar
no public price
Bottrade
● PLATFORM77% similar
$19.99/mo Pro
-57% vs Pro median
ContextIQ
● PLATFORM77% similar
$5/mo Pro
-89% vs Pro median
LIFE FORGE
● PLATFORM77% similar
no public price
VA
Vasari
● PLATFORM76% similar
no public price
Plainwright
● PLATFORM76% similar
no public price
OOther15Ranked by similarity
Agentevals Via Github
● OTHER87% similar
no public price
16agents
● OTHER82% similar
no public price
EMO-X
● OTHER81% similar
no public price
aws-bench
● OTHER80% similar
no public price
Agentic Eval
● OTHER80% similar
no public price
Clawbench
● OTHER80% similar
no public price
Model Evaluation
● OTHER80% similar
no public price
Skillgrade
● OTHER79% similar
no public price
Eval Skills
● OTHER79% similar
no public price
agentcheck
● OTHER78% similar
no public price
Kalytera
● OTHER78% similar
no Pro plan
entry $49/mo
AI Deploy Bench
● OTHER77% similar
no public price
Fusion First
● OTHER77% similar
no public price
Agency
● OTHER77% similar
no public price
Harness Lab
● OTHER77% similar
no public price
FFrameworks10Ranked by similarity
Niceeval
● FRAMEWORK86% similar
no public price
GEAR
● FRAMEWORK85% similar
no public price
Agentspec
● FRAMEWORK81% similar
no public price
Beagle
● FRAMEWORK81% similar
no public price
Evalmonkey
● FRAMEWORK81% similar
no public price
Bound
● FRAMEWORK79% similar
no public price
Understudy
● FRAMEWORK79% similar
no public price
Langwatch
● FRAMEWORK78% similar
no Pro plan
entry $33/mo
do-harness
● FRAMEWORK77% similar
no public price
Agentbench
● FRAMEWORK76% similar
no public price
MMCP servers6Ranked by similarity
Evalgate
● MCP80% similar
no public price
ALPNAI
● MCP79% similar
$19/mo Pro
cold-run
● MCP78% similar
no public price
Iris
● MCP77% similar
no public price
SideEye
● MCP77% similar
no public price
TestLens
● MCP76% similar
no public price
AAPIs1Ranked by similarity
Agent Observability
● API77% similar
$50/mo Pro

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.