agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around Plumloom

AI evaluation platform for engineers and product managers building AI agents and LLM applications. Supports calibrated judges, multi-judge agreement, and statistical multi-run evaluations for live scenarios.

Visit plumloom.ai ↗

Explore the market

Prices and medians update for the tier you select.

Compare at
Plumloom · Pro
No Pro plan
—
Pro-provider median
—
insufficient comparable pricing
vs Pro providers
No comparison
Plumloom doesn't sell Pro
ⓘ Comparisons are same provider type (provider) and same buyer tier (Pro). Never across tiers.
Market density
54th pctile
159 competing vendors
Comparable listings · 30d
—
Platforms · Pro median
$35.79/mo
6 priced · $20.9–$48 mid 50%
Price spectrum · Pro plans · 7 of 10 providers priced · log scale · $19 → $79/mo
Platforms◻ shaded = middle 50% · line = median (all types)Plumloom has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches Plumloom's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

OOther10Ranked by similarity
Plumloomthis listing
● OTHER
no public price
Scorable MCP Server
● OTHER81% similar
no public price
AeroEval-SWE
● OTHER75% similar
no public price
tool-eval-bench
● OTHER74% similar
no public price
Agentevals Via Github
● OTHER73% similar
no public price
Decision Agent
● OTHER73% similar
no public price
Agentic Eval
● OTHER72% similar
no public price
Skillgrade
● OTHER72% similar
no public price
Agent-Eval-Pipeline
● OTHER72% similar
no public price
Navital Gym
● OTHER72% similar
no public price
FFrameworks7Ranked by similarity
Deepeval
● FRAMEWORK87% similar
no public price
Openjudge
● FRAMEWORK82% similar
no public price
Langwatch
● FRAMEWORK82% similar
no Pro plan
entry $33/mo
Niceeval
● FRAMEWORK74% similar
no public price
AgentFork
● FRAMEWORK73% similar
no public price
Understudy
● FRAMEWORK73% similar
no public price
SOV City
● FRAMEWORK72% similar
no public price
MMCP servers13Ranked by similarity
Llm Evaluation Agent
● MCP84% similar
no public price
Mentor
● MCP76% similar
no public price
toolroute - Intelligent Automated LLM Routing
● MCP75% similar
no public price
Autoeval
● MCP74% similar
no public price
FreeLLM-MCP
● MCP74% similar
no public price
WorldCore
● MCP73% similar
no public price
Xzar MCP
● MCP73% similar
no public price
EvalForge Lite
● MCP73% similar
no public price
Evalgate
● MCP72% similar
no public price
Overwing MCP
● MCP72% similar
no Pro plan
entry $29/mo
DE
Deepresearch Bench Ii
● MCP72% similar
no public price
Agent Analytics Eval
● MCP72% similar
no public price
Laya Jev MCP
● MCP72% similar
no public price
PPlatforms18Ranked by similarity
VA
Vasari
● PLATFORM84% similar
no public price
Comet Opik
● PLATFORM83% similar
$19/mo Pro
-47% vs Pro median
Parea Ai
● PLATFORM80% similar
no public price
Daishi Studio
● PLATFORM78% similar
$49/mo Pro
+37% vs Pro median
Agentsproof
● PLATFORM78% similar
$24.17/mo Pro
-32% vs Pro median
Orq.ai
● PLATFORM77% similar
no public price
Agentic Evaluation Platform
● PLATFORM76% similar
no public price
Tokenwise
● PLATFORM76% similar
$79/mo Pro
+121% vs Pro median
agent-evals
● PLATFORM75% similar
no public price
Langsmith
● PLATFORM75% similar
$39/mo Pro
+9% vs Pro median
Plainwright
● PLATFORM74% similar
no public price
Bottrade
● PLATFORM73% similar
$19.99/mo Pro
-44% vs Pro median
Matraix
● PLATFORM73% similar
no public price
Scorecard
● PLATFORM73% similar
no Pro plan
entry $299/mo
Mphora
● PLATFORM73% similar
no public price
Alcock Arena
● PLATFORM72% similar
no public price
Manifest
● PLATFORM72% similar
$19/mo Pro
-47% vs Pro median
Xonta Orchestrator
● PLATFORM72% similar
no public price
AAgents2Ranked by similarity
Multi-Judge Consensus
● AGENT79% similar
no public price
TALENS
● AGENT73% similar
no public price

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.