agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around tool-eval-bench

Open-source benchmark for evaluating LLM tool-calling in agentic workflows across OpenAI-compatible serving endpoints, with deterministic scenarios, conversation traces, structured-output checks, and optional performance tests.

Visit github.com ↗Pricing page ↗

Explore the market

Prices and medians update for the tier you select.

Compare at
tool-eval-bench · Pro
No Pro plan
—
Pro-provider median
—
insufficient comparable pricing
vs Pro providers
No comparison
tool-eval-bench doesn't sell Pro
ⓘ Comparisons are same provider type (provider) and same buyer tier (Pro). Never across tiers.
Market density
55th pctile
145 competing vendors
Comparable listings · 30d
—
Price spectrum · Pro plans · 4 of 6 providers priced · log scale · $19 → $150/mo
Agents APIs Platforms◻ shaded = middle 50% · line = median (all types)tool-eval-bench has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches tool-eval-bench's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

OOther7Ranked by similarity
tool-eval-benchthis listing
● OTHER
no public price
Phronesis
● OTHER78% similar
no public price
benchmark-sycophancy
● OTHER77% similar
no public price
Contextspy
● OTHER74% similar
no public price
MA-Trace
● OTHER74% similar
no public price
Cost-Tree
● OTHER73% similar
no public price
canact
● OTHER72% similar
no public price
FFrameworks18Ranked by similarity
Deepeval
● FRAMEWORK80% similar
no public price
AgentFork
● FRAMEWORK80% similar
no public price
Openai Agents
● FRAMEWORK78% similar
no public price
Alphatrion
● FRAMEWORK76% similar
no public price
Langwatch
● FRAMEWORK75% similar
no Pro plan
entry $32/mo
ToolForm
● FRAMEWORK75% similar
no public price
EV
EvoAgentX
● FRAMEWORK75% similar
no public price
TrueForge
● FRAMEWORK74% similar
no public price
Rightnow Auto
● FRAMEWORK74% similar
no public price
Openjudge
● FRAMEWORK74% similar
no public price
Giulia
● FRAMEWORK74% similar
no public price
CognitiveAgent Lab
● FRAMEWORK74% similar
no public price
Sema Lang
● FRAMEWORK73% similar
no public price
Barbacane
● FRAMEWORK73% similar
no public price
Rllm
● FRAMEWORK72% similar
no public price
Orion Os
● FRAMEWORK72% similar
no public price
Microsoft Autogen
● FRAMEWORK72% similar
no public price
paired-eval
● FRAMEWORK72% similar
no public price
PPlatforms12Ranked by similarity
AcruxCore
● PLATFORM77% similar
no public price
Comet Opik
● PLATFORM75% similar
$19/mo Pro
MIKE
● PLATFORM73% similar
no public price
Parea Ai
● PLATFORM73% similar
no public price
LlamaStash
● PLATFORM73% similar
no public price
Tokenwise
● PLATFORM73% similar
$79/mo Pro
Feenion
● PLATFORM73% similar
no public price
Selfware
● PLATFORM72% similar
no public price
Openheim
● PLATFORM72% similar
no public price
Respan
● PLATFORM72% similar
no Pro plan
entry $199/mo
Orq.ai
● PLATFORM72% similar
no public price
onPanda
● PLATFORM72% similar
no public price
AAPIs2Ranked by similarity
Opentools
● API77% similar
no public price
AgentOps
● API72% similar
$40/mo Pro
MMCP servers9Ranked by similarity
Model Council
● MCP76% similar
no public price
CouchLoop EQ
● MCP75% similar
no public price
DeepTeam MCP
● MCP73% similar
no public price
Llm Evaluation Agent
● MCP73% similar
no public price
Universal AI Agent Bridge
● MCP73% similar
no public price
EvalForge Lite
● MCP73% similar
no public price
MCP Tool Execution
● MCP73% similar
no public price
RE
retriEVAL
● MCP73% similar
no public price
Cucumberstudio
● MCP72% similar
no public price
AAgents2Ranked by similarity
KORA Doctor
● AGENT73% similar
no public price
Canvas Agent
● AGENT72% similar
$150/mo Pro

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.