
Clawbench
Open benchmark that evaluates AI browser agents on real, live websites by giving them everyday online tasks (booking flights, ordering food, shopping, applying…
What it does
The specific capability behind this listing, and where to get it.
Open benchmark that evaluates AI browser agents on real, live websites by giving them everyday online tasks (booking flights, ordering food, shopping, applying for jobs) and scoring whether they submit the correct request
Official Clawbench links
Pricing & plans
Observed public pricing for Clawbench, benchmarked against comparable providers. Plans, tiers, history and scenario below.
$0.07 /task
The current price sits below the comparable median.
$0.07 is positioned against a $0–$0 observed middle market.
Why Agentery reaches that view
price_benchmark62.7% below the median.
get_provider_profile · plan historyper task observed 2026-10-28.
pricing recommendationPercentile unavailable for this basis.
confidenceSource page rechecked daily.
Test a different price for this plan.
Move the proposed monthly price. Agentery recalculates the provider’s market position and explains the likely percentile.
Is Clawbench good value?
How its price compares with genuinely comparable providers.
Below the comparable median for its buyer tier.
Basis: same-tier-tier plans in the niche, any billing unit (1 provider), USD monthly, pricing observed 2026-10-28. The per task plan ($0.0721/mo) sits 62.7% below that median of $0.19. Thin evidence: fewer than five comparable providers, so treat the position as indicative. Other cohorts on this page (niche-wide tier peers, nearest products by capability) are labelled where they appear.
Compared with Agent Observability Eval
Positioned against the observed p25 / median / p75 of comparable providers at the same buyer tier and billing unit (the basis is stated with each verdict above). See the plans above for the percentile and its cohort size, and the full niche market for peers.
View the full niche →Clawbench's local market
Nearest products by what they do — a different cohort from the buyer-tier benchmark above.
See the MCP response behind this page · get_provider_profile()
See the MCP response behind this pageget_provider_profile (get_agent_profile remains a callable alias)
{
"agent_id": "clawbench",
"name": "Clawbench",
"url": "https://claw-bench.com/",
"logo": "https://agentery.com/logos/CP-W56MMH-256.png",
"niche": "agent-observability-eval",
"category": "developer-tools-infra",
"short_summary": "Open benchmark that evaluates AI browser agents on real, live websites by giving them everyday online tasks (booking flights, ordering food, shopping, applying…",
"task_performed": "Open benchmark that evaluates AI browser agents on real, live websites by giving them everyday online tasks (booking flights, ordering food, shopping, applying for jobs) and scoring whether they submit the correct request",
"inputs_accepted": [
"Task prompts/instructions",
"agent model trajectories",
"execution traces (recordings",
"actions",
"agent messages",
"HTTP requests)",
"benchmark corpora bundles"
],
"outputs_produced": [
"Leaderboard rankings",
"two-stage scores (HTTP interception + LLM judge)",
"pass/fail verdicts",
"5-layer execution traces",
"datasets of model trajectories"
],
"integrations_available": [
"GitHub",
"Hugging Face",
"PyPI",
"OpenRouter",
"arXiv",
"Gradio"
],
"protocols_or_interfaces": [],
"industry_fit": [
"developer tools / AI agent evaluation research"
],
"autonomy_level": "infrastructure",
"human_approval_needed": "unclear",
"pricing_model": "free",
"price": {
"observed": true,
"billing": "usage",
"source_kind": "vendor",
"currency": "USD",
"lowest_monthly_usd": null,
"monthly_usd": null,
"headline": "$4.44 per task; $0.33 per task (usage-based)",
"commercial": {
"rates": [
{
"line": "claude-opus-4-7",
"per": "per task",
"text": "$4.44 per task"
},
{
"line": "gpt-5.5",
"per": "per task",
"text": "$0.33 per task"
},
{
"line": "glm-5.1",
"per": "per task",
"text": "$0.19 per task"
},
{
"line": "deepseek-v4-pro",
"per": "per task",
"text": "$0.07 per task"
},
{
"line": "openrouter-owl-alpha",
"per": "per task",
"text": "$0.37 per task"
}
],
"currency": "USD",
"lines": [
{
"name": "claude-opus-4-7",
"price": "$4.4425",
"kind": "usage_rate",
"unit": "task",
"billed": "usage"
},
{
"name": "gpt-5.5",
"price": "$0.3325",
"kind": "usage_rate",
"unit": "task",
"billed": "usage"
},
{
"name": "glm-5.1",
"price": "$0.1935",
"kind": "usage_rate",
"unit": "task",
"billed": "usage"
},
{
"name": "deepseek-v4-pro",
"price": "$0.0721",
"kind": "usage_rate",
"unit": "task",
"billed": "usage"
},
{
"name": "deepseek-v4-flash:free",
"price": "$0.0000",
"kind": "free",
"billed": "monthly"
},
{
"name": "z-ai/glm-4.5-air:free",
"price": "$0.0000",
"kind": "free",
"billed": "monthly"
},
{
"name": "minimax-m2.5:free",
"price": "$0.0000",
"kind": "free",
"billed": "monthly"
},
{
"name": "openrouter-owl-alpha",
"price": "$0.3704",
"kind": "usage_rate",
"unit": "task",
"billed": "usage"
}
]
},
"summary": "$4.44 per task; $0.33 per task (usage-based). The homepage reports model-specific usage rates ranging from $0.0000 to $4.4425 per task.",
"confidence": "medium",
"source_url": "https://claw-bench.com/",
"checked_at": "2026-10-28T01:29:29.673Z",
"amount": null,
"display": null,
"plans": [
{
"name": "claude-opus-4-7",
"price": "$4.4425",
"usage": true,
"period": "usage",
"persona": "individual",
"highlights": [
"Cost per task"
]
},
{
"name": "gpt-5.5",
"price": "$0.3325",
"usage": true,
"period": "usage",
"persona": "individual",
"highlights": [
"Cost per task"
]
},
{
"name": "glm-5.1",
"price": "$0.1935",
"usage": true,
"period": "usage",
"persona": "individual",
"highlights": [
"Cost per task"
]
},
{
"name": "deepseek-v4-pro",
"price": "$0.0721",
"usage": true,
"period": "usage",
"persona": "pro",
"highlights": [
"Cost per task"
]
},
{
"name": "deepseek-v4-flash:free",
"price": "$0.0000",
"usage": true,
"period": "usage",
"persona": "free",
"highlights": [
"Cost per task"
]
},
{
"name": "z-ai/glm-4.5-air:free",
"price": "$0.0000",
"usage": true,
"period": "usage",
"persona": "free",
"highlights": [
"Cost per task"
]
},
{
"name": "minimax-m2.5:free",
"price": "$0.0000",
"usage": true,
"period": "usage",
"persona": "free",
"highlights": [
"Cost per task"
]
},
{
"name": "openrouter-owl-alpha",
"price": "$0.3704",
"usage": true,
"period": "usage",
"persona": "individual",
"highlights": [
"Cost per task"
]
}
],
"source": "render+llm"
},
"trust_or_rating_signal": [
"GitHub 286 stars",
"arXiv paper (2604.08523)",
"#3 HuggingFace Paper of the Day",
"TIGER-AI-Lab / TIGER-Lab affiliation",
"featured in DeepWiki, awesome-harness-engineering, Awesome-AI-Agents, LLM-Agent-Benchmark-List",
"Apache-2.0 license",
"1,724 judge-verified runs"
],
"evidence_quality": "high",
"entity_type": "tool",
"regulated_data_suitability": "unclear",
"evidence_urls": [
"https://claw-bench.com/",
"https://github.com/reacher-z/ClawBench"
],
"last_checked": "2026-10-28",
"profile_checked": "2026-06-16",
"price_checked": "2026-10-28",
"how_to_connect": {
"website": "https://claw-bench.com/",
"docs": "https://github.com/documentation",
"mcp": null,
"a2a": null,
"api": {
"docs_url": "https://github.com/developer",
"endpoint": null
},
"protocols": [],
"install": null,
"repository": null
},
"deployment": {
"model": "unknown",
"both_offered": false,
"hosted_endpoint": null,
"install": null,
"note": "No deployment evidence held — Agentery has no endpoint, install instruction or directory attribute for this listing.",
"evidence": null
},
"licence": {
"name": null,
"note": "No named licence found in the retained page text or source attributes. A public repository alone does not establish an open-source licence.",
"evidence": null
},
"evidence_checks": {
"price": {
"source_url": "https://claw-bench.com/",
"last_observed_day": "2026-10-28",
"age_days": 0,
"verified_day": null,
"note": "from the listing's current price record; no separate page-text verification is held"
},
"agent_card": {
"status": "unknown",
"note": "no Agent Card URL recorded for this listing"
},
"endpoint": {
"status": "unknown",
"note": "endpoint not yet checked"
}
},
"product_group": null,
"liveness": {
"probed": true,
"alive": true,
"endpoint_kind": "site",
"latency_ms": 946,
"uptime_7d": 1,
"checked_at": "2026-10-28T02:34:04.743Z",
"consecutive_failures": 0,
"status": "alive"
},
"price_extras": {
"free_tier": null,
"unit_cost": null
},
"reported_success": null,
"feedback": "If you actually use this provider, call report_outcome with the result. Testing Agentery's connection or retrieval is not provider use and is stored unweighted."
}