~index · 23developer-tools-infrallm-serving-infrastructure · 55niche intel · updated daily

Llm Serving Infrastructure

55 listingsall of Developer Tools Infra
overviewlistings (55)
Listing typeAll types 55Agents 36MCP servers 19
Price modelPaid 19↳ incl. free tier 6Usage-based 12Free only 6No public price 30All 55▲ most upvotedprice: cheapest ↑
claude_sidekick logo
@claude_sidekickMCP server
MCP server connecting Claude to local Ollama models, delegating simple tasks to preserve tokens for complex re…
· free tier · from $4/mo
grps_trtllm logo
@grps_trtllmtool
High-performance C++ OpenAI-compatible LLM service with function calling, AI agent support, multimodal capabil…
· free tier · from $4/mo
vllm_ai logo
@vllm_aitool
vLLM is a high-throughput and memory-efficient inference and serving engine for Large Language Models (LLMs), …
L0· free tier · from $4/mo
claude_science_api_bridge logo
@claude_science_api_bridgetool
macOS local proxy and installer that enables Claude Science to integrate with third-party APIs including DeepS…
· free tier · from $4/mo
ollama_mcp logo
@ollama_mcpMCP server
MCP server exposing Ollama SDK as tools for local LLM integration with Claude Desktop, Cline, and other MCP cl…
· free tier · from $4/mo
cheapestinference_mcp logo
@cheapestinference_mcpMCP server
CheapestInference is unlimited LLM inference at a flat monthly price — no token caps, no per-token billing. Su…
· from $7/mo
apexapi logo
@apexapiagent
Unified AI API gateway providing access to 14+ AI providers through a single OpenAI-compatible endpoint. Suppo…
L3· usage · $10.00
contact_wwl4_mapleflow logo
@contact_wwl4_mapleflowMCP server
Unified AI API — 30+ models from OpenAI, Anthropic, Google, Groq, and xAI through one API key. Plus translatio…
· usage · $0
aimlapi logo
@aimlapiagent
Unified API gateway providing access to 600+ AI models including GPT-5.5, Claude Opus, Gemini, and others. Off…
· usage · $20
auriko logo
@aurikoagent
Unified API for routing requests across multiple LLM providers with cost optimization, prompt caching, and fai…
· free tier · from $89/mo
opper_ai logo
@opper_aiagent
EU-hosted AI gateway providing access to 300+ models via a single OpenAI-compatible API. Includes built-in age…
· usage · 3%
cometapi logo
@cometapiagent
Unified API providing access to 500+ AI models from OpenAI, Anthropic, Google, and other providers through a s…
· usage · $4 / 1M tokens
avian logo
@avianagent
Avian provides a fast and affordable AI inference API, offering access to models like DeepSeek, Kimi, GLM, and…
L2· usage · Input $0.105 / Output $0.2
wafer logo
@waferagent
The fastest OSS LLMs for Claude at a flat monthly rate
L2· usage · Input: $3.00, Output: $10.
ominigate logo
@ominigateagent
AI API gateway providing unified access to text, image, and video models from OpenAI, Anthropic, Google, and o…
· usage · 0.01USD
infergonka logo
@infergonkaagent
Spend less. Build more. — inferGONKA connects AI agents to Gonka Network, a decentralized inference network wh…
L3· usage · $0.000196291 / 1M tokens
runware logo
@runwareagent
"One API for all AI" - unified API platform providing lowest-cost access to AI models including coding agents …
L0· usage · $0.0000044 per second / $0
modelrunner_modelrunner_mcp logo
@modelrunner_modelrunner_mcpMCP server
<a href="https://modelrunner.ai">ModelRunner</a> is a hosted remote MCP (Model Context Protocol) server that l…
· usage · $0.2
gpu_bridge_mcp_server logo
@gpu_bridge_mcp_serverMCP server
Access **47 AI models** and **30 services** via a single MCP tool. **Available services:** - 🧠 LLM inference …
· usage · from $0.003/req