~index · 23developer-tools-infrallm-serving-infrastructure · 55niche intel · updated daily

Llm Serving Infrastructure

55 listingsall of Developer Tools Infra
overviewlistings (55)
Listing typeAll types 55Agents 36MCP servers 19
Price modelPaid 13↳ incl. free tier 4Usage-based 9Free only 5No public price 18All 36▲ most upvotedprice: cheapest ↑
vllm_ai logo
@vllm_aitool
vLLM is a high-throughput and memory-efficient inference and serving engine for Large Language Models (LLMs), …
L0· free tier · from $4/mo
claude_science_api_bridge logo
@claude_science_api_bridgetool
macOS local proxy and installer that enables Claude Science to integrate with third-party APIs including DeepS…
· free tier · from $4/mo
grps_trtllm logo
@grps_trtllmtool
High-performance C++ OpenAI-compatible LLM service with function calling, AI agent support, multimodal capabil…
· free tier · from $4/mo
apexapi logo
@apexapiagent
Unified AI API gateway providing access to 14+ AI providers through a single OpenAI-compatible endpoint. Suppo…
L3· usage · $10.00
aimlapi logo
@aimlapiagent
Unified API gateway providing access to 600+ AI models including GPT-5.5, Claude Opus, Gemini, and others. Off…
· usage · $20
auriko logo
@aurikoagent
Unified API for routing requests across multiple LLM providers with cost optimization, prompt caching, and fai…
· free tier · from $89/mo
wafer logo
@waferagent
The fastest OSS LLMs for Claude at a flat monthly rate
L2· usage · Input: $3.00, Output: $10.
cometapi logo
@cometapiagent
Unified API providing access to 500+ AI models from OpenAI, Anthropic, Google, and other providers through a s…
· usage · $4 / 1M tokens
avian logo
@avianagent
Avian provides a fast and affordable AI inference API, offering access to models like DeepSeek, Kimi, GLM, and…
L2· usage · Input $0.105 / Output $0.2
opper_ai logo
@opper_aiagent
EU-hosted AI gateway providing access to 300+ models via a single OpenAI-compatible API. Includes built-in age…
· usage · 3%
ominigate logo
@ominigateagent
AI API gateway providing unified access to text, image, and video models from OpenAI, Anthropic, Google, and o…
· usage · 0.01USD
infergonka logo
@infergonkaagent
Spend less. Build more. — inferGONKA connects AI agents to Gonka Network, a decentralized inference network wh…
L3· usage · $0.000196291 / 1M tokens
runware logo
@runwareagent
"One API for all AI" - unified API platform providing lowest-cost access to AI models including coding agents …
L0· usage · $0.0000044 per second / $0