Ultra-fast LLM inference on custom LPU hardware, tuned for low time-to-first-token
Claude models with tool use, the MCP connector, Agent Skills, and the Claude Agent SDK | 5/5 |
Open-source proxy and SDK exposing 100+ model providers behind one OpenAI-compatible API | 5/5 |
One OpenAI-compatible endpoint in front of hundreds of hosted models, with automatic fallback and per-key spend limits | 5/5 |
GPT-5 series models, embeddings, and the Responses API with native MCP and tool use | 5/5 |
Gemini multimodal models via Google AI Studio and Vertex AI, with function calling and MCP support | 5/5 |
Run thousands of open-source models — LLM, image, video, audio — behind one API | 5/5 |