A hosted gateway that lets developers access models from multiple providers through an OpenAI-compatible API.
CATEGORY
Routing & Cost Optimization
Manage how AI applications use models and resources. Explore tools for model routing, response reuse, and controlling inference costs.
- products
- 49
- related topics
- 3
Explore products49
Showing 1–24 of 49 projects
An open-source tool and platform for red teaming, security testing and evaluating LLM applications; being acquired by OpenAI.
Automated QA platform for voice and chat AI agents that simulates conversations, red-teams, benchmarks providers and monitors production calls.
EU-hosted AI gateway giving one OpenAI-, Anthropic- and Gemini-compatible API to 700+ models, with spend caps, model allowlists, zero data retention, routing and fallbacks.
An open-source MLOps and AI infrastructure platform that combines experiment tracking, dataset versioning, pipelines and model serving with GPU cluster scheduling, quotas and fractional GPUs across cloud and on-premises hardware.
An observability and evaluation platform for AI agents that records traces, scores live traffic and runs experiments, built on OpenTelemetry.
Simulation, evaluation and monitoring platform for voice and chat AI agents, with human review queues, API, CLI and MCP server.
Traceloop's open-source set of OpenTelemetry extensions that trace LLM calls, vector databases and agent frameworks and send the data to Traceloop or an existing observability backend.
An observability and evaluation platform for tracing agent execution, inspecting failures and testing AI application outputs.
A KV-cache management layer that stores, reuses and transfers language-model inference state across requests, serving engines and storage backends.
An AI engineering platform for tracing and evaluating LLM applications, versioning prompts, managing model access and tracking machine-learning experiments.
An observability platform that traces model calls, agent tools, API requests and database queries together and evaluates AI outputs alongside those traces.
A framework for evaluating language models on benchmark tasks with configurable prompts, metrics and local or API-based model backends.
A model-compression library for quantizing weights, activations and KV caches and exporting compressed checkpoints for inference with vLLM.
An agent observability platform that traces production sessions, groups recurring failures and sends coding agents the context to investigate fixes.
A testing platform for finding security vulnerabilities and evaluating answer quality in LLM agents and retrieval applications.
An AI gateway and LLM observability platform for routing and monitoring AI applications.
An observability and evaluation platform for AI agents that traces production, runs evals and catches regressions.
An AI engineering platform for tracing model and tool calls, testing agents with simulated conversations, evaluating outputs and managing prompts.
An AI gateway that routes model requests through one API with caching, provider fallbacks, spend controls and usage analytics.
An AI security platform for discovering attack surfaces, running adversarial tests against models and agents, and reviewing defensive gaps and remediation guidance.
An open-source Python framework for evaluating LLM outputs, testing AI systems and monitoring data quality and model drift.
An evaluation framework that combines datasets, agents, tools and scorers to assess language models and inspect their execution logs.
A unified AI API for comparing and routing model providers, with shared authentication, billing, monitoring and fallback models.