Submit projectSubmit

CATEGORY

Routing & Cost Optimization

Manage how AI applications use models and resources. Explore tools for model routing, response reuse, and controlling inference costs.

products
49
related topics
3

Explore products49

Showing 1–24 of 49 projects

Promptfoo

www.promptfoo.dev

An open-source tool and platform for red teaming, security testing and evaluating LLM applications; being acquired by OpenAI.

Details

Cekura

www.cekura.ai

Automated QA platform for voice and chat AI agents that simulates conversations, red-teams, benchmarks providers and monitors production calls.

Details

Opper

opper.ai

EU-hosted AI gateway giving one OpenAI-, Anthropic- and Gemini-compatible API to 700+ models, with spend caps, model allowlists, zero data retention, routing and fallbacks.

Details

ClearML

clear.ml

An open-source MLOps and AI infrastructure platform that combines experiment tracking, dataset versioning, pipelines and model serving with GPU cluster scheduling, quotas and fractional GPUs across cloud and on-premises hardware.

Details

HoneyHive

www.honeyhive.ai

An observability and evaluation platform for AI agents that records traces, scores live traffic and runs experiments, built on OpenTelemetry.

Details

Coval

www.coval.ai

Simulation, evaluation and monitoring platform for voice and chat AI agents, with human review queues, API, CLI and MCP server.

Details

OpenLLMetry

www.traceloop.com

Traceloop's open-source set of OpenTelemetry extensions that trace LLM calls, vector databases and agent frameworks and send the data to Traceloop or an existing observability backend.

Details

LangSmith

www.langchain.com

An observability and evaluation platform for tracing agent execution, inspecting failures and testing AI application outputs.

Details

LMCache

lmcache.ai

A KV-cache management layer that stores, reuses and transfers language-model inference state across requests, serving engines and storage backends.

Details

MLflow

mlflow.org

An AI engineering platform for tracing and evaluating LLM applications, versioning prompts, managing model access and tracking machine-learning experiments.

Details

Pydantic Logfire

pydantic.dev

An observability platform that traces model calls, agent tools, API requests and database queries together and evaluates AI outputs alongside those traces.

Details

Latitude

latitude.so

An agent observability platform that traces production sessions, groups recurring failures and sends coding agents the context to investigate fixes.

Details

Giskard

www.giskard.ai

A testing platform for finding security vulnerabilities and evaluating answer quality in LLM agents and retrieval applications.

Details

LangWatch

langwatch.ai

An AI engineering platform for tracing model and tool calls, testing agents with simulated conversations, evaluating outputs and managing prompts.

Details

Requesty

www.requesty.ai

An AI gateway that routes model requests through one API with caching, provider fallbacks, spend controls and usage analytics.

Details

Mindgard

mindgard.ai

An AI security platform for discovering attack surfaces, running adversarial tests against models and agents, and reviewing defensive gaps and remediation guidance.

Details

Evidently

www.evidentlyai.com

An open-source Python framework for evaluating LLM outputs, testing AI systems and monitoring data quality and model drift.

Details

Inspect AI

inspect.aisi.org.uk

An evaluation framework that combines datasets, agents, tools and scorers to assess language models and inspect their execution logs.

Details

Eden AI

www.edenai.co

A unified AI API for comparing and routing model providers, with shared authentication, billing, monitoring and fallback models.

Details