Best Portkey alternatives

LangChain's observability and evaluation platform for LLM applications, tracing every step of a chain or agent run and scoring outputs against test datasets.

Unified API and marketplace for LLMs, routing requests to the best available provider for a given model and handling failover automatically across dozens of providers.

Open-source LLM observability and evaluation platform built on OpenTelemetry, with tracing, datasets, experiments and prompt tooling.

Open-source LLM observability platform for tracing, evaluating, and debugging prompts and agent runs, self-hostable or available as a managed cloud service.

Open-source Python library and proxy server that calls 100+ LLM providers through one OpenAI-compatible interface, with built-in cost tracking and load balancing.

Evaluation-first platform for LLM applications, treating prompt and model changes like code changes that need regression tests before shipping.

Open-source LLM observability proxy that sits between your app and a model provider, logging requests, costs, and latency with a one-line integration change.