Relay

Relay is the reliable delivery layer for LLM APIs

Visit Website

Every AI builder rewrites the same retry-failover-cache code for LLM APIs. I did it across four projects, each time with a new bug. Relay is that code, but reliable and importable. One line replaces @anthropic-ai/sdk.

About

Every AI builder rewrites the same retry-failover-cache code for LLM APIs. I did it across four projects, each time with a new bug. Relay is that code, but reliable and importable. One line replaces @anthropic-ai/sdk.