All platforms

// PLATFORM

LLM Gateway

[ OPERATOR MFA ]

OpenAI-compatible LLM routing

Open & authenticate

gateway.bluelayersystems.com/docs

Operator access at the edge (email one-time-PIN). The link opens the interactive API docs (Swagger UI) — viewable without a key; the API endpoints themselves are Bearer-token protected. The root path is a 401 by design (it's an API, not a dashboard).

The LLM Gateway is an OpenAI-compatible API: a thin FastAPI edge handles auth and request shaping, while LiteLLM routes completion requests across a homelab Ollama fleet and cloud providers, with Redis-backed caching and an OpenTelemetry span emitted on every request.

It's an API rather than a browsable UI — the link reaches the gateway surface behind Cloudflare Access. Bearer-token auth at the backend means both the edge challenge and the API token must pass: defense in depth, not perimeter-only.

Stack

FastAPILiteLLMRedisOpenTelemetry