Groundfloor Docs

LLM Gateway

Workspace model catalog, usage, and virtual keys via LiteLLM — inference stays off the Control Plane data path.

The LLM Gateway page manages workspace-scoped model catalogs, usage, and virtual API keys. Inference goes to LiteLLM directly; Control Plane is not in the token data path.

Pillar #13· LLM Gateway✅ Live

What you can do

  • Browse the Groundfloor model catalog (and BYO models when provider keys exist in Secrets, for example OPENAI_API_KEY)
  • Mint or rotate a workspace virtual key (shown once — store it as LITELLM_API_KEY in Secrets)
  • View usage for the last 7 days (compute units, tokens, completions)

Prerequisites

  • LiteLLM available in the environment
  • Workspace selected in the top navigation picker

Portal location

Sidebar → Build → LLM Gateway

Use from apps

Federated apps should call the gateway with the workspace virtual key. See Shell LLM Gateway.

  • GET /v1/workspaces/{id}/llm/models — catalog
  • GET /v1/workspaces/{id}/llm/usage — usage summary
  • POST /v1/workspaces/{id}/llm/virtual-key — mint / rotate virtual key

Feature Flags

Manage per-environment typed feature flags and promote them across environments.

Data Vault

Browse collections, query records, and manage schema in workspace-scoped customer data.

On this page

What you can doPrerequisitesPortal locationUse from appsRelated APIRelated