Groundfloor Docs

LLM Gateway

Workspace-scoped LLM virtual keys, model catalog, and usage billing via LiteLLM.

This page documents a feature that is partially available. LiteLLM must be running (compose --profile litellm) for full functionality.

Pillar #13· LLM Gateway⚠️ Scaffold

What it will do

The LLM Gateway provides workspace-scoped virtual API keys, a model catalog, token usage tracking, and compute-unit (CU) billing emission to the billing pipeline.

What works today

When LiteLLM is configured:

  • Model catalog with USD-per-1M-tokens rates
  • Mint workspace virtual keys
  • Usage summary on the /llm portal page
  • Account billing card shows tier multiplier and calculated bill

Prerequisites

  • LiteLLM running in the environment (deploy/PHASE2-DEPS.md, --profile litellm)
  • Workspace selected in the top navigation picker

Portal location

Sidebar → Build → LLM Gateway

  • GET /v1/workspaces/{id}/llm/catalog — model catalog
  • GET /v1/workspaces/{id}/llm/usage — usage summary
  • POST /v1/workspaces/{id}/llm/keys — mint virtual key

Coderunner

List, inspect, and restart Coderunner instances when integration is configured.

Environment Promotion

Promote app releases and configuration across dev, staging, and prod environments.

On this page

What it will doWhat works todayPrerequisitesPortal locationRelated docsRelated API