> ## Documentation Index
> Fetch the complete documentation index at: https://docs.chromaflow.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Performance & Scale

> Latency budgets, caching strategies, partitioning, and scaling patterns for 10k+ concurrent users.

# Performance Playbook

* Edge-first rendering via Cloudflare Pages
* SSE and WebSocket pipelines built for sub-150ms p99
* Durable Object partitioning per session/tenant

## Latency Budgets

| Component       | Avg | p99 | Optimization               |
| --------------- | --- | --- | -------------------------- |
| Edge Routing    | 5ms | 12m | Anycast                    |
| Auth Validation | 20m | 50m | Token cache                |
| LLM Streaming   | 80m | 150 | Shard models, reduce hops  |
| WS Broadcast    | 15m | 30m | Affinity, minimal payloads |
| DB Persistence  | 10m | 25m | Edge DB and batching       |

## Caching and Batching

* Edge cache for static assets
* Prompt/result caching where safe
* Batch DB writes and debounce broadcasts

See also: [Observability & SRE](sre-observability), [Architecture](architecture).