> ## Documentation Index
> Fetch the complete documentation index at: https://docs.chromaflow.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Performance & Scale

> Latency budgets, caching strategies, partitioning, and scaling patterns for 10k+ concurrent users.

# Performance Playbook

* Edge-first rendering via Cloudflare Pages
* SSE and WebSocket pipelines built for sub-150ms p99
* Durable Object partitioning per session/tenant

## Latency Budgets

| Component | Avg | p99 | Optimization |
| - | - | - | - |
| Edge Routing | 5ms | 12m | Anycast |
| Auth Validation | 20m | 50m | Token cache |
| LLM Streaming | 80m | 150 | Shard models, reduce hops |
| WS Broadcast | 15m | 30m | Affinity, minimal payloads |
| DB Persistence | 10m | 25m | Edge DB and batching |

## Caching and Batching

* Edge cache for static assets
* Prompt/result caching where safe
* Batch DB writes and debounce broadcasts

See also: [Observability & SRE](sre-observability), [Architecture](architecture).


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.