Max Mayfield
a486373d93
- Layout with sidebar navigation (Dashboard, Rules, Keys, Settings) - Dashboard page: stat cards, cost savings area chart (Recharts), model usage table - Rules page: routing rules CRUD with modal editor, strategy/complexity/model matching - Keys page: API key generation, copy-once reveal, revocation, quick-start code snippet - Settings page: org info, provider config, danger zone - API client (SWR + fetch wrapper) with full TypeScript types - dd0c dark theme: indigo primary, cyan accent, dark surfaces - Vite proxy config for local dev against API on :3000
dd0c/route — LLM Cost Router & Optimization Dashboard
Drop-in OpenAI-compatible proxy that routes AI requests to the cheapest capable model.
Quick Start
# Start local infra
docker compose up -d
# Run the proxy
OPENAI_API_KEY=sk-your-key cargo run --bin dd0c-proxy
# Test it
curl http://localhost:8080/v1/chat/completions \
-H "Authorization: Bearer your-dd0c-key" \
-H "Content-Type: application/json" \
-d '{"model":"gpt-4o","messages":[{"role":"user","content":"Hello"}]}'
Architecture
- Proxy Engine (Rust/Axum) — <5ms overhead, SSE streaming, async telemetry
- Router Brain — Complexity classification, cost-based routing, fallback chains
- Dashboard API — REST API for config, analytics, team management
- TimescaleDB — Time-series telemetry with continuous aggregates
- PostgreSQL — Config, auth, routing rules
- Redis — API key cache, rate limiting
Project Structure
src/
proxy/ — Proxy server (main entry point)
api/ — Dashboard API server
worker/ — Background jobs (digests, alerts)
router/ — Routing logic & complexity classifier
auth/ — API key validation, JWT, OAuth
config/ — App configuration
data/ — Data layer traits (EventQueue, ObjectStore)
analytics/ — PostHog PLG instrumentation
migrations/ — PostgreSQL + TimescaleDB schemas
tests/ — Unit, integration, E2E tests
infra/ — CDK / deployment configs
Pricing
| Tier | Price | Requests/mo | Retention |
|---|---|---|---|
| Free | $0 | 10K | 7 days |
| Pro | $49/mo | 1M | 90 days |
| Enterprise | Custom | Unlimited | 1 year |