Max Mayfield
0a3173c6a9
Some checks failed
CI — P1 Route (Rust) / test (push) Has been cancelled
- Fixed struct field references (_org_id, _config) in constructors - Added chrono::Weekday import in test module - cargo clippy --workspace -- -D warnings: CLEAN - cargo test --workspace: 5/5 passing
dd0c/route — LLM Cost Router & Optimization Dashboard
Drop-in OpenAI-compatible proxy that routes AI requests to the cheapest capable model.
Quick Start
# Start local infra
docker compose up -d
# Run the proxy
OPENAI_API_KEY=sk-your-key cargo run --bin dd0c-proxy
# Test it
curl http://localhost:8080/v1/chat/completions \
-H "Authorization: Bearer your-dd0c-key" \
-H "Content-Type: application/json" \
-d '{"model":"gpt-4o","messages":[{"role":"user","content":"Hello"}]}'
Architecture
- Proxy Engine (Rust/Axum) — <5ms overhead, SSE streaming, async telemetry
- Router Brain — Complexity classification, cost-based routing, fallback chains
- Dashboard API — REST API for config, analytics, team management
- TimescaleDB — Time-series telemetry with continuous aggregates
- PostgreSQL — Config, auth, routing rules
- Redis — API key cache, rate limiting
Project Structure
src/
proxy/ — Proxy server (main entry point)
api/ — Dashboard API server
worker/ — Background jobs (digests, alerts)
router/ — Routing logic & complexity classifier
auth/ — API key validation, JWT, OAuth
config/ — App configuration
data/ — Data layer traits (EventQueue, ObjectStore)
analytics/ — PostHog PLG instrumentation
migrations/ — PostgreSQL + TimescaleDB schemas
tests/ — Unit, integration, E2E tests
infra/ — CDK / deployment configs
Pricing
| Tier | Price | Requests/mo | Retention |
|---|---|---|---|
| Free | $0 | 10K | 7 days |
| Pro | $49/mo | 1M | 90 days |
| Enterprise | Custom | Unlimited | 1 year |