Max Mayfield
311a834228
- PostgreSQL schema: orgs, users, api_keys, provider_configs, routing_rules, cost_tables, feature_flags - TimescaleDB schema: request_events hypertable, hourly/daily continuous aggregates, compression, retention - docker-compose.yml: postgres, timescaledb, redis for local dev - README with quick start, architecture overview, pricing tiers - .env.example, .gitignore
54 lines
1.6 KiB
Markdown
54 lines
1.6 KiB
Markdown
# dd0c/route — LLM Cost Router & Optimization Dashboard
|
|
|
|
Drop-in OpenAI-compatible proxy that routes AI requests to the cheapest capable model.
|
|
|
|
## Quick Start
|
|
|
|
```bash
|
|
# Start local infra
|
|
docker compose up -d
|
|
|
|
# Run the proxy
|
|
OPENAI_API_KEY=sk-your-key cargo run --bin dd0c-proxy
|
|
|
|
# Test it
|
|
curl http://localhost:8080/v1/chat/completions \
|
|
-H "Authorization: Bearer your-dd0c-key" \
|
|
-H "Content-Type: application/json" \
|
|
-d '{"model":"gpt-4o","messages":[{"role":"user","content":"Hello"}]}'
|
|
```
|
|
|
|
## Architecture
|
|
|
|
- **Proxy Engine** (Rust/Axum) — <5ms overhead, SSE streaming, async telemetry
|
|
- **Router Brain** — Complexity classification, cost-based routing, fallback chains
|
|
- **Dashboard API** — REST API for config, analytics, team management
|
|
- **TimescaleDB** — Time-series telemetry with continuous aggregates
|
|
- **PostgreSQL** — Config, auth, routing rules
|
|
- **Redis** — API key cache, rate limiting
|
|
|
|
## Project Structure
|
|
|
|
```
|
|
src/
|
|
proxy/ — Proxy server (main entry point)
|
|
api/ — Dashboard API server
|
|
worker/ — Background jobs (digests, alerts)
|
|
router/ — Routing logic & complexity classifier
|
|
auth/ — API key validation, JWT, OAuth
|
|
config/ — App configuration
|
|
data/ — Data layer traits (EventQueue, ObjectStore)
|
|
analytics/ — PostHog PLG instrumentation
|
|
migrations/ — PostgreSQL + TimescaleDB schemas
|
|
tests/ — Unit, integration, E2E tests
|
|
infra/ — CDK / deployment configs
|
|
```
|
|
|
|
## Pricing
|
|
|
|
| Tier | Price | Requests/mo | Retention |
|
|
|------|-------|-------------|-----------|
|
|
| Free | $0 | 10K | 7 days |
|
|
| Pro | $49/mo | 1M | 90 days |
|
|
| Enterprise | Custom | Unlimited | 1 year |
|