Max Mayfield
8a4c7c256d
- Gitea Actions workflows: ci.yml (tests+clippy+fmt), benchmark.yml (P99 gate), deploy.yml (Fly+CF) - Fly.io configs: proxy (shared-cpu, 256MB, min 1 machine), API (scale-to-zero) - Dockerfiles: multi-stage Rust builds for proxy and API binaries - INFRASTRUCTURE.md: full V1 stack (~$5/mo), AWS migration path, Gitea runner setup, DNS plan - Stack: Fly.io + Cloudflare Pages + Neon + Upstash + Gitea Actions
dd0c/route — LLM Cost Router & Optimization Dashboard
Drop-in OpenAI-compatible proxy that routes AI requests to the cheapest capable model.
Quick Start
# Start local infra
docker compose up -d
# Run the proxy
OPENAI_API_KEY=sk-your-key cargo run --bin dd0c-proxy
# Test it
curl http://localhost:8080/v1/chat/completions \
-H "Authorization: Bearer your-dd0c-key" \
-H "Content-Type: application/json" \
-d '{"model":"gpt-4o","messages":[{"role":"user","content":"Hello"}]}'
Architecture
- Proxy Engine (Rust/Axum) — <5ms overhead, SSE streaming, async telemetry
- Router Brain — Complexity classification, cost-based routing, fallback chains
- Dashboard API — REST API for config, analytics, team management
- TimescaleDB — Time-series telemetry with continuous aggregates
- PostgreSQL — Config, auth, routing rules
- Redis — API key cache, rate limiting
Project Structure
src/
proxy/ — Proxy server (main entry point)
api/ — Dashboard API server
worker/ — Background jobs (digests, alerts)
router/ — Routing logic & complexity classifier
auth/ — API key validation, JWT, OAuth
config/ — App configuration
data/ — Data layer traits (EventQueue, ObjectStore)
analytics/ — PostHog PLG instrumentation
migrations/ — PostgreSQL + TimescaleDB schemas
tests/ — Unit, integration, E2E tests
infra/ — CDK / deployment configs
Pricing
| Tier | Price | Requests/mo | Retention |
|---|---|---|---|
| Free | $0 | 10K | 7 days |
| Pro | $49/mo | 1M | 90 days |
| Enterprise | Custom | Unlimited | 1 year |