Proxy

Single Binary. Zero Dependencies. Sub‑10ms Routing.

A high-performance Rust proxy that routes LLM requests across providers through a single OpenAI-compatible endpoint. Built for autonomous agents, not chatbots.

INSTALL

No Postgres. No Redis. No Docker orchestration. One command to start routing.

curl

curl -fsSL https://get.bitrouter.ai | sh

npm

npx bitrouter@latest

brew

brew install bitrouter/tap/bitrouter

cargo

cargo install bitrouter

Runs on macOS, Linux, and Docker. Windows via WSL.

ROUTING

Requests arrive in OpenAI format. BitRouter selects the optimal provider and model based on task type, cost, and availability — then translates the protocol automatically.

Request	Routed to	Provider	Reason	Overhead
gpt-4o	claude-sonnet-4	Anthropic	Cost optimization	8ms
claude-opus	claude-haiku	Anthropic	Low complexity	6ms
gpt-4o	gemini-2.5-pro	Google	Fallback (429)	9ms
any	deepseek-r1	DeepSeek	Reasoning task	7ms

Sub-10ms overhead

Automatic fallback on 429/5xx

PROVIDERS

Route to any major LLM provider through a single endpoint. Cross-protocol translation handled automatically.

OpenAI

Anthropic

Google

Mistral

DeepSeek

Inspect

Monitor all requests and responses in real time. Full token-level visibility.

Warn

Flag risky content patterns and log alerts without blocking the request.

Redact

Strip PII, credentials, and sensitive data before it reaches the provider.

Block

Hard-stop requests that violate policy. Content filtering at the proxy layer.

CONFIGURATION

One YAML file configures providers, routing rules, and firewall policies.

bitrouter.yaml

# bitrouter.yaml
providers:
  - name: anthropic
    api_key: ${ANTHROPIC_API_KEY}
  - name: openai
    api_key: ${OPENAI_API_KEY}
  - name: google
    api_key: ${GOOGLE_API_KEY}

routing:
  strategy: cost-optimized
  rules:
    - match: { complexity: high }
      model: claude-opus-4
    - match: { task: code-gen }
      model: claude-sonnet-4
    - fallback: claude-haiku

firewall:
  pii_redaction: true
  content_filter: warn
  audit_log: true

COMPARE

How BitRouter stacks up against other LLM routing solutions.

	BitRouter	OpenRouter	LiteLLM
Open source		—
Self-hostable		—
Routing overhead	< 10ms	25–40ms	15–30ms
Agent-native (KYA/ACP)		—	—
Zero dependencies		N/A	—
Agent firewall		—	—
402/MPP payments		—	—
Single binary		N/A	—