---
title: "Millwright: Rust-based, self-hosted LLM router"
source: "Hacker News 热门（Algolia · 中文化）"
source_tier: "t2"
url: "https://github.com/Northwood-Systems/millwright"
permalink: "https://feed.astralor.com/items/itm_434d8cdb5261500af7394704"
published: "2026-07-22T19:03:50.000Z"
score: 69
channel: "ai"
tags: ["LLM Router","Northwood Systems","Rust","Self-hosted"]
---

# Millwright: Rust-based, self-hosted LLM router

## AI commentary

> If you're struggling with orchestrating multiple LLM APIs and controlling costs, Millwright's deterministic routing approach is worth a try. Its Rust implementation and self-hosted nature make it especially suitable for teams with strict latency and security requirements.

## At a glance

Millwright is a self-hosted LLM router written in Rust, emphasizing cost-effectiveness, deterministic routing, and high performance. It is secure and private by default, supporting multi-model load balancing and fallback, making it suitable for AI applications that require local deployment, low latency, and high reliability. The project is open-sourced on GitHub and can be flexibly integrated into existing inference backends.

## Key points

- Built with Rust for high performance and memory safety
- Self-hosted with security and privacy by default
- Deterministic routing and cost control mechanisms
- Multi-model fallback and load balancing support

## Full text

Self-hosted LLM router. Cost effective, deterministic, and fast. Secure and private by default. - Northwood-Systems/millwright

---

Verify against the original before citing; curated by Astral Feed: https://feed.astralor.com/items/itm_434d8cdb5261500af7394704