---
title: "role-model: A Router for Hybrid Local/Cloud AI"
source: "Hacker News 热门（Algolia · 中文化）"
source_tier: "t2"
url: "https://github.com/try-works/role-model"
permalink: "https://feed.astralor.com/items/itm_ee499d3b8fb23ced53088aa4"
published: "2026-06-28T10:46:08.000Z"
score: 49
channel: "tech"
tags: ["role-model","Open Source","smart routing"]
---

# role-model: A Router for Hybrid Local/Cloud AI

## At a glance

Role-model is an open-source protocol that intelligently routes tasks between local and cloud AI models, enabling hybrid usage or switching across multiple cloud providers. It defines task requirements via roles and automatically selects the best model (local or cloud), balancing cost, privacy, and performance. Ideal for developers seeking flexible AI resource orchestration.

## Key points

- Offers a unified configuration interface to seamlessly combine local LLMs (e.g., Llama) with cloud APIs (e.g., OpenAI)
- Supports role-based declarative routing, each role can bind multiple models with weights
- Built-in failover and load balancing to avoid single point of dependency
- Zero-dependency, lightweight, easy to integrate into existing workflows

## Full text

role-model is a protocol for assigning the right model for the right job. Use local and cloud AI together, or route between several cloud providers. - try-works/role-model

---

Verify against the original before citing; curated by Astral Feed: https://feed.astralor.com/items/itm_ee499d3b8fb23ced53088aa4