---
title: "Perseus: A Full-Stack System for Homomorphic Model Inference"
source: "arXiv AI/CL/LG（论文）"
source_tier: "t2"
url: "https://arxiv.org/abs/2611.04488v1"
permalink: "https://feed.astralor.com/items/itm_889b788f8e87d06a8e58945d"
published: "2026-11-03T08:19:10.000Z"
score: 59
channel: "tech"
tags: ["LLM","OpenAI","推理效率","RAG","Perseus","Full-Stack System","Homomorphic Model Inference","Large Language Models"]
---

# Perseus: A Full-Stack System for Homomorphic Model Inference

## 速览

Large Language Models (LLMs) have made it exceptionally convenient for users to send their private data to model providers, which process them in plaintext. Fully Homomorphic Encryption (FHE) promises to secure remote i…

## 关键点

- Large Language Models (LLMs) have made it exceptionally convenient for users to send their private data to model providers, which process them in plaintext.
- Fully Homomorphic Encryption (FHE) promises to secure remote inference by computing directly on encrypted data, yet it has remained prohibitively slow.
- The effort to make it practical remains fragmented, with most existing frameworks being closed-source, which keeps progress from compounding.

## 全文

Large Language Models (LLMs) have made it exceptionally convenient for users to send their private data to model providers, which process them in plaintext. Fully Homomorphic Encryption (FHE) promises to secure remote inference by computing directly on encrypted data, yet it has remained prohibitively slow. The effort to make it practical remains fragmented, with most existing frameworks being closed-source, which keeps progress from compounding. We present Perseus, a free and open Python software library that supports the full stack of encrypted model inference, from the cryptographic backend and data packing, to encrypted nonlinearities and end-to-end model execution. Perseus ships with built-in novel optimizations, one at each level of the stack: in-kernel regeneration of key-switching keys at the (i) backend level, a complex variant of Cachemir packing at the (ii) data level, and a state-of-the-art bootstrap placer that is both packing- and magnitude-aware at the (iii) model level. Perseus achieves state-of-the-art latency across multiple models and modalities, within $3\%$ of the plaintext models' accuracy and perplexity. Remarkably, it is $3.96\times$ faster at single-token decoding than any other implementation on Llama-3-8B. We initiate, for the first time, a public speedrun on encrypted GPT-2, so that progress can compound.

---

引用前请核对原文;本文由星际流动整理:https://feed.astralor.com/items/itm_889b788f8e87d06a8e58945d