---
title: "Para-Gaussian Approximations of Random Deep Neural Networks"
source: "arXiv AI/CL/LG（论文）"
source_tier: "t2"
url: "https://arxiv.org/abs/2610.37388v1"
permalink: "https://feed.astralor.com/items/itm_ce78875e47ebe787970085e5"
published: "2026-10-27T15:12:22.000Z"
score: 50
channel: "ai"
tags: ["Para-Gaussian Approximations","Random Deep Neural","Networks","Gaussian","Unfortunately"]
---

# Para-Gaussian Approximations of Random Deep Neural Networks

## 速览

It is known that randomly initialized neural networks have Gaussian behaviour in the $n\to \infty$ limit. Unfortunately, this approximation can be poor for finite $n$ and gets worse as one goes deeper into the network. …

## 关键点

- It is known that randomly initialized neural networks have Gaussian behaviour in the $n\to \infty$ limit.
- Unfortunately, this approximation can be poor for finite $n$ and gets worse as one goes deeper into the network.
- In this work, we develop a more accurate approximation that is \emph{slightly} non-Gaussian, which we call the para-Gaussian distribution and is constructed from the Hermite polynomials.

## 全文

It is known that randomly initialized neural networks have Gaussian behaviour in the $n\to \infty$ limit. Unfortunately, this approximation can be poor for finite $n$ and gets worse as one goes deeper into the network. In this work, we develop a more accurate approximation that is \emph{slightly} non-Gaussian, which we call the para-Gaussian distribution and is constructed from the Hermite polynomials. We show how this para-Gaussian approximation can lead to a practical recursive method to approximate the deeper layers of the network. Finally, we apply this theory to linear neural networks (where things can be solved exactly) and to ReLU neural networks (where things can be approximated).

---

引用前请核对原文;本文由星际流动整理:https://feed.astralor.com/items/itm_ce78875e47ebe787970085e5