---
title: "SaMA: Morpho Adaptation via Asymmetric Expansion of Kronecker Product"
source: "arXiv AI/CL/LG（论文）"
source_tier: "t2"
url: "https://arxiv.org/abs/2611.04462v1"
permalink: "https://feed.astralor.com/items/itm_a9b6756429d0b5a8fe046b69"
published: "2026-11-03T07:49:56.000Z"
score: 57
channel: "ai"
tags: ["SaMA","Morpho Adaptation","Asymmetric Expansion","Kronecker Product Low-rank","LoRA","PEFT","However","First"]
---

# SaMA: Morpho Adaptation via Asymmetric Expansion of Kronecker Product

## At a glance

Low-rank adaptation (LoRA) has attracted significant attention in the parameter-efficient fine-tuning (PEFT) landscape. However, its design suffers from two fundamental limitations. First, its invariance manifold induce…

## Key points

- Low-rank adaptation (LoRA) has attracted significant attention in the parameter-efficient fine-tuning (PEFT) landscape.
- However, its design suffers from two fundamental limitations.
- First, its invariance manifold induces flat directions in the loss landscape, creating an optimization bottleneck for adaptive optimizers.

## Full text

Low-rank adaptation (LoRA) has attracted significant attention in the parameter-efficient fine-tuning (PEFT) landscape. However, its design suffers from two fundamental limitations. First, its invariance manifold induces flat directions in the loss landscape, creating an optimization bottleneck for adaptive optimizers. Second, its effective rank scales only linearly with the parameter budget. In this paper, we propose Scalable Morpho Adaptation (SaMA), a PEFT method grounded in a principled generalization of the Kronecker product. By relaxing the shared-block constraint in the perfect-shuffle factorization, SaMA spans from low to full rank and achieves a practical rank that scales quadratically with the parameter budget, up to full-rank. Furthermore, we show that its invariance manifold collapses to a diagonal group, making it structurally more optimizer-friendly. Empirically, SaMA consistently outperforms strong PEFT baselines on commonsense and arithmetic reasoning benchmarks while being more parameter-efficient.

---

Verify against the original before citing; curated by Astral Feed: https://feed.astralor.com/items/itm_a9b6756429d0b5a8fe046b69