#LoRA & PEFT

2026

• 08-21 EN

  CARE-LoRA: Fixing LoRA-FA's Frozen-Subspace Problem Without Paying for Full Activations

• 08-21 中

  CARE-LoRA：不用冻结子空间，也能省下 LoRA 的激活内存

• 08-18 EN

  GCPO: Why Some GRPO Updates Quietly Break Your Model, and How to Structurally Forbid Them

• 08-18 中

  GCPO 阅读笔记：为什么某些 GRPO 更新会悄悄搞垮模型，以及如何从结构上禁止它们

• 08-07 EN

  SALT: Subspace-Aligned Centroid-Residual Training for Efficient Ultra-LoRA Serving

• 08-07 中

  SALT 阅读笔记：子空间对齐质心-残差训练如何让超低秩 LoRA 服务成为可能

• 05-22 EN

  DoRA: Weight-Decomposed Low-Rank Adaptation — Technical Review

• 05-22 中

  DoRA：权重分解低秩自适应——用幅度与方向解耦提升 LoRA 学习能力 | 阅读笔记

• 03-13 EN

  LoRA: Fine-Tuning Giant Models with Pocket Change — The Low-Rank Revolution

• 02-19 EN

  AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning — Technical Review