Skip to content

Add adapter.pre_norm: optional norm ahead of the mlp_2layer projection - #212

Merged
amazloumi merged 4 commits into
mainfrom
feat/adapter-pre-norm
Oct 7, 2026
Merged

Add adapter.pre_norm: optional norm ahead of the mlp_2layer projection#212
amazloumi merged 4 commits into
mainfrom
feat/adapter-pre-norm

Re-init the adapter pre-norm through its own reset_parameters; tighte…

82d3005
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch succeeded Oct 7, 2026 in 1s

100.00% of diff hit (target 88.88%)

View this Pull Request on Codecov

100.00% of diff hit (target 88.88%)

View more details on Codecov