Skip to content

Commit 76d1669

Browse files
committed
Fix missing norm call in Mlp forward (not used by default, but can be enabled for normformer MLP scale). Fix #1851 fix #1852
1 parent 8e4480e commit 76d1669

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

timm/layers/mlp.py

+1
Original file line numberDiff line numberDiff line change
@@ -42,6 +42,7 @@ def forward(self, x):
4242
x = self.fc1(x)
4343
x = self.act(x)
4444
x = self.drop1(x)
45+
x = self.norm(x)
4546
x = self.fc2(x)
4647
x = self.drop2(x)
4748
return x

0 commit comments

Comments
 (0)