Skip to content

Commit 51d058c

Browse files
authored
Merge branch 'main' into main
2 parents bb133dd + e547e11 commit 51d058c

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

xtuner/v1/model/moe/moe.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -99,6 +99,7 @@ def free_nongrad_feature(self):
9999
"""
100100
super().free_nongrad_feature()
101101
self.router_logits = None
102+
self.router_weights = None
102103

103104

104105
class MoEBatchForwardInfo(BatchForwardInfo):

0 commit comments

Comments
 (0)