Skip to content

Commit 43a657a

Browse files
authored
add clear_grpah func (#7443)
1 parent 12e4fff commit 43a657a

1 file changed

Lines changed: 4 additions & 0 deletions

File tree

fastdeploy/model_executor/models/glm4_mtp.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -369,3 +369,7 @@ def forward(
369369
)
370370

371371
return hidden_states
372+
373+
def clear_grpah_opt_backend(self):
374+
"""Clear graph optimization backend, the captured cuda graph will be cleaned"""
375+
self.model.clear_grpah_opt_backend(fd_config=self.fd_config)

0 commit comments

Comments
 (0)