馃悰 Describe the bug
https://github.com/CarperAI/trlx/blob/main/trlx/trlx.py#L140
this load function may be called after prepare in
https://github.com/CarperAI/trlx/blob/main/trlx/trainer/accelerate_base_trainer.py#L86
according to
https://huggingface.co/docs/accelerate/usage_guides/checkpoint
this may cause the loading not work actually, such as deepspeed model
Which trlX version are you using?
No response
Additional system and package information
No response
馃悰 Describe the bug
https://github.com/CarperAI/trlx/blob/main/trlx/trlx.py#L140
this
loadfunction may be called afterprepareinhttps://github.com/CarperAI/trlx/blob/main/trlx/trainer/accelerate_base_trainer.py#L86
according to
https://huggingface.co/docs/accelerate/usage_guides/checkpoint
this may cause the loading not work actually, such as deepspeed model
Which trlX version are you using?
No response
Additional system and package information
No response