Guard the cross-attention FSDP2 wrap for pipeline stage modules - #187

Guard the cross-attention FSDP2 wrap for pipeline stage modules#187

Naeemkh merged 4 commits into

mainKempnerInstitute/KempnerForge:mainfrom

fix/pp-fsdp2-cross-attention-guardKempnerInstitute/KempnerForge:fix/pp-fsdp2-cross-attention-guardCopy head branch name to clipboard