[attention] refactor hip kl#2778

amd-ruitang3 wants to merge 2 commits intomainROCm/aiter:mainfrom

attention_hip_kl_refactorROCm/aiter:attention_hip_kl_refactorCopy head branch name to clipboard