Please hold on while we prepare the code for public share.
Code repository for PowerAttention: Exponentially Scaling of Receptive Fields for Effective Sparse Attention.