regarding the Inter-Pooling Mechanism

[XiaoqiWang]

regarding the Inter-Pooling Mechanism

[StriveZs]

Hi Wang,
this Zander, thanks for your insightful comment and attention about our work.
For Q, K and V generated by the raw Q K V, we adopt two different strategiest to generate each of them .

• First, for Q, we adopt the rerange operation to change the dimension of Q, e.g., [B, C, H ,W] -> [B f^2, C, H/f, W/f], to reserve the information without lossing
• Second, for K and V, after downsampling the spatial dimension by convolution~(e.g. [B, C, H, W] -> [B, C, H/f, W/f]), we adopt the repeat operation to pull the dimension of K and V, e.g. [B, C, H/f, W/f] -> [B f^2, C, H/f, W/f], to increase the information dimension different from Q.

I hope my answer can alleviate your confusion, if you also question, please let me know. THX