A visualization of positional embedding and its inner product diagonal P*P^T
. Useful for paper "mimetic initialization".
klgr123 / positional-embedding-vis Goto Github PK
View Code? Open in Web Editor NEWA visualization of positional embedding and its inner product diagonal. Useful for paper "mimetic initialization".