Positional Embedding in Transformer

 

We prove that the summation of positional embedding and word embedding is a specific case of concatenation

Report

Source code

https://github.com/HappyWalkers/ESE546Project.git