미분류

[Transformer] Positional Encoding (작성중)

cape.coder 2024. 1. 6. 21:30

https://machinelearningmastery.com/a-gentle-introduction-to-positional-encoding-in-transformer-models-part-1/

https://www.blossominkyung.com/deeplearning/transfomer-positional-encoding

https://datascience.stackexchange.com/questions/82451/why-is-10000-used-as-the-denominator-in-positional-encodings-in-the-transformer