ng-video-lecture
ng-video-lecture copied to clipboard
time series data like BTC price
if we have a time series data like BTC price, then we don't need to do token_embedding
i suppose,
how do we do position_embedding
in this case?
The paper "Attention is all you need", used the below encoding. Take a look, might be useful for you time series.
Paper link: https://arxiv.org/pdf/1706.03762.pdf Section: 3.5 Positional Encoding
