ng-video-lecture icon indicating copy to clipboard operation
ng-video-lecture copied to clipboard

time series data like BTC price

Open tesla-cat opened this issue 1 year ago • 1 comments

if we have a time series data like BTC price, then we don't need to do token_embedding i suppose,

how do we do position_embedding in this case?

tesla-cat avatar Mar 29 '23 16:03 tesla-cat

The paper "Attention is all you need", used the below encoding. Take a look, might be useful for you time series.

Paper link: https://arxiv.org/pdf/1706.03762.pdf Section: 3.5 Positional Encoding

image

mynkpl1998 avatar May 07 '23 06:05 mynkpl1998