Timothy Yu

Results 84 comments of Timothy Yu

EDIT: However, if the `sigma` and `uthreshold` values don't match when reversing the denoising process, **then the reconstructed signal is going to be invalid** - and since there are clearly...

@JannyKul Your comment(s)/criticism of the model design and existing attempts to replicate/implement said model are valid - they do not need retraction. For a streaming/online model, a dynamic `sigma` &...

incomplete/work in progress: https://github.com/timothyyu/wsae-lstm/commit/9c796bf4e46558e5e7e5526dfec9763a286b74a4#diff-3c3d6d5243e1476c8c1f21078c759772R39

this is directly related to #5 a dual-stage approach is probably required due to the nature of the dataset (complex hierarchical time series with numerical features), so a simple transformation...

Copied from #5 (dataset scaling/normalization before wavelet transform): The author of [`DeepLearning_Financial`](https://github.com/mlpanda/DeepLearning_Financial/blob/master/run_training.py) decided to forgo automated scaling/normalization and instead scaled the input features/dataset manually before applying the wavelet transform: https://github.com/mlpanda/DeepLearning_Financial/blob/7e846144629d8b49b8fd74a87d5ff047b7af55d1/run_training.py#L55...

RobustScaler test for `'nifty 50 index data'`: ![image](https://user-images.githubusercontent.com/26447193/53634086-3b4e9280-3be7-11e9-9e5c-d4e3403aba96.png) ![image](https://user-images.githubusercontent.com/26447193/53634239-a8fabe80-3be7-11e9-97ee-f17223ee9de2.png) ![image](https://user-images.githubusercontent.com/26447193/53634105-499cae80-3be7-11e9-82ba-beeb8f78752e.png) ![image](https://user-images.githubusercontent.com/26447193/53634114-50c3bc80-3be7-11e9-9137-0df5f79bdd0d.png) ![image](https://user-images.githubusercontent.com/26447193/53634130-5b7e5180-3be7-11e9-808f-691b5e7132bb.png)

see commit https://github.com/timothyyu/wsae-lstm/commit/8073c426f903611f7ec22043d4b5378054b2904b scaled data and scaled denoised data now saved in data/interim folder: ![image](https://user-images.githubusercontent.com/26447193/53638392-1ad90500-3bf4-11e9-9c7b-c28d49a2c0a7.png) pdf output of train-validate-test split scaled + denoised in reports folder: ![image](https://user-images.githubusercontent.com/26447193/53638421-2af0e480-3bf4-11e9-97af-ed44eddc2df0.png) Excerpt from pdf...

train-validate-test split is showing some questionable output; look into when I get a chance there is the possibility it's a matplotlib/pdf render output issue: https://github.com/timothyyu/wsae-lstm/blob/master/reports/djia%20index%20data%20tvt%20split%20scale%20denoise%20visual.pdf this should not be happening:...

upon closer examination, it appears that the line/feature flatling visually is not technically wrong for the `djia index` dataset: ![image](https://user-images.githubusercontent.com/26447193/53688249-09385000-3d0f-11e9-9352-b8cace69f676.png) ![image](https://user-images.githubusercontent.com/26447193/53688250-0ccbd700-3d0f-11e9-941b-7b483246a054.png) ![image](https://user-images.githubusercontent.com/26447193/53688251-0e959a80-3d0f-11e9-92ab-3590e0ef085c.png) ![image](https://user-images.githubusercontent.com/26447193/53688252-105f5e00-3d0f-11e9-8e3d-312f55964779.png) The values are still there, but `RobustScaler`...

@mg64ve the `subrepos` directory contains `deeplearning_financial` for reference; `wsae_lstm` is the main source location for the code for my implementation. I am using the following directory structure, but with `wsae_lstm`...