FinRL-Trading icon indicating copy to clipboard operation
FinRL-Trading copied to clipboard

What is StockTradingRLEnv.StockEnv for?

Open Pit-Storm opened this issue 4 years ago • 3 comments

HI @BruceYanghy

as you know I'm expanding your work for my masters thesis. And for that, I stepped over the following class:

StockEnv

As far as I scanned over the Code, this Env isn't used anywhere. Can you please explain why this orphan env is there and (more important) you built three different Envs for training validation and trading?

Would be great to hear from you :-)

Kind regards!

Pit-Storm avatar Nov 14 '20 21:11 Pit-Storm

HI @BruceYanghy

as you know I'm expanding your work for my masters thesis. And for that, I stepped over the following class:

StockEnv

As far as I scanned over the Code, this Env isn't used anywhere. Can you please explain why this orphan env is there and (more important) you built three different Envs for training validation and trading?

Would be great to hear from you :-)

Kind regards!

That's not used. I will remove that. Thanks.

BruceYanghy avatar Nov 14 '20 23:11 BruceYanghy

And can you give a hint what the differences between the three used envs are?

I just need a lead to the right direction.

Thank you!

Pit-Storm avatar Nov 15 '20 00:11 Pit-Storm

And can you give a hint what the differences between the three used envs are? I just need a lead to the right direction. Thank you!

Sure.

The 3 used envs are for different purposes: training, validation, trading.

Training v.s. Validation and Trading: turbulence index is used as a risk signal after the actions which are the trading signals generated by the DRL algorithms. Turbulence index should not be included in training.

Validation v.s. Trading: Validation is just for hyperparameter tuning and model selection purposes, trading env has a previous_state parameter because it is quarterly rebalance, the DRL algorithms can't always start from the beginning (initial state is $1,000,000).

BruceYanghy avatar Nov 15 '20 18:11 BruceYanghy