Recommender_system_via_deep_RL icon indicating copy to clipboard operation
Recommender_system_via_deep_RL copied to clipboard

The implemetation of Deep Reinforcement Learning based Recommender System from the paper Deep Reinforcement Learning based Recommendation with Explicit User-Item Interactions Modeling by Liu et al.

Deep Reinforcement Learning based Recommender System in Tensorflow

The implemetation of Deep Reinforcement Learning based Recommender System from the paper Deep Reinforcement Learning based Recommendation with Explicit User-Item Interactions Modeling by Liu et al. Build recommender system with DDPG algorithm. Add state representation module to produce trainable state for RL algorithm from data.

Dataset

MovieLens 1M Datset

unzip ./ml-1m.zip

Procedure

Trying to improve performance of RL based recommender system. The report contains the result of Using the actor network with embedding layer, reducing overestimated Q value, using several pretrained embedding and applying PER.

Result

Please check here - Experiment Report (Korean)


image

  • for evalutation data
    • precision@5 : 0.479, ndcg@5 : 0.471
    • precision@10 : 0.444, ndcg@10 : 0.429

Usage

Training

python train.py

Evalutation

Follow evaluation.ipynb

requirements

tensorflow==2.2.0
scikit-learn==0.23.2
matplotlib==3.3.3

reference

https://github.com/LeejwUniverse/RL_Rainbow_Pytorch

https://github.com/kyunghoon-jung/MacaronRL

https://github.com/pasus/Reinforcement-Learning-Book