submissions icon indicating copy to clipboard operation
submissions copied to clipboard

[Re] Exploration in Model-based Reinforcement Learning by Empirically Estimating Learning Progress

Open AugustinChrtn opened this issue 1 year ago β€’ 42 comments

Original article: Lopes, M., Lang, T., Toussaint, M., & Oudeyer, P. Y. (2012). Exploration in model-based reinforcement learning by empirically estimating learning progress. Advances in neural information processing systems, 25.

PDF URL: https://github.com/AugustinChrtn/Reproduction/blob/master/article.pdf Metadata URL: https://github.com/AugustinChrtn/Reproduction/blob/master/metadata.yaml Code URL: https://github.com/AugustinChrtn/Reproduction/

Scientific domain: Computational Neuroscience Programming language: Python Suggested editor:

AugustinChrtn avatar May 23 '23 14:05 AugustinChrtn

Thank you for your submission. An editor will be soon assigned. @benoit-girard Can you handle this submission (either editing it or assigning an editor)?

rougier avatar Jun 01 '23 09:06 rougier

Thank you for your answer! @benoit-girard is my PhD supervisor and cannot edit this submission due to conflict of interest.

AugustinChrtn avatar Jun 01 '23 09:06 AugustinChrtn

Oh sorry, I didn't check the authors... @oliviaguest Can you handle this submission (either editing it or assigning an editor)?

rougier avatar Jun 01 '23 09:06 rougier

Yes, I can, @rougier .☺️

oliviaguest avatar Jun 01 '23 13:06 oliviaguest

Thank you @oliviaguest!

AugustinChrtn avatar Jun 01 '23 14:06 AugustinChrtn

πŸ‘‹ Hi @hhihn @kkhetarpal @ghost-nn-machine @MA-Ramirez can any/all of you review this for ReScience C? 😊 Please let me know as soon as possible if you can take this on, I would appreciate that of course, but also be aware I might be harder to reach than usual till next week. Thank you!

oliviaguest avatar Jun 07 '23 06:06 oliviaguest

Dear editors, Dear @rougier, Dear @oliviaguest, Any news from the reviewing process? I wish you all a great summer! Best regards mehdi

MehdiKhamassi avatar Aug 04 '23 10:08 MehdiKhamassi

Hi @MehdiKhamassi I guess August is not the best month to find reviewers. Let's hope we'll find them early September. @oliviaguest Any progress on that?

rougier avatar Aug 24 '23 16:08 rougier

Sorry indeed. It's so slow-going. As you see, nobody even replied above; I'll keep trying. If you have any suggestions, please give them to us. 😊

oliviaguest avatar Aug 26 '23 16:08 oliviaguest

Dear all,

thank you very much for the invitation to review the article. Nonetheless, this time I won’t be able to review it due to time constraints.

All the best

MA-Ramirez avatar Aug 28 '23 08:08 MA-Ramirez

Dear ReScience/submissions

Thank you for the reviewer invitation. Unfortunately, I am unable to commit to this at this point due to several other constraints. Sorry about that. Thanks for understanding.

Kind Regards Khimya

On Mon, Aug 28, 2023 at 1:06β€―AM Alejandra Ramirez @.***> wrote:

Dear all,

thank you very much for the invitation to review the article. Nonetheless, this time I won’t be able to review it due to time constraints.

All the best

β€” Reply to this email directly, view it on GitHub https://github.com/ReScience/submissions/issues/73#issuecomment-1695232567, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABXGQYWVIREACGKTWNCX2BDXXRGSBANCNFSM6AAAAAAYMACVK4 . You are receiving this because you were mentioned.Message ID: @.***>

kkhetarpal avatar Aug 29 '23 02:08 kkhetarpal

@oliviaguest You can try to ask all the reviewers at once to check if someone willing to review.

rougier avatar Sep 11 '23 09:09 rougier

dear @ReScience/reviewers can anybody take this on? 😊

oliviaguest avatar Sep 17 '23 12:09 oliviaguest

@natbprice do you have capacity?

On Sun, Sep 17, 2023 at 08:13 Olivia Guest @.***> wrote:

dear @ReScience/reviewers https://github.com/orgs/ReScience/teams/reviewers can anybody take this on? 😊

β€” Reply to this email directly, view it on GitHub https://github.com/ReScience/submissions/issues/73#issuecomment-1722463601, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACL2TNL4VCKSX2CBK7VSB23X23SQBANCNFSM6AAAAAAYMACVK4 . You are receiving this because you are on a team that was mentioned.Message ID: @.***>

trashbirdecology avatar Sep 17 '23 12:09 trashbirdecology

I would be willing to review this submission. But do note that I might be largely unreachable between Oct 20 to end-November. I can have my initial review submitted prior to this period.

[Edit on Sep 26] As the upcoming weeks are going to be busy, I would no longer be available for review during this period. I can revisit this in December if needed.

appukuttan-shailesh avatar Sep 17 '23 12:09 appukuttan-shailesh

I would be happy to review this. However, we should have a "compute requirements" section as well in the submission process to better understand what resources reviewers might need.

HaoZeke avatar Sep 17 '23 15:09 HaoZeke

@oliviaguest I think you have two potential reviewers.

rougier avatar Oct 13 '23 08:10 rougier

I am sorry for taking so long to check this, I have been unwell. Apologies, to all above.

oliviaguest avatar Oct 29 '23 13:10 oliviaguest

@HaoZeke and @appukuttan-shailesh thank you for offering to review this. Please let me know if you need any help. Please see here for some information: https://rescience.github.io/edit/ ☺️

oliviaguest avatar Oct 29 '23 13:10 oliviaguest

Hi @oliviaguest, As I had updated on my post above, I am currently away and won't be able to take this up prior to December. Also, once back I would be shifting to a new city and therefore might be slow on proceeding with this. I would therefore recommend appointing another reviewer to speed things along. If in case nobody volunteers by December, I will be willing to take it up on my return.

appukuttan-shailesh avatar Oct 29 '23 16:10 appukuttan-shailesh

@appukuttan-shailesh thank you for the heads up.

oliviaguest avatar Nov 20 '23 17:11 oliviaguest

@oliviaguest @appukuttan-shailesh @HaoZeke Happy new year all and gentle reminder for the review. If we can target end of January that would be cool since we'll soon transition to a new website.

rougier avatar Jan 10 '24 08:01 rougier

@rougier, @oliviaguest : I am afraid I won't be able to attend to this in the short term. As mentioned previously I have just moved to take up a new position, and therefore a bit occupied at the moment. It would be best to appoint another reviewer for a faster evaluation.

appukuttan-shailesh avatar Jan 10 '24 09:01 appukuttan-shailesh

@appukuttan-shailesh ok @oliviaguest can you find another reviewer?

rougier avatar Jan 10 '24 13:01 rougier

Dear editors, Dear @rougier, Dear @oliviaguest, Any news from the reviewing process? I wish you all a nice day! Best regards mehdi

MehdiKhamassi avatar Feb 07 '24 15:02 MehdiKhamassi

@HaoZeke Are tou still availabe to review? If so you can start (don't wait for secodn reviewer I mean). If you could do it in two weeks that would wonderful. @oliviaguest Can you find another reviewer or should be broadcast to all reviewers ?

rougier avatar Feb 12 '24 16:02 rougier

@rougier can reviewers be tagged like this @ReScience/reviewers? If so, that's great. Please if anyone has the time and capacity, please let us know. 😊

oliviaguest avatar Feb 13 '24 21:02 oliviaguest

Another solution would be to ask one of ReScience published author if he/she is willing to review.

rougier avatar Feb 19 '24 10:02 rougier

I can review this work, should be able to return the review by the end of March.

mo-arvan avatar Feb 19 '24 15:02 mo-arvan

@mo-arvan Wonderful, thanks.

rougier avatar Feb 19 '24 16:02 rougier