imitation icon indicating copy to clipboard operation
imitation copied to clipboard

Utilizing Expert Data (.npz) in format of SB3.

Open azafar1991 opened this issue 1 year ago • 5 comments

Is it possible to use the trajectories (.npz) collected as expert response which is compatible for SB3 IRL models. ? I made an env which take user input to move an object in game. I collected the trajectories by providing user input , considering it to be expert response. But i am unable to find an example with which i can utilize that dataset.

azafar1991 avatar Sep 07 '23 13:09 azafar1991

I have the same problem, i have created a PyGame environment using also Gym to collect demonstrations by providing user input but i am not able to use that directly with the imitation implementation.

AdrianPrados avatar Sep 14 '23 07:09 AdrianPrados

I too, plan to use a custom environment and generate trajectories for use as Expert data. It would be great to create a tutorial/example on these lines

Rajesh-Siraskar avatar Nov 17 '23 09:11 Rajesh-Siraskar

@azafar1991 @AdrianPrados @Rajesh-Siraskar Do you find the solution of the problem? Faced with a similar problem.

aPovidlo avatar Mar 26 '24 16:03 aPovidlo

@azafar1991 @AdrianPrados @Rajesh-Siraskar Do you find the solution of the problem? Faced with a similar problem.

Hi Andrey, @aPovidlo :

This is what I have been able to achieve:

  • Use of Imitation Inverse RL Libraries (as a demo integrated with Behavior Cloning algo.)
  • Use of a custom environment that I built for predictive maintenance
  • TensorBoard integration

Rajesh-Siraskar avatar Mar 27 '24 05:03 Rajesh-Siraskar