Overcoming-exploration-from-demos icon indicating copy to clipboard operation
Overcoming-exploration-from-demos copied to clipboard

learning without demo

Open watashihageteru opened this issue 6 years ago • 13 comments

how to learn without demonstration?

watashihageteru avatar Dec 26 '18 08:12 watashihageteru

Hello @watashihageteru this work is based on developing learning algorithms that can leverage the information from demonstrations to speed up the learning process. However if you wish to train your algorithm without the demonstration data you can try to put "num_demonstrations = 0", but I think there are some parts of the code that have to be commented out still.

jangirrishabh avatar May 03 '19 09:05 jangirrishabh

Hello @watashihageteru this work is based on developing learning algorithms that can leverage the information from demonstrations to speed up the learning process. However if you wish to train your algorithm without the demonstration data you can try to put "num_demonstrations = 0", but I think there are some parts of the code that have to be commented out still.

Can you send your files with demonstrations? And please explain how to debug this:

File "/home/khurram/DL_skoltech/Research_hand/HER_overcoming_exploration/experiment/ddpg.py", line 155, in initDemoBuffer demoData = np.load(demoDataFile) File "/home/khurram/.local/lib/python3.6/site-packages/numpy/lib/npyio.py", line 422, in load fid = open(os_fspath(file), "rb") IsADirectoryError: [Errno 21] Is a directory: '/home/khurram/DL_skoltech/'

KhurramPirov avatar May 26 '19 21:05 KhurramPirov

Hello @KhurramPirov I have sent the demo file to your email. About the error I think it's because you are not giving the correct path to the demo .npz file you might want to try something like /home/khurram/DL_skoltech/data_fetch_random_100.npz in the train.py file.

jangirrishabh avatar May 27 '19 09:05 jangirrishabh

You need demoData = np.load(demoDataFile, allow_pickle=True) to get through the errors

jangirrishabh avatar May 28 '19 10:05 jangirrishabh

Hello @jangirrishabh @KhurramPirov , can you share the demo file ?. Thank you.

chaiban avatar Jul 09 '19 14:07 chaiban

Hello @jangirrishabh @KhurramPirov , can you share the demo file ? Thank you

jnyanghit avatar Dec 02 '19 08:12 jnyanghit

Hello @jangirrishabh @KhurramPirov , can you share the demo file ? Thank you

jnyanghit avatar Dec 02 '19 08:12 jnyanghit

Hello, you can generate the demo file by running the python script located in data_generation/fetch_data_generation.py

Check out the file contents for more information, hope it helps

jangirrishabh avatar Dec 02 '19 10:12 jangirrishabh

Oh,I have find it, thanks a lot

jnyanghit avatar Dec 02 '19 11:12 jnyanghit

@jnyanghit Hello! I am a chinese graduate student and reproducing the experiment's results. I want to communicate with you about it. Sorry for any interruption.

Focusssss avatar Dec 23 '19 08:12 Focusssss

Hello @jangirrishabh @KhurramPirov , thanks for sharing the demo file. I need it urgently, please.

Focusssss avatar Dec 23 '19 08:12 Focusssss

@jangirrishabh Hello, how to get the demos of the GazeboWAMemptyEnv-v1

Focusssss avatar Dec 24 '19 13:12 Focusssss

@KhurramPirov @chaiban @jnyanghit Excuse me, how to deal with the env of GazeboWAMemptyEnv-v1? For example, how to get the demo of the env or how to import the env?

Focusssss avatar Dec 24 '19 13:12 Focusssss