Is the relative distance between hand and object predicted?

[buaacyw]

Thanks for your great work! The results are fascinating! And I have some questions.

1. Is the relative distance between hand and object predicted? I want to let robots imitate object-lifting videos to lift objects. So I need the relative distance between hand and object.
2. I haven't seen the object scale parameters for Ho3d in homan/dataset/ho3dconstants.py. But core50 has object scale parameters, such as 0.08 in your colab demo. So how to set the scale parameter for Ho3d?
3. How to obtain the final results of objects and hand pose?

Really nice work, thanks!

[buaacyw]

In https://github.com/hassony2/homan/blob/c421f1830460f931e75dc017e4e2d9f7b199562a/homan/datasets/ho3d.py#L200
scale is set to 1 for all YCB objects. But I have tried to set it to 1 in colab demo code, the result is much worse than 0.08

[binghui-z]

Thanks for your great work! The results are fascinating! And I have some questions.

1. Is the relative distance between hand and object predicted? I want to let robots imitate object-lifting videos to lift objects. So I need the relative distance between hand and object.
2. I haven't seen the object scale parameters for Ho3d in homan/dataset/ho3dconstants.py. But core50 has object scale parameters, such as 0.08 in your colab demo. So how to set the scale parameter for Ho3d?
3. How to obtain the final results of objects and hand pose?

Really nice work, thanks!

hello ,does you meet

Thanks for your great work! The results are fascinating! And I have some questions.

1. Is the relative distance between hand and object predicted? I want to let robots imitate object-lifting videos to lift objects. So I need the relative distance between hand and object.
2. I haven't seen the object scale parameters for Ho3d in homan/dataset/ho3dconstants.py. But core50 has object scale parameters, such as 0.08 in your colab demo. So how to set the scale parameter for Ho3d?
3. How to obtain the final results of objects and hand pose?

Really nice work, thanks!

hello , can you meet " ModuleNotFoundError "that "No module named 'detectron2.projects'" in folder "homan\homan\pointrend.py"? I have installed detectron2-0.2.1 , but I dont't find this module.

[anilesec]

@buaacyw Did you manage to run the demo notebook successfully? I am getting the error https://github.com/hassony2/homan/issues/3#issue-1028295491

Did you also face this error?

[hassony2]

Hi !

Sorry for the late response, let me try to provide some answers:

1. Is the relative distance between hand and object predicted? -> The relative distance can be computed using the computed vertex locations of hands and objects. Would that be satisfying for your use case ?
2. for the ho3d dataset the scale of the object is assumed to be known, so we are using the real results. What do you mean when "the results are much worse in colab", do you mean qualitatively ?
3. How to obtain the final results of objects and hand pose? -> I am not sure I understand the question. Do you mean quantitative results for the HO-3D dataset ?

Best !

Yana