habitat-sim icon indicating copy to clipboard operation
habitat-sim copied to clipboard

How to add multiple labels in an object navigation task?

Open TzzzzzzR opened this issue 1 year ago • 0 comments
trafficstars

We are using Habitat v0.2.4 for object navigation tasks using the HM3D dataset. We found that in some scenarios, the real semantic labels of some objects don't exist in the goal list but maybe are synonyms for one of them, resulting in the task failing even though the goal is found. For example, in the figure below, goal of the navigation task is a "couch". The detector detected the couch in the view so the agent stopped. But since the real semantic label of the object in the scene is "sofa" instead of "couch", the task was judged a failure. Therefore, we want to add some real semantic labels of these objects into the goal list of navigation. For example, we want to add both "sofa" and "couch" to the goal list when navigating to "couch", so whether the agent finds "sofa" or "couch", the task can be judged as a success. How should we do it? Thank you for your answer! couch_ObjNav

TzzzzzzR avatar Aug 15 '24 05:08 TzzzzzzR