ELM

ELM copied to clipboard

Question about the usage of box data

1

How can I get 'data/embodied/BOXQA_train_v3.json' in [this line](https://github.com/OpenDriveLab/ELM/blob/7ae27a2b68509a637141a586796bbd63f8c26fcb/lavis/datasets/datasets/elm_datasets.py#L320) ? What is `self.temporal_length` mean in `lavis/datasets/datasets/elm_datasets.py` ? How can I get `self.traffic_element_dict` in [this line](https://github.com/OpenDriveLab/ELM/blob/7ae27a2b68509a637141a586796bbd63f8c26fcb/lavis/datasets/datasets/elm_datasets.py#L133)? When will you release file used...

fang196

Train detail and GPU hours

1

Great work！ I have some questions to ask you. I would like to know your training details during the pre-train phase, such as the amount of training data and training...

zc-zhao

Question about preprocess of nuscenes dataset

1

In `lavis/datasets/datasets/elm_datasets.py` and `lavis/projects/blip2/train/advqa_t5_elm.yaml`, I found some necessary files that hasn't been mentioned in README. - How to get `bevdetv2-nuscenes_infos_trainval.pkl`? - I've seen `drivelm_train.json` in [this link](https://drive.google.com/drive/folders/1QFBIrKqxjn9lfv31XMC3wVIdaAbpMwDL?usp=sharing) , but how...

fang196

Typo in video_clip_processor.py

3

one typo in tools/video_clip_processor ``` from lavis.datasets.data_utils load_pickle ``` to ``` from lavis.datasets.data_utils import load_pickle ```

pastapeter

When will the model be publicly available?

1

milk-bottle-liyu

I got an error: FileNotFoundError: [Errno 2] No such file or directory: 'data/nuscenes/bevdetv2-nuscenes_infos_train.pkl' 479 def default_drivelm(self, ann_paths): 480 self.annotation = json.load(open(ann_paths[0], "r")) 481 self.data_info = pickle.load(open("data/nuscenes/bevdetv2-nuscenes_infos_val.pkl", "rb"))["infos"] How to get...

CerrieJ

question about datasets

1

1. can I use the nuScenes-v1.0-mini for trainning? 2. 'For a quick verification of the pipeline, we recommend downloading the subset dataset of [DriveLM](https://github.com/OpenDriveLab/DriveLM/blob/main/docs/data_prep_nus.md) and organizing the data in line...

CerrieJ

Question Regarding AttributeError in ELMDataset Class

3

I'm trying to replicate the ELM project, but I've encountered an error. Specifically, in the file elm_datasets.py, I receive the following error: File "/workspace/nkh1szh/ELM/lavis/datasets/datasets/elm_datasets.py", line 402, in __getitem__ tmp_imglist =...

fubai-666

Hi, thanks for the great work! I would like to ask about the training settings on the EGO4D dataset and how am I supposed to modify the json file for...

wyddmw

ELM/lavis/projects/blip2/train/advqa_t5_elm.yaml: annotations: train: storage: 'data/drivelm/train.json' test: storage: 'data/drivelm/val.json' val: storage: 'data/drivelm/val.json'

fubai-666