VoxFormer icon indicating copy to clipboard operation
VoxFormer copied to clipboard

evaluate problem

Open a2801603396 opened this issue 1 year ago • 5 comments

When I run test.py, I will report an error: TypeError: string indices must be integers In the following code:

    for result in results:
        !!self.metrics.add_batch(result['y_pred'], result['y_true'])!!
    metric_prefix = f'{result_name}_SemanticKITTI'

In semantic_kitti_dataset_stage2.py and semantic_kitti_dataset_stage1.py. The function is “evaluate”.

Whether it's me testing qpn or voxformer-S, this error occurred in the same location.

a2801603396 avatar May 24 '23 12:05 a2801603396

The first result is a string with the content 'y_ pred’。 Results is a list that alternates between 'y_ pred' and 'y_true'.

a2801603396 avatar May 25 '23 01:05 a2801603396

How much memory did you use during the testing?I ran out of 16GB of memory and the verification set was full of memory.The test set is even more difficult to run.

a2801603396 avatar May 25 '23 06:05 a2801603396

Please follow our tutorial exactly https://github.com/NVlabs/VoxFormer/blob/main/docs/getting_started.md. Thank you!

RoboticsYimingLi avatar May 30 '23 02:05 RoboticsYimingLi

Thank you for your interest in our paper. Please make sure to follow our tutorial exactly and use the dist_test.sh script to obtain evaluation results.

RoboticsYimingLi avatar Jun 11 '23 03:06 RoboticsYimingLi

When I run test.py, I will report an error: TypeError: string indices must be integers In the following code:

    for result in results:
        !!self.metrics.add_batch(result['y_pred'], result['y_true'])!!
    metric_prefix = f'{result_name}_SemanticKITTI'

In semantic_kitti_dataset_stage2.py and semantic_kitti_dataset_stage1.py. The function is “evaluate”.

Whether it's me testing qpn or voxformer-S, this error occurred in the same location.

I also have this problem, it occurs when I was trying to run test with one GPU, I change the dist_test.sh: `CONFIG=$1 CHECKPOINT=$2 PORT=${PORT:-29503}

PYTHONPATH="$(dirname $0)/..":$PYTHONPATH
python -m torch.distributed.launch --master_port=$PORT
$(dirname "$0")/test.py $CONFIG $CHECKPOINT --eval bbox`

Made-Gpt avatar Jan 05 '24 04:01 Made-Gpt