OpenViDial icon indicating copy to clipboard operation
OpenViDial copied to clipboard

Published 20 hours ago • verified publisher icon ShannonAI

Results

Open phellonchen opened this issue 4 years ago • 5 comments

Hi, I run your code (FV). I get the gen.out file. The result seems that (Last line in gen.out): Generate test with beam=5: BLEU4 = 0.40, 6.2/0.5/0.1/0.1 (BP=1.000, ratio=2.087, syslen=810940, reflen=388568) Diversity-1: 0.0006535270732838133 Diversity-2: 0.0031576051690483616 Diversity-3: 0.006970750791777929 Diversity-4: 0.010780433006226303 StopWords%: 0.3479316484665542; StopWords/Sent: 5.507739454627082 AvgLength: 15.829946711951749 Are the results correct?

phellonchen avatar Mar 06 '21 03:03 phellonchen

@phellonchen Hi, we found the current cnn/rcnn features for valid/test set is not correct, we will update it soon!

YuxianMeng avatar Mar 06 '21 04:03 YuxianMeng

@phellonchen We updated cnn/rcnn feature of valid/test dataset today! We achieved 0.95/1.14/1.18 BLEU4 for NV/CV/FV, respectively. Other stats are coming soon.

YuxianMeng avatar Mar 12 '21 02:03 YuxianMeng

@YuxianMeng I seems that I also need use new train.objects.mmap.splitao.mmap? And there is no space left on my device. Can I still run normally after I delete origin_dir/train_images?

wjczf123 avatar Mar 15 '21 09:03 wjczf123

@wjczf123 Yes, you're right. Only data in preprocessed_dir are used during training and inference.

YuxianMeng avatar Mar 16 '21 02:03 YuxianMeng

@YuxianMeng OK. Thank you a lot.

wjczf123 avatar Mar 16 '21 09:03 wjczf123