TextZoom icon indicating copy to clipboard operation
TextZoom copied to clipboard

The test results are obviously too small

Open clttyou opened this issue 2 years ago • 4 comments

Hello, I am very interested in your work. I refer to the code in your project, first read the picture and label from LMDB format, and then convert the read picture and label to LMDB format. But I test with my own converted LMDB file, (I use /test/medium). Found out that data.mdb is 2x bigger than the data you provided. At the same time, the test accuracy is significantly reduced. Therefore, I suspect that there is something wrong with my conversion process, and I hope to get your help. Medium data and test results provided by you: data.mdb 5624KB {'accuracy': {'medium': 0.2998}, 'psnr_avg': 19.378832, 'ssim_avg': 0.624525, 'fps': 28.96241389504168} I transformed the data and test results myself data.mdb 15324KB {'accuracy': {'medium': 0.0014}, 'psnr_avg': 19.014374, 'ssim_avg': 0.625526, 'fps': 29.325254743748406}

您好,我对您的工作很感兴趣。我参考了您项目中的代码,先从LMDB格式读取图片和label,再将读取到的图片和label转换为LMDB格式。但是我用自己转换后的LMDB文件进行测试,(我使用的是/test/medium)。发现data.mdb比您提供的数据大2倍。同时测试精度明显降低。因此我怀疑自己的转换过程有问题,希望得到您的办帮助。 您提供的medium数据和测试结果: data.mdb 5624KB {'accuracy': {'medium': 0.2998}, 'psnr_avg': 19.378832, 'ssim_avg': 0.624525, 'fps': 28.96241389504168} 我自己转换数据和测试结果 data.mdb 15324KB {'accuracy': {'medium': 0.0014}, 'psnr_avg': 19.014374, 'ssim_avg': 0.625526, 'fps': 29.325254743748406}

clttyou avatar May 16 '22 06:05 clttyou

Obviously there may be something wrong with your code ... Maybe you could use the provided lmdb file for testing :D The accuracy seems okay if using the provided lmdb.

JingyeChen avatar May 24 '22 05:05 JingyeChen

请问您知道论文中的平均准确率是如何计算的吗,我看了文章文章并为提及,也不是通过简单的对easy medium hard 准确率进行平均

fuxjau avatar Jun 05 '22 10:06 fuxjau

根据每个数据集图片数量来的,weighted average

| | @.*** | | @.*** |

---- 回复的原邮件 ---- | 发件人 | @.> | | 日期 | 2022年06月05日 18:59 | | 收件人 | @.> | | 抄送至 | @.***> | | 主题 | Re: [JasonBoy1/TextZoom] The test results are obviously too small (Issue #58) |

请问您知道论文中的平均准确率是如何计算的吗,我看了文章文章并为提及,也不是通过简单的对easy medium hard 准确率进行平均

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you are subscribed to this thread.Message ID: @.***>

WenjiaWang0312 avatar Jun 06 '22 06:06 WenjiaWang0312

@clttyou 您好,我同样遇到了这个问题,我测试的数据是medium,结果也类似,请问您现在解决了吗?

Hello, I am very interested in your work. I refer to the code in your project, first read the picture and label from LMDB format, and then convert the read picture and label to LMDB format. But I test with my own converted LMDB file, (I use /test/medium). Found out that data.mdb is 2x bigger than the data you provided. At the same time, the test accuracy is significantly reduced. Therefore, I suspect that there is something wrong with my conversion process, and I hope to get your help. Medium data and test results provided by you: data.mdb 5624KB {'accuracy': {'medium': 0.2998}, 'psnr_avg': 19.378832, 'ssim_avg': 0.624525, 'fps': 28.96241389504168} I transformed the data and test results myself data.mdb 15324KB {'accuracy': {'medium': 0.0014}, 'psnr_avg': 19.014374, 'ssim_avg': 0.625526, 'fps': 29.325254743748406}

您好,我对您的工作很感兴趣。我参考了您项目中的代码,先从LMDB格式读取图片和label,再将读取到的图片和label转换为LMDB格式。但是我用自己转换后的LMDB文件进行测试,(我使用的是/test/medium)。发现data.mdb比您提供的数据大2倍。同时测试精度明显降低。因此我怀疑自己的转换过程有问题,希望得到您的办帮助。 您提供的medium数据和测试结果: data.mdb 5624KB {'accuracy': {'medium': 0.2998}, 'psnr_avg': 19.378832, 'ssim_avg': 0.624525, 'fps': 28.96241389504168} 我自己转换数据和测试结果 data.mdb 15324KB {'accuracy': {'medium': 0.0014}, 'psnr_avg': 19.014374, 'ssim_avg': 0.625526, 'fps': 29.325254743748406}

E-qin avatar Jun 14 '22 10:06 E-qin