yolov7 icon indicating copy to clipboard operation
yolov7 copied to clipboard

Issue with detecting borderless headers

Open KaranBhuva22 opened this issue 5 months ago • 3 comments

Hello @AlexeyAB @WongKinYiu, I tried to fine-tune yolov7 using the yolov7-w6.pt pretrained weights. Overall, the model performs well, although it struggles to detect some borderless table headers despite having borderless table images in the training set.

The observed pattern is that the model accurately predicts some borderless headers within the table but fails to identify several intermediate headers. For instance, if there are 10 headers in the table, the model may successfully predict 4 or 5 headers while overlooking the remaining 5 or 6 headers.

This problem only occurs with borderless headers, model detects bordered headers perfectly.

Model Configurations : Training resolution : 1280 Batch size : 16 Total Images in training : 16K

The following are examples of borderless tables in which the model fails to detect headers.

pt_Parimal Parmar_Ravi Gusani_21 Feb22 _ 100_Thales2-1_601038894728544_generated12_1

pt_Parimal Parmar_Ravi Gusani_23Feb22 _ 127_Vedd6-1_944752235891375_1

pt_Ravi Gusani_Till_26Oct21_To_23Nov21_RaviGusani_13Nov21-97_1 (69)_pdf_2021-12-02_15_47_32_764729_jpg_2022-01-27_11_12_46_885549

images

pt_HiringlinkSep-04-Wecolabpage0

What are the possible ways for improvements ?

KaranBhuva22 avatar Feb 12 '24 13:02 KaranBhuva22

@KaranBhuva22 what is the --conf-thres you used in the above images?

dsbyprateekg avatar Feb 13 '24 09:02 dsbyprateekg

@dsbyprateekg --conf-thresh is 0.7

KaranBhuva22 avatar Feb 13 '24 09:02 KaranBhuva22

@dsbyprateekg --conf-thresh is 0.7

Check with a lower one like 0.5 or default one 0.25.

dsbyprateekg avatar Feb 13 '24 09:02 dsbyprateekg