PaddleSlim icon indicating copy to clipboard operation
PaddleSlim copied to clipboard
verified publisher icon PaddlePaddle

Error compressing picodet_xs model using nas

Open hurun opened this issue 3 years ago • 6 comments

1、env

system：Ubuntu 20 paddle version：paddlepaddle-gpu 2.3.1.post116 paddleslim version：2.3.2 Python verison: 3.7.13

2、run code

cd PaddleSlim-develop/example/auto_compression/detection

python run.py --config_path=./configs/picodet_s_qat_dis.yaml --save_dir='./output/'

3、result ----------- Running Arguments ----------- Distillation: alpha: 1.0 loss: l2 Global: Evaluation: True input_list: ['image', 'scale_factor'] model_dir: ./picodet_s_288_coco_lcnet/ model_filename: model.pdmodel params_filename: model.pdiparams reader_config: ./configs/picodet_reader.yml
Quantization: activation_bits: 8 activation_quantize_type: moving_average_abs_max quantize_op_types: ['conv2d', 'depthwise_conv2d'] use_pact: True weight_bits: 8 TrainConfig: eval_iter: 1000 learning_rate: T_max: 8000 learning_rate: 1e-05 type: CosineAnnealingDecay optimizer_builder: optimizer: type: SGD weight_decay: 4e-05 train_iter: 8000

[08/15 23:15:15] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/12--Group_12_Group_Large_Group_12_Group_Large_Group_12_424_0.xml, x1: 572.0, y1: 561.0, x2: 571.0, y2: 571.0. [08/15 23:15:16] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/10--People_Marching_10_People_Marching_People_Marching_10_People_Marching_People_Marching_10_People_Marching_People_Marching_10_543_0.xml, x1: 572.0, y1: 459.0, x2: 571.0, y2: 470.0. [08/15 23:17:05] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Political_Rally_2_201_0.xml, x1: 572.0, y1: 497.0, x2: 571.0, y2: 507.0. [08/15 23:17:36] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Demonstration_Or_Protest_2_485_0.xml, x1: 572.0, y1: 588.0, x2: 571.0, y2: 596.0. [08/15 23:17:46] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Demonstration_Or_Protest_2_465_0.xml, x1: 572.0, y1: 408.0, x2: 571.0, y2: 414.0. [08/15 23:18:11] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/0--Parade_0_Parade_marchingband_1_502_0.xml, x1: 572.0, y1: 442.0, x2: 571.0, y2: 457.0. [08/15 23:21:53] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/15--Stock_Market_15_Stock_Market_Stock_Market_15_194_0.xml, x1: 572.0, y1: 439.0, x2: 571.0, y2: 444.0. [08/15 23:22:49] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Demonstration_Or_Protest_2_189_0.xml, x1: 572.0, y1: 308.0, x2: 571.0, y2: 316.0. [08/15 23:22:56] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/0--Parade_0_Parade_Parade_0_391_0.xml, x1: 572.0, y1: 300.0, x2: 571.0, y2: 311.0. [08/15 23:24:29] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/44--Aerobics_44_Aerobics_Aerobics_44_926_0.xml, x1: 572.0, y1: 299.0, x2: 571.0, y2: 316.0. [08/15 23:25:10] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Political_Rally_2_330_0.xml, x1: 572.0, y1: 579.0, x2: 571.0, y2: 588.0. [08/15 23:26:27] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/10--People_Marching_10_People_Marching_People_Marching_10_People_Marching_People_Marching_10_88_0.xml, x1: 754.0, y1: 534.0, x2: 754.0, y2: 547.0. [08/15 23:26:46] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/14--Traffic_14_Traffic_Traffic_14_338_0.xml, x1: 572.0, y1: 569.0, x2: 571.0, y2: 581.0. [08/15 23:26:48] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/9--Press_Conference_9_Press_Conference_Press_Conference_9_392_0.xml, x1: 572.0, y1: 255.0, x2: 571.0, y2: 269.0. [08/15 23:26:58] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/12--Group_12_Group_Team_Organized_Group_12_Group_Team_Organized_Group_12_639_0.xml, x1: 572.0, y1: 426.0, x2: 571.0, y2: 431.0. [08/15 23:27:24] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/39--Ice_Skating_39_Ice_Skating_iceskiing_39_325_0.xml, x1: 572.0, y1: 463.0, x2: 571.0, y2: 471.0. [08/15 23:27:49] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/47--Matador_Bullfighter_47_Matador_Bullfighter_matadorbullfighting_47_376_0.xml, x1: 572.0, y1: 360.0, x2: 571.0, y2: 368.0. [08/15 23:28:19] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Demonstration_Or_Protest_2_339_0.xml, x1: 572.0, y1: 580.0, x2: 571.0, y2: 593.0. [08/15 23:28:35] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Demonstration_Or_Protest_2_120_0.xml, x1: 572.0, y1: 458.0, x2: 571.0, y2: 466.0. [08/15 23:28:35] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Demonstration_Or_Protest_2_235_0.xml, x1: 572.0, y1: 313.0, x2: 571.0, y2: 321.0. [08/15 23:31:27] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/16--Award_Ceremony_16_Award_Ceremony_Awards_Ceremony_16_46_0.xml, x1: 572.0, y1: 354.0, x2: 571.0, y2: 362.0. [08/15 23:31:27] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/16--Award_Ceremony_16_Award_Ceremony_Awards_Ceremony_16_46_0.xml, x1: 572.0, y1: 404.0, x2: 571.0, y2: 414.0. [08/15 23:31:43] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/35--Basketball_35_Basketball_basketballgame_ball_35_375_0.xml, x1: 572.0, y1: 258.0, x2: 571.0, y2: 266.0. [08/15 23:33:34] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/17--Ceremony_17_Ceremony_Ceremony_17_717_0.xml, x1: 572.0, y1: 240.0, x2: 571.0, y2: 248.0. [08/15 23:34:01] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/21--Festival_21_Festival_Festival_21_54_0.xml, x1: 572.0, y1: 638.0, x2: 571.0, y2: 648.0. [08/15 23:35:35] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/6--Funeral_6_Funeral_Funeral_6_214_0.xml, x1: 572.0, y1: 280.0, x2: 571.0, y2: 285.0. [08/15 23:37:17] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/mda-kk1vbjriwnkqgu3d__735___0.xml, x1: 486.0, y1: 231.0, x2: 486.0, y2: 250.0. [08/15 23:37:26] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Demonstration_Or_Protest_2_476_0.xml, x1: 572.0, y1: 225.0, x2: 571.0, y2: 234.0.

[08/15 23:37:47] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Demonstrators_2_559_0.xml, x1: 572.0, y1: 354.0, x2: 571.0, y2: 366.0. [08/15 23:38:06] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/0--Parade_0_Parade_Parade_0_514_0.xml, x1: 572.0, y1: 626.0, x2: 571.0, y2: 635.0. [08/15 23:38:15] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/35--Basketball_35_Basketball_basketballgame_ball_35_49_0.xml, x1: 572.0, y1: 690.0, x2: 571.0, y2: 699.0. [08/15 23:38:21] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/mda-mmw9jrdqaiv6iy32__1710___0.xml, x1: 486.0, y1: 181.0, x2: 486.0, y2: 199.0. [08/15 23:39:29] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/46--Jockey_46_Jockey_Jockey_46_182_0.xml, x1: 572.0, y1: 253.0, x2: 571.0, y2: 266.0. [08/15 23:41:31] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/0--Parade_0_Parade_marchingband_1_881_0.xml, x1: 572.0, y1: 337.0, x2: 571.0, y2: 347.0. [08/15 23:41:37] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/7--Cheering_7_Cheering_Cheering_7_548_0.xml, x1: 572.0, y1: 490.0, x2: 571.0, y2: 498.0. [08/15 23:42:58] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/52--Photographers_52_Photographers_photographertakingphoto_52_818_0.xml, x1: 829.0, y1: 591.0, x2: 829.0, y2: 602.0. [08/15 23:43:32] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/9--Press_Conference_9_Press_Conference_Press_Conference_9_28_0.xml, x1: 572.0, y1: 366.0, x2: 571.0, y2: 371.0. [08/15 23:43:39] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/21--Festival_21_Festival_Festival_21_943_0.xml, x1: 572.0, y1: 324.0, x2: 571.0, y2: 333.0. [08/15 23:43:43] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/0--Parade_0_Parade_marchingband_1_465_0.xml, x1: 572.0, y1: 311.0, x2: 571.0, y2: 315.0. [08/15 23:44:17] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/7--Cheering_7_Cheering_Cheering_7_171_0.xml, x1: 572.0, y1: 304.0, x2: 571.0, y2: 321.0. [08/15 23:44:54] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Political_Rally_2_231_0.xml, x1: 830.0, y1: 392.0, x2: 830.0, y2: 415.0. [08/15 23:45:00] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Demonstration_Or_Protest_2_455_0.xml, x1: 572.0, y1: 110.0, x2: 571.0, y2: 124.0. [08/15 23:45:13] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/mda-mmj5a2z2pkxwumw9__5550___0.xml, x1: 486.0, y1: 274.0, x2: 486.0, y2: 292.0. [08/15 23:45:27] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/0--Parade_0_Parade_Parade_0_188_0.xml, x1: 572.0, y1: 428.0, x2: 571.0, y2: 438.0. [08/15 23:46:17] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/21--Festival_21_Festival_Festival_21_833_0.xml, x1: 572.0, y1: 546.0, x2: 571.0, y2: 557.0. [08/15 23:46:36] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Protesters_2_441_0.xml, x1: 572.0, y1: 232.0, x2: 571.0, y2: 249.0. [08/15 23:46:53] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Demonstration_Or_Protest_2_193_0.xml, x1: 572.0, y1: 340.0, x2: 571.0, y2: 350.0. [08/15 23:46:53] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Demonstration_Or_Protest_2_193_0.xml, x1: 572.0, y1: 284.0, x2: 571.0, y2: 289.0. [08/15 23:47:14] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/8--Election_Campain_8_Election_Campain_Election_Campaign_8_349_0.xml, x1: 572.0, y1: 300.0, x2: 571.0, y2: 314.0. [08/15 23:48:14] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Political_Rally_2_609_0.xml, x1: 572.0, y1: 519.0, x2: 571.0, y2: 532.0. [08/15 23:48:29] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/0--Parade_0_Parade_marchingband_1_843_0.xml, x1: 572.0, y1: 357.0, x2: 571.0, y2: 368.0. [08/15 23:48:31] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Political_Rally_2_60_0.xml, x1: 572.0, y1: 476.0, x2: 571.0, y2: 487.0. [08/15 23:48:32] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/18--Concerts_18_Concerts_Concerts_18_989_0.xml, x1: 572.0, y1: 623.0, x2: 571.0, y2: 639.0. [08/15 23:48:32] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/18--Concerts_18_Concerts_Concerts_18_989_0.xml, x1: 572.0, y1: 270.0, x2: 571.0, y2: 281.0. [08/15 23:48:44] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/0--Parade_0_Parade_marchingband_1_691_0.xml, x1: 572.0, y1: 529.0, x2: 571.0, y2: 533.0. [08/15 23:48:45] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/21--Festival_21_Festival_Festival_21_130_0.xml, x1: 572.0, y1: 598.0, x2: 571.0, y2: 607.0. [08/15 23:48:49] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Protesters_2_545_0.xml, x1: 572.0, y1: 516.0, x2: 571.0, y2: 523.0. [08/15 23:48:54] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Demonstration_Or_Protest_2_140_0.xml, x1: 572.0, y1: 479.0, x2: 571.0, y2: 485.0. [08/15 23:48:57] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Demonstration_Or_Protest_2_500_0.xml, x1: 572.0, y1: 345.0, x2: 571.0, y2: 357.0. [08/15 23:49:07] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/44_Aerobics_Aerobics_44_926_0.xml, x1: 572.0, y1: 75.0, x2: 571.0, y2: 91.0. [08/15 23:49:40] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/35--Basketball_35_Basketball_basketballgame_ball_35_479_0.xml, x1: 572.0, y1: 499.0, x2: 571.0, y2: 506.0. [08/15 23:49:40] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/35--Basketball_35_Basketball_basketballgame_ball_35_479_0.xml, x1: 572.0, y1: 458.0, x2: 571.0, y2: 464.0. [08/15 23:49:40] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/35--Basketball_35_Basketball_basketballgame_ball_35_479_0.xml, x1: 572.0, y1: 449.0, x2: 571.0, y2: 453.0. [08/15 23:49:41] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Demonstrators_2_594_0.xml, x1: 572.0, y1: 346.0, x2: 571.0, y2: 360.0. [08/15 23:51:49] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/0--Parade_0_Parade_marchingband_1_337_0.xml, x1: 572.0, y1: 367.0, x2: 571.0, y2: 382.0. [08/15 23:52:21] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/0--Parade_0_Parade_Parade_0_856_0.xml, x1: 572.0, y1: 797.0, x2: 571.0, y2: 805.0. [08/15 23:52:32] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/0--Parade_0_Parade_marchingband_1_17_0.xml, x1: 572.0, y1: 480.0, x2: 571.0, y2: 493.0.

[08/15 23:53:23] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/35--Basketball_35_Basketball_basketballgame_ball_35_82_0.xml, x1: 572.0, y1: 221.0, x2: 571.0, y2: 235.0. [08/15 23:53:33] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Protesters_2_166_0.xml, x1: 572.0, y1: 358.0, x2: 571.0, y2: 374.0. [08/15 23:54:05] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/0--Parade_0_Parade_Parade_0_68_0.xml, x1: 572.0, y1: 559.0, x2: 571.0, y2: 570.0. [08/15 23:54:48] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/46--Jockey_46_Jockey_Jockey_46_877_0.xml, x1: 572.0, y1: 503.0, x2: 571.0, y2: 517.0. [08/15 23:55:00] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/0--Parade_0_Parade_marchingband_1_593_0.xml, x1: 572.0, y1: 528.0, x2: 571.0, y2: 535.0. [08/15 23:55:10] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/000404__3__6420___0.xml, x1: 1019.0, y1: 742.0, x2: 1019.0, y2: 751.0. [08/15 23:55:26] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/14--Traffic_14_Traffic_Traffic_14_9_0.xml, x1: 792.0, y1: 310.0, x2: 792.0, y2: 317.0. [08/15 23:56:13] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/13--Interview_13_Interview_Interview_2_People_Visible_13_69_0.xml, x1: 572.0, y1: 470.0, x2: 571.0, y2: 483.0. [08/15 23:56:33] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Political_Rally_2_509_0.xml, x1: 572.0, y1: 606.0, x2: 571.0, y2: 615.0. [08/15 23:56:46] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/0--Parade_0_Parade_marchingband_1_665_0.xml, x1: 572.0, y1: 376.0, x2: 571.0, y2: 396.0. [08/15 23:57:12] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/12--Group_12_Group_Large_Group_12_Group_Large_Group_12_4_0.xml, x1: 572.0, y1: 367.0, x2: 571.0, y2: 388.0. [08/15 23:59:37] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/PartA_00053_1.xml, x1: 1.0, y1: 105.0, x2: 1.0, y2: 117.0. [08/15 23:59:44] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/test_00003674_0.xml, x1: 392.0, y1: 280.0, x2: 392.0, y2: 317.0. [08/16 00:00:06] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/12--Group_12_Group_Large_Group_12_Group_Large_Group_12_31_0.xml, x1: 572.0, y1: 200.0, x2: 571.0, y2: 211.0. [08/16 00:00:06] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/12--Group_12_Group_Large_Group_12_Group_Large_Group_12_31_0.xml, x1: 572.0, y1: 507.0, x2: 571.0, y2: 520.0. [08/16 00:00:06] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/12--Group_12_Group_Large_Group_12_Group_Large_Group_12_31_0.xml, x1: 572.0, y1: 183.0, x2: 571.0, y2: 189.0. [08/16 00:00:39] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Demonstrators_2_270_0.xml, x1: 572.0, y1: 539.0, x2: 571.0, y2: 561.0. [08/16 00:00:45] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/35--Basketball_35_Basketball_basketballgame_ball_35_250_0.xml, x1: 572.0, y1: 302.0, x2: 571.0, y2: 312.0. [08/16 00:02:40] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Demonstration_Or_Protest_2_258_0.xml, x1: 572.0, y1: 489.0, x2: 571.0, y2: 495.0. [08/16 00:02:40] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Demonstration_Or_Protest_2_258_0.xml, x1: 572.0, y1: 503.0, x2: 571.0, y2: 508.0. [08/16 00:04:13] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/0--Parade_0_Parade_Parade_0_71_0.xml, x1: 572.0, y1: 540.0, x2: 571.0, y2: 554.0. [08/16 00:06:03] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/2--Demonstration_2_Demonstration_Demonstrators_2_40_0.xml, x1: 572.0, y1: 482.0, x2: 571.0, y2: 493.0. [08/16 00:06:39] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/PartA_00053_0.xml, x1: 493.0, y1: 82.0, x2: 493.0, y2: 96.0. [08/16 00:07:07] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/21--Festival_21_Festival_Festival_21_287_0.xml, x1: 572.0, y1: 620.0, x2: 571.0, y2: 633.0. [08/16 00:08:35] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/35--Basketball_35_Basketball_basketballgame_ball_35_526_0.xml, x1: 572.0, y1: 423.0, x2: 571.0, y2: 433.0. [08/16 00:08:56] ppdet.data.source.voc WARNING: Found an invalid bbox in annotations: xml_file: /home/guest/projects/xiaohuan/data_cut/cut_images_all_0802_xml/0--Parade_0_Parade_marchingband_1_541_0.xml, x1: 572.0, y1: 596.0, x2: 571.0, y2: 602.0. W0816 00:09:09.955559 52598 gpu_resources.cc:61] Please NOTE: device: 0, GPU Compute Capability: 8.6, Driver API Version: 11.7, Runtime API Version: 11.2 W0816 00:09:10.153280 52598 gpu_resources.cc:91] device: 0, cuDNN Version: 8.1. Tue Aug 16 00:09:17-WARNING: The old way to load inference model is deprecated. model path: /home/guest/projects/PaddleSlim-develop/example/auto_compression/detection/picodet_s_288_coco_lcnet/model.pdmodel, params path: /home/guest/projects/PaddleSlim-develop/example/auto_compression/detection/picodet_s_288_coco_lcnet/model.pdiparams
2022-08-16 00:09:18,419-INFO: devices: gpu Tue Aug 16 00:09:18-WARNING: The old way to load inference model is deprecated. model path: /home/guest/projects/PaddleSlim-develop/example/auto_compression/detection/picodet_s_288_coco_lcnet/model.pdmodel, params path: /home/guest/projects/PaddleSlim-develop/example/auto_compression/detection/picodet_s_288_coco_lcnet/model.pdiparams
2022-08-16 00:09:21,587-INFO: Detect model type: None Tue Aug 16 00:09:21-WARNING: The old way to load inference model is deprecated. model path: /home/guest/projects/PaddleSlim-develop/example/auto_compression/detection/picodet_s_288_coco_lcnet/model.pdmodel, params path: /home/guest/projects/PaddleSlim-develop/example/auto_compression/detection/picodet_s_288_coco_lcnet/model.pdiparams
2022-08-16 00:09:21,701-INFO: Selected strategies: ['qat_dis'] Tue Aug 16 00:09:21-WARNING: The old way to load inference model is deprecated. model path: /home/guest/projects/PaddleSlim-develop/example/auto_compression/detection/picodet_s_288_coco_lcnet/model.pdmodel, params path: /home/guest/projects/PaddleSlim-develop/example/auto_compression/detection/picodet_s_288_coco_lcnet/model.pdiparams
Tue Aug 16 00:09:24-WARNING: The old way to load inference model is deprecated. model path: /home/guest/projects/PaddleSlim-develop/example/auto_compression/detection/picodet_s_288_coco_lcnet/model.pdmodel, params path: /home/guest/projects/PaddleSlim-develop/example/auto_compression/detection/picodet_s_288_coco_lcnet/model.pdiparams
2022-08-16 00:09:27,435-INFO: train config.distill_node_pair: ['teacher_conv2d_129.tmp_1', 'conv2d_129.tmp_1', 'teacher_conv2d_130.tmp_1', 'conv2d_130.tmp_1', 'teacher_batch_norm_60.tmp_2', 'batch_norm_60.tmp_2', 'teacher_linear_0.tmp_0', 'linear_0.tmp_0', 'teacher_conv2d_137.tmp_1', 'conv2d_137.tmp_1', 'teacher_conv2d_138.tmp_1', 'conv2d_138.tmp_1', 'teacher_batch_norm_67.tmp_2', 'batch_norm_67.tmp_2', 'teacher_linear_1.tmp_0', 'linear_1.tmp_0', 'teacher_conv2d_145.tmp_1', 'conv2d_145.tmp_1', 'teacher_conv2d_146.tmp_1', 'conv2d_146.tmp_1', 'teacher_batch_norm_74.tmp_2', 'batch_norm_74.tmp_2', 'teacher_linear_2.tmp_0', 'linear_2.tmp_0', 'teacher_conv2d_153.tmp_1', 'conv2d_153.tmp_1', 'teacher_conv2d_154.tmp_1', 'conv2d_154.tmp_1', 'teacher_batch_norm_81.tmp_2', 'batch_norm_81.tmp_2', 'teacher_linear_3.tmp_0', 'linear_3.tmp_0']
2022-08-16 00:09:28,168-INFO: quant_aware config {'weight_quantize_type': 'channel_wise_abs_max', 'activation_quantize_type': 'moving_average_abs_max', 'weight_bits': 8, 'activation_bits': 8, 'not_quant_pattern': ['skip_quant'], 'quantize_op_types': ['conv2d', 'depthwise_conv2d'], 'dtype': 'int8', 'window_size': 10000, 'moving_rate': 0.9, 'for_tensorrt': False, 'is_full_quantize': False, 'name': 'Distillation', 'loss': 'l2', 'node': [], 'alpha': 1.0, 'teacher_model_dir': './picodet_s_288_coco_lcnet', 'teacher_model_filename': 'model.pdmodel', 'teacher_params_filename': 'model.pdiparams'} Adding quant op with weight:|██████████████████████████████████████████| 347/347 Adding OutScale op:|███████████████████████████████████████████████████| 337/337 2022-08-16 00:09:32,929-INFO: quant_aware config {'weight_quantize_type': 'channel_wise_abs_max', 'activation_quantize_type': 'moving_average_abs_max', 'weight_bits': 8, 'activation_bits': 8, 'not_quant_pattern': ['skip_quant'], 'quantize_op_types': ['conv2d', 'depthwise_conv2d'], 'dtype': 'int8', 'window_size': 10000, 'moving_rate': 0.9, 'for_tensorrt': False, 'is_full_quantize': False, 'name': 'Distillation', 'loss': 'l2', 'node': [], 'alpha': 1.0, 'teacher_model_dir': './picodet_s_288_coco_lcnet', 'teacher_model_filename': 'model.pdmodel', 'teacher_params_filename': 'model.pdiparams'} Adding quant op with weight:|████████████████████████████████████████| 1966/1966 Adding OutScale op:|█████████████████████████████████████████████████| 1249/1249 2022-08-16 00:13:18,124-INFO: When a preprocess_func is used in quant_aware, Need to save a mapping table to match variable names in the convert phase. 2022-08-16 00:13:18,124-INFO: The mapping table is saved as './mapping_table_for_saving_inference_model'. Traceback (most recent call last): File "run.py", line 188, in main() File "run.py", line 178, in main ac.compress() File "/root/miniconda3/envs/paddle/lib/python3.7/site-packages/paddleslim/auto_compression/compressor.py", line 575, in compress train_config) File "/root/miniconda3/envs/paddle/lib/python3.7/site-packages/paddleslim/auto_compression/compressor.py", line 702, in single_strategy_compress train_program_info, test_program_info, strategy, train_config) File "/root/miniconda3/envs/paddle/lib/python3.7/site-packages/paddleslim/auto_compression/compressor.py", line 714, in _start_train fetch_list=train_program_info.fetch_targets) File "/root/miniconda3/envs/paddle/lib/python3.7/site-packages/paddle/fluid/executor.py", line 1299, in run six.reraise(*sys.exc_info()) File "/root/miniconda3/envs/paddle/lib/python3.7/site-packages/six.py", line 719, in reraise raise value File "/root/miniconda3/envs/paddle/lib/python3.7/site-packages/paddle/fluid/executor.py", line 1295, in run return_merged=return_merged) File "/root/miniconda3/envs/paddle/lib/python3.7/site-packages/paddle/fluid/executor.py", line 1531, in _run_impl return_merged=return_merged) File "/root/miniconda3/envs/paddle/lib/python3.7/site-packages/paddle/fluid/executor.py", line 1049, in _run_parallel var = global_block.var(feed_name) if need_check_feed else None File "/root/miniconda3/envs/paddle/lib/python3.7/site-packages/paddle/fluid/framework.py", line 3358, in var raise ValueError("var %s not in this block" % name) ValueError: var scale_factor not in this block

hurun avatar Aug 16 '22 07:08 hurun

Here is setting file, picodet_s_qat_dis and picodet_reader.

picodet_s_qat_dis.yaml

Global: reader_config: ./configs/picodet_reader.yml input_list: ['image', 'scale_factor'] Evaluation: True model_dir: ./picodet_s_288_coco_lcnet/ model_filename: model.pdmodel params_filename: model.pdiparams

Distillation: alpha: 1.0 loss: l2

Quantization: use_pact: true activation_quantize_type: 'moving_average_abs_max' weight_bits: 8 activation_bits: 8 quantize_op_types:

  • conv2d
  • depthwise_conv2d

TrainConfig: train_iter: 8000 eval_iter: 1000 learning_rate:
type: CosineAnnealingDecay learning_rate: 0.00001 T_max: 8000 optimizer_builder: optimizer: type: SGD weight_decay: 4.0e-05

picodet_reader.yml

metric: VOC map_type: 11point num_classes: 2

TrainDataset: !VOCDataSet dataset_dir: /home/guest/projects/xiaohuan/pad/work_data/cfg_data anno_path: train.txt label_list: classes.txt data_fields: ['image', 'gt_bbox', 'gt_class', 'difficult']

EvalDataset: !VOCDataSet dataset_dir: /home/guest/projects/xiaohuan/pad/work_data/cfg_data anno_path: val.txt label_list: classes.txt data_fields: ['image', 'gt_bbox', 'gt_class', 'difficult']

TestDataset: !ImageFolder anno_path: /home/guest/projects/xiaohuan/pad/work_data/cfg_data/classes.txt

eval_height: &eval_height 288 eval_width: &eval_width 288 eval_size: &eval_size [*eval_height, *eval_width]

worker_num: 0

EvalReader: inputs_def: image_shape: [1, 3, *eval_height, *eval_width] sample_transforms:

  • Decode: {}
  • Resize: {interp: 2, target_size: *eval_size, keep_ratio: False}
  • NormalizeImage: {is_scale: true, mean: [0.485,0.456,0.406], std: [0.229, 0.224,0.225]}
  • Permute: {} batch_size: 1

hurun avatar Aug 16 '22 07:08 hurun

@hurun 你的picodet模型不包含后处理？不包含后处理的话，scale_factor输入不需要，那将

Global:
  input_list: ['image', 'scale_factor']

改为

Global:
  input_list: ['image']

再试下

yghstill avatar Aug 16 '22 11:08 yghstill

@yghstill 已按照提示修改scale_factor，修改后依次出现如下问题，尝试处理但没解决根源问题，还请指点

1、 已将Global改为 Global: input_list: ['image']

程序能正常运行并计算损失（batchsize=1）， 2022-08-17 10:21:19,109-INFO: Total iter: 980, epoch: 0, batch: 980, loss: [9.578232] 2022-08-17 10:21:20,041-INFO: Total iter: 990, epoch: 0, batch: 990, loss: [14.332893]

2、后续程序出现其他报错，报错详情如下 Traceback (most recent call last): File "run.py", line 188, in main() File "run.py", line 178, in main ac.compress() File "/root/miniconda3/envs/paddle/lib/python3.7/site-packages/paddleslim/auto_compression/compressor.py", line 575, in compress train_config) File "/root/miniconda3/envs/paddle/lib/python3.7/site-packages/paddleslim/auto_compression/compressor.py", line 702, in single_strategy_compress train_program_info, test_program_info, strategy, train_config) File "/root/miniconda3/envs/paddle/lib/python3.7/site-packages/paddleslim/auto_compression/compressor.py", line 741, in _start_train test_program_info.fetch_targets) File "run.py", line 114, in eval_function metric.update(data_all, res) File "/root/miniconda3/envs/paddle/lib/python3.7/site-packages/ppdet/metrics/metrics.py", line 239, in update bbox_np = outputs['bbox'].numpy() AttributeError: 'numpy.ndarray' object has no attribute 'numpy'

3、对第2步出现的错误进行尝试修改，修改metrics.py 239行，提前对outputs['bbox']和outputs['bbox_num']判断是否为ndarray类型，改为： if isinstance(outputs['bbox'], np.ndarray): bbox_np = outputs['bbox'] else: bbox_np = outputs['bbox'].numpy()

if isinstance(outputs['bbox_num'], np.ndarray): bbox_lengths = outputs['bbox_num'] else: bbox_lengths = outputs['bbox_num'].numpy()

出现新的错误： File "/root/miniconda3/envs/paddle/lib/python3.7/site-packages/ppdet/metrics/metrics.py", line 254, in update if isinstance(outputs['bbox_num'], np.ndarray): KeyError: 'bbox_num'

4、输出outputs变量详细内容，结果如下： {'bbox': array([[[0.00886565, 0.00773272, 0.00810773, ..., 0.00536475, 0.0044159 , 0.00631363], [0.02975461, 0.0300125 , 0.02498135, ..., 0.0076876 , 0.00814154, 0.00794849]]], dtype=float32)}

outputs变量不存在bbox_num值，至此不知如何修改，还请指点

hurun avatar Aug 17 '22 02:08 hurun

我把出现这个错误的地方都这样判断了，可以训练，但一轮训练完后出现了 **2022-08-17 15:23:27,860-INFO: ==> The ACT compression has been completed and the final model is saved in ./output/ double free or corruption (fasttop)

C++ Traceback (most recent call last):

No stack trace in paddle, may be caused by external reasons.

Error Message Summary:

FatalError: Process abort signal is detected by the operating system. [TimeInfo: *** Aborted at 1660721009 (unix time) try "date -d @1660721009" if you are using GNU date ***] [SignalInfo: *** SIGABRT (@0x3e80001370c) received by PID 79628 (TID 0x7fa2b131b340) from PID 79628 ***]

已放弃 (核心已转储) **

jo-dean avatar Aug 17 '22 07:08 jo-dean

@jo-dean 因为你的PicoDet模型不带后处理，所以无法直接进行eval，所以将AutoCompression中的eval_callback设为False就行，不评估精度。

yghstill avatar Aug 18 '22 03:08 yghstill

设置为None可以了，谢谢。

jo-dean avatar Aug 19 '22 02:08 jo-dean