PaddleRec icon indicating copy to clipboard operation
PaddleRec copied to clipboard

为什么训练如此慢,用criteo 20g数据集版本,一直内存才用几G ,一夜也训练不完

Open ArtificialZeng opened this issue 2 years ago • 2 comments

ArtificialZeng avatar Jul 29 '22 05:07 ArtificialZeng

(pp212Clone) G:\rec_projects\rec_efficiency_test\PaddleRec-master\PaddleRec-master\models\rank\xdeepfm>python -u ../../../tools/trainer.py -m config_bigdata.yaml 2022-07-27 13:50:13,095 - INFO - ****common.configs 2022-07-27 13:50:13,095 - INFO - use_gpu: False, use_xpu: False, use_npu: False, use_visual: False, train_batch_size: 512, train_data_dir: G:\nlp_projects\slot_train_data_full\slot_train_data_full, epochs: 1, print_interval: 10, model_save_path: output_model_xdeepfm_all 2022-07-27 13:50:13,096 - INFO - ****common.configs 2022-07-27 13:50:13,776 - INFO - read data 2022-07-27 13:50:13,777 - INFO - reader path:criteo_reader 2022-07-27 13:50:16,205 - INFO - epoch: 0, batch_id: 0, auc:0.474819, avg_reader_cost: 0.02605 sec, avg_batch_cost: 0.24226 sec, avg_samples: 51.20000, ips: 211.33950 ins/s 2022-07-27 13:50:39,607 - INFO - epoch: 0, batch_id: 10, auc:0.494470, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.33920 sec, avg_samples: 512.00000, ips: 218.87824 ins/s 2022-07-27 13:51:05,936 - INFO - epoch: 0, batch_id: 20, auc:0.534758, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.63197 sec, avg_samples: 512.00000, ips: 194.53091 ins/s 2022-07-27 13:51:28,507 - INFO - epoch: 0, batch_id: 30, auc:0.567217, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.25630 sec, avg_samples: 512.00000, ips: 226.92028 ins/s 2022-07-27 13:51:50,877 - INFO - epoch: 0, batch_id: 40, auc:0.587596, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.23614 sec, avg_samples: 512.00000, ips: 228.96626 ins/s 2022-07-27 13:52:12,314 - INFO - epoch: 0, batch_id: 50, auc:0.604557, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.14273 sec, avg_samples: 512.00000, ips: 238.94756 ins/s 2022-07-27 13:52:35,231 - INFO - epoch: 0, batch_id: 60, auc:0.619371, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.29070 sec, avg_samples: 512.00000, ips: 223.51260 ins/s 2022-07-27 13:52:56,272 - INFO - epoch: 0, batch_id: 70, auc:0.632468, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.10296 sec, avg_samples: 512.00000, ips: 243.46667 ins/s 2022-07-27 13:53:16,706 - INFO - epoch: 0, batch_id: 80, auc:0.642682, avg_reader_cost: 0.00039 sec, avg_batch_cost: 2.04276 sec, avg_samples: 512.00000, ips: 250.64070 ins/s 2022-07-27 13:53:37,587 - INFO - epoch: 0, batch_id: 90, auc:0.650421, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.08699 sec, avg_samples: 512.00000, ips: 245.32913 ins/s 2022-07-27 13:53:59,088 - INFO - epoch: 0, batch_id: 100, auc:0.657738, avg_reader_cost: 0.00059 sec, avg_batch_cost: 2.14928 sec, avg_samples: 512.00000, ips: 238.21898 ins/s 2022-07-27 13:54:21,409 - INFO - epoch: 0, batch_id: 110, auc:0.662404, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.23100 sec, avg_samples: 512.00000, ips: 229.49337 ins/s 2022-07-27 13:54:43,864 - INFO - epoch: 0, batch_id: 120, auc:0.667497, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.24473 sec, avg_samples: 512.00000, ips: 228.09025 ins/s 2022-07-27 13:55:04,740 - INFO - epoch: 0, batch_id: 130, auc:0.671880, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.08684 sec, avg_samples: 512.00000, ips: 245.34704 ins/s 2022-07-27 13:55:28,059 - INFO - epoch: 0, batch_id: 140, auc:0.676460, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.33089 sec, avg_samples: 512.00000, ips: 219.65859 ins/s 2022-07-27 13:55:52,185 - INFO - epoch: 0, batch_id: 150, auc:0.679739, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.41179 sec, avg_samples: 512.00000, ips: 212.29051 ins/s 2022-07-27 13:56:13,488 - INFO - epoch: 0, batch_id: 160, auc:0.681754, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.12927 sec, avg_samples: 512.00000, ips: 240.45758 ins/s 2022-07-27 13:56:35,912 - INFO - epoch: 0, batch_id: 170, auc:0.684165, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.24111 sec, avg_samples: 512.00000, ips: 228.45826 ins/s 2022-07-27 13:56:59,465 - INFO - epoch: 0, batch_id: 180, auc:0.686144, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.35452 sec, avg_samples: 512.00000, ips: 217.45424 ins/s 2022-07-27 13:57:21,513 - INFO - epoch: 0, batch_id: 190, auc:0.689399, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.20394 sec, avg_samples: 512.00000, ips: 232.31106 ins/s 2022-07-27 13:57:42,045 - INFO - epoch: 0, batch_id: 200, auc:0.693557, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.05231 sec, avg_samples: 512.00000, ips: 249.47481 ins/s 2022-07-27 13:58:03,279 - INFO - epoch: 0, batch_id: 210, auc:0.696401, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.12275 sec, avg_samples: 512.00000, ips: 241.19609 ins/s 2022-07-27 13:58:25,137 - INFO - epoch: 0, batch_id: 220, auc:0.699398, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.18482 sec, avg_samples: 512.00000, ips: 234.34421 ins/s 2022-07-27 13:58:46,859 - INFO - epoch: 0, batch_id: 230, auc:0.700809, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.17146 sec, avg_samples: 512.00000, ips: 235.78652 ins/s 2022-07-27 13:59:08,177 - INFO - epoch: 0, batch_id: 240, auc:0.702663, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.13103 sec, avg_samples: 512.00000, ips: 240.25983 ins/s 2022-07-27 13:59:31,631 - INFO - epoch: 0, batch_id: 250, auc:0.704773, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.34413 sec, avg_samples: 512.00000, ips: 218.41834 ins/s 2022-07-27 13:59:54,327 - INFO - epoch: 0, batch_id: 260, auc:0.706743, avg_reader_cost: 0.00050 sec, avg_batch_cost: 2.26878 sec, avg_samples: 512.00000, ips: 225.67173 ins/s 2022-07-27 14:00:16,891 - INFO - epoch: 0, batch_id: 270, auc:0.708870, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.25533 sec, avg_samples: 512.00000, ips: 227.01752 ins/s 2022-07-27 14:00:39,851 - INFO - epoch: 0, batch_id: 280, auc:0.710804, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.29473 sec, avg_samples: 512.00000, ips: 223.12036 ins/s 2022-07-27 14:01:02,516 - INFO - epoch: 0, batch_id: 290, auc:0.712436, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.26535 sec, avg_samples: 512.00000, ips: 226.01361 ins/s 2022-07-27 14:01:23,121 - INFO - epoch: 0, batch_id: 300, auc:0.713909, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.05988 sec, avg_samples: 512.00000, ips: 248.55787 ins/s 2022-07-27 14:01:45,711 - INFO - epoch: 0, batch_id: 310, auc:0.715784, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.25781 sec, avg_samples: 512.00000, ips: 226.76846 ins/s 2022-07-27 14:02:07,984 - INFO - epoch: 0, batch_id: 320, auc:0.717341, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.22622 sec, avg_samples: 512.00000, ips: 229.98634 ins/s 2022-07-27 14:02:30,064 - INFO - epoch: 0, batch_id: 330, auc:0.718484, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.20709 sec, avg_samples: 512.00000, ips: 231.97991 ins/s 2022-07-27 14:02:51,786 - INFO - epoch: 0, batch_id: 340, auc:0.719154, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.17095 sec, avg_samples: 512.00000, ips: 235.84124 ins/s 2022-07-27 14:03:13,364 - INFO - epoch: 0, batch_id: 350, auc:0.720345, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.15677 sec, avg_samples: 512.00000, ips: 237.39224 ins/s 2022-07-27 14:03:34,623 - INFO - epoch: 0, batch_id: 360, auc:0.721266, avg_reader_cost: 0.00040 sec, avg_batch_cost: 2.12526 sec, avg_samples: 512.00000, ips: 240.91163 ins/s 2022-07-27 14:03:55,662 - INFO - epoch: 0, batch_id: 370, auc:0.721963, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.10293 sec, avg_samples: 512.00000, ips: 243.46953 ins/s 2022-07-27 14:04:17,073 - INFO - epoch: 0, batch_id: 380, auc:0.722907, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.14006 sec, avg_samples: 512.00000, ips: 239.24519 ins/s 2022-07-27 14:04:39,271 - INFO - epoch: 0, batch_id: 390, auc:0.723863, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.21882 sec, avg_samples: 512.00000, ips: 230.75357 ins/s 2022-07-27 14:05:00,000 - INFO - epoch: 0, batch_id: 400, auc:0.724427, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.07210 sec, avg_samples: 512.00000, ips: 247.09278 ins/s 2022-07-27 14:05:22,574 - INFO - epoch: 0, batch_id: 410, auc:0.725005, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.25611 sec, avg_samples: 512.00000, ips: 226.93947 ins/s 2022-07-27 14:05:43,475 - INFO - epoch: 0, batch_id: 420, auc:0.725615, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.08890 sec, avg_samples: 512.00000, ips: 245.10523 ins/s 2022-07-27 14:06:04,725 - INFO - epoch: 0, batch_id: 430, auc:0.726497, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.12377 sec, avg_samples: 512.00000, ips: 241.08107 ins/s 2022-07-27 14:06:25,811 - INFO - epoch: 0, batch_id: 440, auc:0.727111, avg_reader_cost: 0.00035 sec, avg_batch_cost: 2.10811 sec, avg_samples: 512.00000, ips: 242.87207 ins/s 2022-07-27 14:06:46,900 - INFO - epoch: 0, batch_id: 450, auc:0.727629, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.10816 sec, avg_samples: 512.00000, ips: 242.86611 ins/s 2022-07-27 14:07:07,454 - INFO - epoch: 0, batch_id: 460, auc:0.728375, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.05446 sec, avg_samples: 512.00000, ips: 249.21419 ins/s 2022-07-27 14:07:28,584 - INFO - epoch: 0, batch_id: 470, auc:0.728689, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.11204 sec, avg_samples: 512.00000, ips: 242.41927 ins/s 2022-07-27 14:07:50,689 - INFO - epoch: 0, batch_id: 480, auc:0.729127, avg_reader_cost: 0.00016 sec, avg_batch_cost: 2.20971 sec, avg_samples: 512.00000, ips: 231.70416 ins/s 2022-07-27 14:08:12,060 - INFO - epoch: 0, batch_id: 490, auc:0.729827, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.13600 sec, avg_samples: 512.00000, ips: 239.70050 ins/s 2022-07-27 14:08:33,747 - INFO - epoch: 0, batch_id: 500, auc:0.730009, avg_reader_cost: 0.00040 sec, avg_batch_cost: 2.16791 sec, avg_samples: 512.00000, ips: 236.17166 ins/s 2022-07-27 14:08:54,866 - INFO - epoch: 0, batch_id: 510, auc:0.730176, avg_reader_cost: 0.00035 sec, avg_batch_cost: 2.11096 sec, avg_samples: 512.00000, ips: 242.54392 ins/s 2022-07-27 14:09:15,839 - INFO - epoch: 0, batch_id: 520, auc:0.730615, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.09637 sec, avg_samples: 512.00000, ips: 244.23173 ins/s 2022-07-27 14:09:36,962 - INFO - epoch: 0, batch_id: 530, auc:0.730959, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.11119 sec, avg_samples: 512.00000, ips: 242.51671 ins/s 2022-07-27 14:09:58,303 - INFO - epoch: 0, batch_id: 540, auc:0.731264, avg_reader_cost: 0.00025 sec, avg_batch_cost: 2.13313 sec, avg_samples: 512.00000, ips: 240.02275 ins/s 2022-07-27 14:10:21,921 - INFO - epoch: 0, batch_id: 550, auc:0.731548, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.36094 sec, avg_samples: 512.00000, ips: 216.86321 ins/s 2022-07-27 14:10:44,026 - INFO - epoch: 0, batch_id: 560, auc:0.731857, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.20933 sec, avg_samples: 512.00000, ips: 231.74395 ins/s 2022-07-27 14:11:05,644 - INFO - epoch: 0, batch_id: 570, auc:0.732280, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.16052 sec, avg_samples: 512.00000, ips: 236.98022 ins/s 2022-07-27 14:11:26,468 - INFO - epoch: 0, batch_id: 580, auc:0.732704, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.08125 sec, avg_samples: 512.00000, ips: 246.00657 ins/s 2022-07-27 14:11:47,467 - INFO - epoch: 0, batch_id: 590, auc:0.733174, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.09918 sec, avg_samples: 512.00000, ips: 243.90464 ins/s 2022-07-27 14:12:09,477 - INFO - epoch: 0, batch_id: 600, auc:0.733498, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.20006 sec, avg_samples: 512.00000, ips: 232.72126 ins/s 2022-07-27 14:12:30,868 - INFO - epoch: 0, batch_id: 610, auc:0.733501, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.13802 sec, avg_samples: 512.00000, ips: 239.47367 ins/s 2022-07-27 14:12:51,826 - INFO - epoch: 0, batch_id: 620, auc:0.733805, avg_reader_cost: 0.00025 sec, avg_batch_cost: 2.09500 sec, avg_samples: 512.00000, ips: 244.39129 ins/s 2022-07-27 14:13:13,947 - INFO - epoch: 0, batch_id: 630, auc:0.734407, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.21114 sec, avg_samples: 512.00000, ips: 231.55526 ins/s 2022-07-27 14:13:35,956 - INFO - epoch: 0, batch_id: 640, auc:0.735023, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.20009 sec, avg_samples: 512.00000, ips: 232.71802 ins/s 2022-07-27 14:13:58,914 - INFO - epoch: 0, batch_id: 650, auc:0.735375, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.29466 sec, avg_samples: 512.00000, ips: 223.12639 ins/s 2022-07-27 14:14:19,758 - INFO - epoch: 0, batch_id: 660, auc:0.735544, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.08325 sec, avg_samples: 512.00000, ips: 245.76971 ins/s 2022-07-27 14:14:42,509 - INFO - epoch: 0, batch_id: 670, auc:0.736070, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.27422 sec, avg_samples: 512.00000, ips: 225.13209 ins/s 2022-07-27 14:15:02,912 - INFO - epoch: 0, batch_id: 680, auc:0.736435, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.03927 sec, avg_samples: 512.00000, ips: 251.06967 ins/s 2022-07-27 14:15:25,177 - INFO - epoch: 0, batch_id: 690, auc:0.736829, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.22558 sec, avg_samples: 512.00000, ips: 230.05263 ins/s 2022-07-27 14:15:46,335 - INFO - epoch: 0, batch_id: 700, auc:0.737007, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.11453 sec, avg_samples: 512.00000, ips: 242.13470 ins/s 2022-07-27 14:16:07,590 - INFO - epoch: 0, batch_id: 710, auc:0.737360, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.12424 sec, avg_samples: 512.00000, ips: 241.02691 ins/s 2022-07-27 14:16:28,611 - INFO - epoch: 0, batch_id: 720, auc:0.737616, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.10124 sec, avg_samples: 512.00000, ips: 243.66507 ins/s 2022-07-27 14:16:49,310 - INFO - epoch: 0, batch_id: 730, auc:0.737971, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.06909 sec, avg_samples: 512.00000, ips: 247.45195 ins/s 2022-07-27 14:17:09,998 - INFO - epoch: 0, batch_id: 740, auc:0.738288, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.06796 sec, avg_samples: 512.00000, ips: 247.58752 ins/s 2022-07-27 14:17:32,009 - INFO - epoch: 0, batch_id: 750, auc:0.738606, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.20007 sec, avg_samples: 512.00000, ips: 232.71935 ins/s 2022-07-27 14:17:54,314 - INFO - epoch: 0, batch_id: 760, auc:0.738906, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.22941 sec, avg_samples: 512.00000, ips: 229.65727 ins/s 2022-07-27 14:18:16,886 - INFO - epoch: 0, batch_id: 770, auc:0.739310, avg_reader_cost: 0.00019 sec, avg_batch_cost: 2.25574 sec, avg_samples: 512.00000, ips: 226.97643 ins/s 2022-07-27 14:18:38,933 - INFO - epoch: 0, batch_id: 780, auc:0.739519, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.20361 sec, avg_samples: 512.00000, ips: 232.34631 ins/s 2022-07-27 14:19:00,437 - INFO - epoch: 0, batch_id: 790, auc:0.739574, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.14926 sec, avg_samples: 512.00000, ips: 238.22186 ins/s 2022-07-27 14:19:21,833 - INFO - epoch: 0, batch_id: 800, auc:0.739483, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.13857 sec, avg_samples: 512.00000, ips: 239.41185 ins/s 2022-07-27 14:19:42,095 - INFO - epoch: 0, batch_id: 810, auc:0.739219, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.02527 sec, avg_samples: 512.00000, ips: 252.80604 ins/s 2022-07-27 14:20:03,807 - INFO - epoch: 0, batch_id: 820, auc:0.739252, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.16992 sec, avg_samples: 512.00000, ips: 235.95301 ins/s 2022-07-27 14:20:26,984 - INFO - epoch: 0, batch_id: 830, auc:0.739404, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.31650 sec, avg_samples: 512.00000, ips: 221.02309 ins/s 2022-07-27 14:20:48,948 - INFO - epoch: 0, batch_id: 840, auc:0.739677, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.19516 sec, avg_samples: 512.00000, ips: 233.24015 ins/s 2022-07-27 14:21:11,281 - INFO - epoch: 0, batch_id: 850, auc:0.739825, avg_reader_cost: 0.00015 sec, avg_batch_cost: 2.23226 sec, avg_samples: 512.00000, ips: 229.36369 ins/s 2022-07-27 14:21:33,645 - INFO - epoch: 0, batch_id: 860, auc:0.739978, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.23531 sec, avg_samples: 512.00000, ips: 229.05116 ins/s 2022-07-27 14:21:57,241 - INFO - epoch: 0, batch_id: 870, auc:0.740189, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.35845 sec, avg_samples: 512.00000, ips: 217.09205 ins/s 2022-07-27 14:22:20,973 - INFO - epoch: 0, batch_id: 880, auc:0.740322, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.37236 sec, avg_samples: 512.00000, ips: 215.81898 ins/s 2022-07-27 14:22:44,290 - INFO - epoch: 0, batch_id: 890, auc:0.740506, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.33085 sec, avg_samples: 512.00000, ips: 219.66201 ins/s 2022-07-27 14:23:06,342 - INFO - epoch: 0, batch_id: 900, auc:0.740549, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.20419 sec, avg_samples: 512.00000, ips: 232.28452 ins/s 2022-07-27 14:23:28,286 - INFO - epoch: 0, batch_id: 910, auc:0.740632, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.19331 sec, avg_samples: 512.00000, ips: 233.43661 ins/s 2022-07-27 14:23:51,198 - INFO - epoch: 0, batch_id: 920, auc:0.740836, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.29055 sec, avg_samples: 512.00000, ips: 223.52727 ins/s 2022-07-27 14:24:13,667 - INFO - epoch: 0, batch_id: 930, auc:0.740977, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.24571 sec, avg_samples: 512.00000, ips: 227.99068 ins/s 2022-07-27 14:24:37,503 - INFO - epoch: 0, batch_id: 940, auc:0.741206, avg_reader_cost: 0.00050 sec, avg_batch_cost: 2.38270 sec, avg_samples: 512.00000, ips: 214.88244 ins/s 2022-07-27 14:24:58,624 - INFO - epoch: 0, batch_id: 950, auc:0.741305, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.11081 sec, avg_samples: 512.00000, ips: 242.56096 ins/s 2022-07-27 14:25:21,633 - INFO - epoch: 0, batch_id: 960, auc:0.741627, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.29997 sec, avg_samples: 512.00000, ips: 222.61202 ins/s 2022-07-27 14:25:45,267 - INFO - epoch: 0, batch_id: 970, auc:0.741789, avg_reader_cost: 0.00040 sec, avg_batch_cost: 2.36246 sec, avg_samples: 512.00000, ips: 216.72344 ins/s 2022-07-27 14:26:08,144 - INFO - epoch: 0, batch_id: 980, auc:0.741947, avg_reader_cost: 0.00040 sec, avg_batch_cost: 2.28686 sec, avg_samples: 512.00000, ips: 223.88737 ins/s 2022-07-27 14:26:29,759 - INFO - epoch: 0, batch_id: 990, auc:0.742145, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.16044 sec, avg_samples: 512.00000, ips: 236.98855 ins/s 2022-07-27 14:26:51,399 - INFO - epoch: 0, batch_id: 1000, auc:0.742309, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.16297 sec, avg_samples: 512.00000, ips: 236.71130 ins/s2022-07-27 14:27:12,656 - INFO - epoch: 0, batch_id: 1010, auc:0.742323, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.12474 sec, avg_samples: 512.00000, ips: 240.97033 ins/s2022-07-27 14:27:34,927 - INFO - epoch: 0, batch_id: 1020, auc:0.742499, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.22635 sec, avg_samples: 512.00000, ips: 229.97301 ins/s2022-07-27 14:27:57,001 - INFO - epoch: 0, batch_id: 1030, auc:0.742674, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.20623 sec, avg_samples: 512.00000, ips: 232.07057 ins/s2022-07-27 14:28:20,628 - INFO - epoch: 0, batch_id: 1040, auc:0.743049, avg_reader_cost: 0.00040 sec, avg_batch_cost: 2.36153 sec, avg_samples: 512.00000, ips: 216.80845 ins/s2022-07-27 14:28:42,612 - INFO - epoch: 0, batch_id: 1050, auc:0.743265, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.19690 sec, avg_samples: 512.00000, ips: 233.05606 ins/s2022-07-27 14:29:04,541 - INFO - epoch: 0, batch_id: 1060, auc:0.743475, avg_reader_cost: 0.00009 sec, avg_batch_cost: 2.19195 sec, avg_samples: 512.00000, ips: 233.58151 ins/s2022-07-27 14:29:27,251 - INFO - epoch: 0, batch_id: 1070, auc:0.743649, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.27000 sec, avg_samples: 512.00000, ips: 225.55081 ins/s2022-07-27 14:29:48,569 - INFO - epoch: 0, batch_id: 1080, auc:0.743825, avg_reader_cost: 0.00040 sec, avg_batch_cost: 2.13060 sec, avg_samples: 512.00000, ips: 240.30736 ins/s2022-07-27 14:30:09,015 - INFO - epoch: 0, batch_id: 1090, auc:0.743939, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.04381 sec, avg_samples: 512.00000, ips: 250.51217 ins/s2022-07-27 14:30:29,519 - INFO - epoch: 0, batch_id: 1100, auc:0.744105, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.04947 sec, avg_samples: 512.00000, ips: 249.82064 ins/s2022-07-27 14:30:50,333 - INFO - epoch: 0, batch_id: 1110, auc:0.744366, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.08069 sec, avg_samples: 512.00000, ips: 246.07217 ins/s2022-07-27 14:31:11,997 - INFO - epoch: 0, batch_id: 1120, auc:0.744473, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.16527 sec, avg_samples: 512.00000, ips: 236.45998 ins/s2022-07-27 14:31:33,478 - INFO - epoch: 0, batch_id: 1130, auc:0.744631, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.14716 sec, avg_samples: 512.00000, ips: 238.45468 ins/s2022-07-27 14:31:54,084 - INFO - epoch: 0, batch_id: 1140, auc:0.744760, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.05974 sec, avg_samples: 512.00000, ips: 248.57531 ins/s2022-07-27 14:32:17,010 - INFO - epoch: 0, batch_id: 1150, auc:0.744878, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.29174 sec, avg_samples: 512.00000, ips: 223.41109 ins/s2022-07-27 14:32:39,830 - INFO - epoch: 0, batch_id: 1160, auc:0.744966, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.28122 sec, avg_samples: 512.00000, ips: 224.44093 ins/s2022-07-27 14:33:04,450 - INFO - epoch: 0, batch_id: 1170, auc:0.744929, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.46129 sec, avg_samples: 512.00000, ips: 208.02067 ins/s2022-07-27 14:33:25,450 - INFO - epoch: 0, batch_id: 1180, auc:0.744963, avg_reader_cost: 0.00065 sec, avg_batch_cost: 2.09913 sec, avg_samples: 512.00000, ips: 243.91087 ins/s2022-07-27 14:33:46,232 - INFO - epoch: 0, batch_id: 1190, auc:0.745132, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.07719 sec, avg_samples: 512.00000, ips: 246.48729 ins/s2022-07-27 14:34:07,374 - INFO - epoch: 0, batch_id: 1200, auc:0.745472, avg_reader_cost: 0.00040 sec, avg_batch_cost: 2.11343 sec, avg_samples: 512.00000, ips: 242.25994 ins/s2022-07-27 14:34:29,567 - INFO - epoch: 0, batch_id: 1210, auc:0.745704, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.21827 sec, avg_samples: 512.00000, ips: 230.81017 ins/s2022-07-27 14:34:51,022 - INFO - epoch: 0, batch_id: 1220, auc:0.745899, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.14430 sec, avg_samples: 512.00000, ips: 238.77312 ins/s2022-07-27 14:35:12,628 - INFO - epoch: 0, batch_id: 1230, auc:0.746073, avg_reader_cost: 0.00035 sec, avg_batch_cost: 2.15946 sec, avg_samples: 512.00000, ips: 237.09618 ins/s2022-07-27 14:35:33,625 - INFO - epoch: 0, batch_id: 1240, auc:0.746197, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.09865 sec, avg_samples: 512.00000, ips: 243.96639 ins/s2022-07-27 14:35:55,237 - INFO - epoch: 0, batch_id: 1250, auc:0.746408, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.16014 sec, avg_samples: 512.00000, ips: 237.02116 ins/s2022-07-27 14:36:15,573 - INFO - epoch: 0, batch_id: 1260, auc:0.746568, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.03273 sec, avg_samples: 512.00000, ips: 251.87768 ins/s2022-07-27 14:36:35,323 - INFO - epoch: 0, batch_id: 1270, auc:0.746749, avg_reader_cost: 0.00030 sec, avg_batch_cost: 1.97400 sec, avg_samples: 512.00000, ips: 259.37248 ins/s2022-07-27 14:36:55,488 - INFO - epoch: 0, batch_id: 1280, auc:0.746906, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.01540 sec, avg_samples: 512.00000, ips: 254.04391 ins/s2022-07-27 14:37:17,048 - INFO - epoch: 0, batch_id: 1290, auc:0.747175, avg_reader_cost: 0.00005 sec, avg_batch_cost: 2.15494 sec, avg_samples: 512.00000, ips: 237.59395 ins/s2022-07-27 14:37:36,970 - INFO - epoch: 0, batch_id: 1300, auc:0.747272, avg_reader_cost: 0.00010 sec, avg_batch_cost: 1.99113 sec, avg_samples: 512.00000, ips: 257.14032 ins/s2022-07-27 14:37:57,100 - INFO - epoch: 0, batch_id: 1310, auc:0.747354, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.01150 sec, avg_samples: 512.00000, ips: 254.53633 ins/s2022-07-27 14:38:16,630 - INFO - epoch: 0, batch_id: 1320, auc:0.747478, avg_reader_cost: 0.00020 sec, avg_batch_cost: 1.95178 sec, avg_samples: 512.00000, ips: 262.32416 ins/s2022-07-27 14:38:36,473 - INFO - epoch: 0, batch_id: 1330, auc:0.747704, avg_reader_cost: 0.00010 sec, avg_batch_cost: 1.98319 sec, avg_samples: 512.00000, ips: 258.16931 ins/s2022-07-27 14:38:56,987 - INFO - epoch: 0, batch_id: 1340, auc:0.747765, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.05051 sec, avg_samples: 512.00000, ips: 249.69452 ins/s2022-07-27 14:39:16,883 - INFO - epoch: 0, batch_id: 1350, auc:0.747915, avg_reader_cost: 0.00010 sec, avg_batch_cost: 1.98844 sec, avg_samples: 512.00000, ips: 257.48837 ins/s2022-07-27 14:39:37,136 - INFO - epoch: 0, batch_id: 1360, auc:0.748102, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.02422 sec, avg_samples: 512.00000, ips: 252.93659 ins/s2022-07-27 14:39:57,823 - INFO - epoch: 0, batch_id: 1370, auc:0.748200, avg_reader_cost: 0.00017 sec, avg_batch_cost: 2.06780 sec, avg_samples: 512.00000, ips: 247.60670 ins/s2022-07-27 14:40:18,364 - INFO - epoch: 0, batch_id: 1380, auc:0.748401, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.05265 sec, avg_samples: 512.00000, ips: 249.43335 ins/s2022-07-27 14:40:39,363 - INFO - epoch: 0, batch_id: 1390, auc:0.748447, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.09894 sec, avg_samples: 512.00000, ips: 243.93314 ins/s2022-07-27 14:41:00,112 - INFO - epoch: 0, batch_id: 1400, auc:0.748641, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.07400 sec, avg_samples: 512.00000, ips: 246.86625 ins/s2022-07-27 14:41:21,016 - INFO - epoch: 0, batch_id: 1410, auc:0.748713, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.08943 sec, avg_samples: 512.00000, ips: 245.04276 ins/s2022-07-27 14:41:42,291 - INFO - epoch: 0, batch_id: 1420, auc:0.748890, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.12670 sec, avg_samples: 512.00000, ips: 240.74884 ins/s2022-07-27 14:42:03,848 - INFO - epoch: 0, batch_id: 1430, auc:0.749055, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.15490 sec, avg_samples: 512.00000, ips: 237.59817 ins/s2022-07-27 14:42:25,638 - INFO - epoch: 0, batch_id: 1440, auc:0.749285, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.17780 sec, avg_samples: 512.00000, ips: 235.09988 ins/s2022-07-27 14:42:47,245 - INFO - epoch: 0, batch_id: 1450, auc:0.749414, avg_reader_cost: 0.00049 sec, avg_batch_cost: 2.16001 sec, avg_samples: 512.00000, ips: 237.03589 ins/s2022-07-27 14:43:08,522 - INFO - epoch: 0, batch_id: 1460, auc:0.749609, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.12647 sec, avg_samples: 512.00000, ips: 240.77468 ins/s2022-07-27 14:43:28,820 - INFO - epoch: 0, batch_id: 1470, auc:0.749818, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.02891 sec, avg_samples: 512.00000, ips: 252.35234 ins/s2022-07-27 14:43:51,138 - INFO - epoch: 0, batch_id: 1480, auc:0.750021, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.23049 sec, avg_samples: 512.00000, ips: 229.54586 ins/s2022-07-27 14:44:12,704 - INFO - epoch: 0, batch_id: 1490, auc:0.750183, avg_reader_cost: 0.00040 sec, avg_batch_cost: 2.15561 sec, avg_samples: 512.00000, ips: 237.52003 ins/s2022-07-27 14:44:33,702 - INFO - epoch: 0, batch_id: 1500, auc:0.750290, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.09880 sec, avg_samples: 512.00000, ips: 243.94866 ins/s2022-07-27 14:44:54,305 - INFO - epoch: 0, batch_id: 1510, auc:0.750465, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.05934 sec, avg_samples: 512.00000, ips: 248.62364 ins/s2022-07-27 14:45:14,998 - INFO - epoch: 0, batch_id: 1520, auc:0.750719, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.06824 sec, avg_samples: 512.00000, ips: 247.55348 ins/s2022-07-27 14:45:36,648 - INFO - epoch: 0, batch_id: 1530, auc:0.750848, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.16389 sec, avg_samples: 512.00000, ips: 236.61076 ins/s2022-07-27 14:45:58,702 - INFO - epoch: 0, batch_id: 1540, auc:0.750938, avg_reader_cost: 0.00031 sec, avg_batch_cost: 2.20447 sec, avg_samples: 512.00000, ips: 232.25566 ins/s2022-07-27 14:46:21,445 - INFO - epoch: 0, batch_id: 1550, auc:0.751105, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.27331 sec, avg_samples: 512.00000, ips: 225.22250 ins/s2022-07-27 14:46:44,285 - INFO - epoch: 0, batch_id: 1560, auc:0.751289, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.28334 sec, avg_samples: 512.00000, ips: 224.23329 ins/s2022-07-27 14:47:07,295 - INFO - epoch: 0, batch_id: 1570, auc:0.751393, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.30012 sec, avg_samples: 512.00000, ips: 222.59691 ins/s2022-07-27 14:47:30,780 - INFO - epoch: 0, batch_id: 1580, auc:0.751562, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.34737 sec, avg_samples: 512.00000, ips: 218.11662 ins/s2022-07-27 14:47:53,890 - INFO - epoch: 0, batch_id: 1590, auc:0.751638, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.31038 sec, avg_samples: 512.00000, ips: 221.60823 ins/s2022-07-27 14:48:16,731 - INFO - epoch: 0, batch_id: 1600, auc:0.751725, avg_reader_cost: 0.00025 sec, avg_batch_cost: 2.28366 sec, avg_samples: 512.00000, ips: 224.20122 ins/s2022-07-27 14:48:40,187 - INFO - epoch: 0, batch_id: 1610, auc:0.751848, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.34441 sec, avg_samples: 512.00000, ips: 218.39163 ins/s2022-07-27 14:49:03,868 - INFO - epoch: 0, batch_id: 1620, auc:0.751911, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.36710 sec, avg_samples: 512.00000, ips: 216.29873 ins/s2022-07-27 14:49:27,304 - INFO - epoch: 0, batch_id: 1630, auc:0.752045, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.34289 sec, avg_samples: 512.00000, ips: 218.53372 ins/s2022-07-27 14:49:50,426 - INFO - epoch: 0, batch_id: 1640, auc:0.752210, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.31135 sec, avg_samples: 512.00000, ips: 221.51591 ins/s2022-07-27 14:50:13,787 - INFO - epoch: 0, batch_id: 1650, auc:0.752332, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.33567 sec, avg_samples: 512.00000, ips: 219.20904 ins/s2022-07-27 14:50:37,530 - INFO - epoch: 0, batch_id: 1660, auc:0.752489, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.37335 sec, avg_samples: 512.00000, ips: 215.72854 ins/s2022-07-27 14:51:01,413 - INFO - epoch: 0, batch_id: 1670, auc:0.752618, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.38716 sec, avg_samples: 512.00000, ips: 214.48102 ins/s2022-07-27 14:51:24,869 - INFO - epoch: 0, batch_id: 1680, auc:0.752764, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.34487 sec, avg_samples: 512.00000, ips: 218.34927 ins/s2022-07-27 14:51:48,209 - INFO - epoch: 0, batch_id: 1690, auc:0.752952, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.33289 sec, avg_samples: 512.00000, ips: 219.47017 ins/s2022-07-27 14:52:11,532 - INFO - epoch: 0, batch_id: 1700, auc:0.753143, avg_reader_cost: 0.00010 sec, avg_batch_cost: 2.33132 sec, avg_samples: 512.00000, ips: 219.61786 ins/s2022-07-27 14:52:35,898 - INFO - epoch: 0, batch_id: 1710, auc:0.753220, avg_reader_cost: 0.00030 sec, avg_batch_cost: 2.43603 sec, avg_samples: 512.00000, ips: 210.17767 ins/s2022-07-27 14:53:00,159 - INFO - epoch: 0, batch_id: 1720, auc:0.753279, avg_reader_cost: 0.00000 sec, avg_batch_cost: 2.42520 sec, avg_samples: 512.00000, ips: 211.11699 ins/s2022-07-27 14:53:24,093 - INFO - epoch: 0, batch_id: 1730, auc:0.753430, avg_reader_cost: 0.00020 sec, avg_batch_cost: 2.39227 sec, avg_samples: 512.00000, ips: 214.02285 ins/s2022-07-27 14:55:17,770 - INFO - epoch: 0, batch_id: 1740, auc:0.753574, avg_reader_cost: 0.00059 sec, avg_batch_cost: 11.36456 sec, avg_samples: 512.00000, ips: 45.05234 ins/s2022-07-27 15:01:02,254 - INFO - epoch: 0, batch_id: 1750, auc:0.753745, avg_reader_cost: 0.00394 sec, avg_batch_cost: 34.43787 sec, avg_samples: 512.00000, ips: 14.86735 ins/s2022-07-27 15:06:34,735 - INFO - epoch: 0, batch_id: 1760, auc:0.753873, avg_reader_cost: 0.00120 sec, avg_batch_cost: 33.24192 sec, avg_samples: 512.00000, ips: 15.40224 ins/s2022-07-27 15:12:09,694 - INFO - epoch: 0, batch_id: 1770, auc:0.754017, avg_reader_cost: 0.00110 sec, avg_batch_cost: 33.48353 sec, avg_samples: 512.00000, ips: 15.29110 ins/s2022-07-27 15:17:42,070 - INFO - epoch: 0, batch_id: 1780, auc:0.754126, avg_reader_cost: 0.00140 sec, avg_batch_cost: 33.22663 sec, avg_samples: 512.00000, ips: 15.40933 ins/s2022-07-27 15:23:38,037 - INFO - epoch: 0, batch_id: 1790, auc:0.754310, avg_reader_cost: 0.00090 sec, avg_batch_cost: 35.58945 sec, avg_samples: 512.00000, ips: 14.38628 ins/s2022-07-27 15:29:27,578 - INFO - epoch: 0, batch_id: 1800, auc:0.754492, avg_reader_cost: 0.00120 sec, avg_batch_cost: 34.94794 sec, avg_samples: 512.00000, ips: 14.65036 ins/s2022-07-27 15:34:21,960 - INFO - epoch: 0, batch_id: 1810, auc:0.754583, avg_reader_cost: 0.00259 sec, avg_batch_cost: 29.42681 sec, avg_samples: 512.00000, ips: 17.39910 ins/s2022-07-27 15:39:12,372 - INFO - epoch: 0, batch_id: 1820, auc:0.754662, avg_reader_cost: 0.00282 sec, avg_batch_cost: 29.03190 sec, avg_samples: 512.00000, ips: 17.63578 ins/s2022-07-27 15:44:05,157 - INFO - epoch: 0, batch_id: 1830, auc:0.754778, avg_reader_cost: 0.00150 sec, avg_batch_cost: 29.26998 sec, avg_samples: 512.00000, ips: 17.49232 ins/s2022-07-27 15:49:00,694 - INFO - epoch: 0, batch_id: 1840, auc:0.754924, avg_reader_cost: 0.00160 sec, avg_batch_cost: 29.54055 sec, avg_samples: 512.00000, ips: 17.33211 ins/s2022-07-27 15:53:53,459 - INFO - epoch: 0, batch_id: 1850, auc:0.755002, avg_reader_cost: 0.00180 sec, avg_batch_cost: 29.26493 sec, avg_samples: 512.00000, ips: 17.49535 ins/s2022-07-27 15:58:49,959 - INFO - epoch: 0, batch_id: 1860, auc:0.755132, avg_reader_cost: 0.00110 sec, avg_batch_cost: 29.64414 sec, avg_samples: 512.00000, ips: 17.27154 ins/s2022-07-27 16:03:38,030 - INFO - epoch: 0, batch_id: 1870, auc:0.755168, avg_reader_cost: 0.00339 sec, avg_batch_cost: 28.79698 sec, avg_samples: 512.00000, ips: 17.77964 ins/s2022-07-27 16:08:21,462 - INFO - epoch: 0, batch_id: 1880, auc:0.755154, avg_reader_cost: 0.00773 sec, avg_batch_cost: 28.33613 sec, avg_samples: 512.00000, ips: 18.06880 ins/s2022-07-27 16:13:15,008 - INFO - epoch: 0, batch_id: 1890, auc:0.755276, avg_reader_cost: 0.00279 sec, avg_batch_cost: 29.34700 sec, avg_samples: 512.00000, ips: 17.44641 ins/s2022-07-27 16:18:01,256 - INFO - epoch: 0, batch_id: 1900, auc:0.755382, avg_reader_cost: 0.00100 sec, avg_batch_cost: 28.61011 sec, avg_samples: 512.00000, ips: 17.89577 ins/s2022-07-27 16:23:00,905 - INFO - epoch: 0, batch_id: 1910, auc:0.755474, avg_reader_cost: 0.00130 sec, avg_batch_cost: 29.95007 sec, avg_samples: 512.00000, ips: 17.09512 ins/s2022-07-27 16:28:02,365 - INFO - epoch: 0, batch_id: 1920, auc:0.755597, avg_reader_cost: 0.00389 sec, avg_batch_cost: 30.13736 sec, avg_samples: 512.00000, ips: 16.98888 ins/s2022-07-27 16:33:02,072 - INFO - epoch: 0, batch_id: 1930, auc:0.755726, avg_reader_cost: 0.00169 sec, avg_batch_cost: 29.95469 sec, avg_samples: 512.00000, ips: 17.09248 ins/s2022-07-27 16:37:59,427 - INFO - epoch: 0, batch_id: 1940, auc:0.755924, avg_reader_cost: 0.00080 sec, avg_batch_cost: 29.72888 sec, avg_samples: 512.00000, ips: 17.22231 ins/s2022-07-27 16:42:50,182 - INFO - epoch: 0, batch_id: 1950, auc:0.756055, avg_reader_cost: 0.00110 sec, avg_batch_cost: 29.06999 sec, avg_samples: 512.00000, ips: 17.61266 ins/s2022-07-27 16:47:35,191 - INFO - epoch: 0, batch_id: 1960, auc:0.756220, avg_reader_cost: 0.00265 sec, avg_batch_cost: 28.49106 sec, avg_samples: 512.00000, ips: 17.97055 ins/s2022-07-27 16:52:44,713 - INFO - epoch: 0, batch_id: 1970, auc:0.756354, avg_reader_cost: 0.00194 sec, avg_batch_cost: 30.93360 sec, avg_samples: 512.00000, ips: 16.55158 ins/s2022-07-27 16:57:49,858 - INFO - epoch: 0, batch_id: 1980, auc:0.756503, avg_reader_cost: 0.00175 sec, avg_batch_cost: 30.50297 sec, avg_samples: 512.00000, ips: 16.78525 ins/s2022-07-27 17:02:35,207 - INFO - epoch: 0, batch_id: 1990, auc:0.756634, avg_reader_cost: 0.00090 sec, avg_batch_cost: 28.52881 sec, avg_samples: 512.00000, ips: 17.94677 ins/s2022-07-27 17:07:26,163 - INFO - epoch: 0, batch_id: 2000, auc:0.756766, avg_reader_cost: 0.00170 sec, avg_batch_cost: 29.08770 sec, avg_samples: 512.00000, ips: 17.60194 ins/s2022-07-27 17:12:16,373 - INFO - epoch: 0, batch_id: 2010, auc:0.756864, avg_reader_cost: 0.00289 sec, avg_batch_cost: 29.01027 sec, avg_samples: 512.00000, ips: 17.64892 ins/s2022-07-27 17:16:58,455 - INFO - epoch: 0, batch_id: 2020, auc:0.756958, avg_reader_cost: 0.00414 sec, avg_batch_cost: 28.19813 sec, avg_samples: 512.00000, ips: 18.15723 ins/s2022-07-27 17:21:33,075 - INFO - epoch: 0, batch_id: 2030, auc:0.757044, avg_reader_cost: 0.00269 sec, avg_batch_cost: 27.45037 sec, avg_samples: 512.00000, ips: 18.65184 ins/s2022-07-27 17:26:10,434 - INFO - epoch: 0, batch_id: 2040, auc:0.757197, avg_reader_cost: 0.00140 sec, avg_batch_cost: 27.72454 sec, avg_samples: 512.00000, ips: 18.46740 ins/s2022-07-27 17:30:45,245 - INFO - epoch: 0, batch_id: 2050, auc:0.757213, avg_reader_cost: 0.00160 sec, avg_batch_cost: 27.46749 sec, avg_samples: 512.00000, ips: 18.64022 ins/s2022-07-27 17:35:17,748 - INFO - epoch: 0, batch_id: 2060, auc:0.757323, avg_reader_cost: 0.00110 sec, avg_batch_cost: 27.23837 sec, avg_samples: 512.00000, ips: 18.79701 ins/s2022-07-27 17:39:57,589 - INFO - epoch: 0, batch_id: 2070, auc:0.757447, avg_reader_cost: 0.00095 sec, avg_batch_cost: 27.97548 sec, avg_samples: 512.00000, ips: 18.30174 ins/s2022-07-27 17:44:38,114 - INFO - epoch: 0, batch_id: 2080, auc:0.757527, avg_reader_cost: 0.00289 sec, avg_batch_cost: 28.04424 sec, avg_samples: 512.00000, ips: 18.25687 ins/s2022-07-27 17:49:34,242 - INFO - epoch: 0, batch_id: 2090, auc:0.757613, avg_reader_cost: 0.00150 sec, avg_batch_cost: 29.59877 sec, avg_samples: 512.00000, ips: 17.29801 ins/s2022-07-27 17:54:26,447 - INFO - epoch: 0, batch_id: 2100, auc:0.757705, avg_reader_cost: 0.00170 sec, avg_batch_cost: 29.21119 sec, avg_samples: 512.00000, ips: 17.52753 ins/s2022-07-27 17:59:08,963 - INFO - epoch: 0, batch_id: 2110, auc:0.757712, avg_reader_cost: 0.00314 sec, avg_batch_cost: 28.24374 sec, avg_samples: 512.00000, ips: 18.12791 ins/s2022-07-27 18:03:55,226 - INFO - epoch: 0, batch_id: 2120, auc:0.757855, avg_reader_cost: 0.00140 sec, avg_batch_cost: 28.61813 sec, avg_samples: 512.00000, ips: 17.89076 ins/s2022-07-27 18:08:34,168 - INFO - epoch: 0, batch_id: 2130, auc:0.757965, avg_reader_cost: 0.00140 sec, avg_batch_cost: 27.88596 sec, avg_samples: 512.00000, ips: 18.36049 ins/s2022-07-27 18:13:10,737 - INFO - epoch: 0, batch_id: 2140, auc:0.758111, avg_reader_cost: 0.00119 sec, avg_batch_cost: 27.64741 sec, avg_samples: 512.00000, ips: 18.51892 ins/s2022-07-27 18:17:45,536 - INFO - epoch: 0, batch_id: 2150, auc:0.758151, avg_reader_cost: 0.00150 sec, avg_batch_cost: 27.46898 sec, avg_samples: 512.00000, ips: 18.63921 ins/s2022-07-27 18:22:24,365 - INFO - epoch: 0, batch_id: 2160, auc:0.758175, avg_reader_cost: 0.00135 sec, avg_batch_cost: 27.87297 sec, avg_samples: 512.00000, ips: 18.36905 ins/s2022-07-27 18:27:05,717 - INFO - epoch: 0, batch_id: 2170, auc:0.758247, avg_reader_cost: 0.00095 sec, avg_batch_cost: 28.12298 sec, avg_samples: 512.00000, ips: 18.20575 ins/s2022-07-27 18:31:52,265 - INFO - epoch: 0, batch_id: 2180, auc:0.758330, avg_reader_cost: 0.00150 sec, avg_batch_cost: 28.64137 sec, avg_samples: 512.00000, ips: 17.87624 ins/s2022-07-27 18:36:37,349 - INFO - epoch: 0, batch_id: 2190, auc:0.758431, avg_reader_cost: 0.00150 sec, avg_batch_cost: 28.49977 sec, avg_samples: 512.00000, ips: 17.96506 ins/s2022-07-27 18:41:26,944 - INFO - epoch: 0, batch_id: 2200, auc:0.758410, avg_reader_cost: 0.00259 sec, avg_batch_cost: 28.94640 sec, avg_samples: 512.00000, ips: 17.68787 ins/s2022-07-27 18:46:12,881 - INFO - epoch: 0, batch_id: 2210, auc:0.758514, avg_reader_cost: 0.00972 sec, avg_batch_cost: 28.58699 sec, avg_samples: 512.00000, ips: 17.91024 ins/s2022-07-27 18:51:00,756 - INFO - epoch: 0, batch_id: 2220, auc:0.758626, avg_reader_cost: 0.00110 sec, avg_batch_cost: 28.77394 sec, avg_samples: 512.00000, ips: 17.79388 ins/s2022-07-27 18:55:47,539 - INFO - epoch: 0, batch_id: 2230, auc:0.758690, avg_reader_cost: 0.00519 sec, avg_batch_cost: 28.66443 sec, avg_samples: 512.00000, ips: 17.86186 ins/s2022-07-27 19:00:51,240 - INFO - epoch: 0, batch_id: 2240, auc:0.758795, avg_reader_cost: 0.00160 sec, avg_batch_cost: 30.35898 sec, avg_samples: 512.00000, ips: 16.86486 ins/s2022-07-27 19:05:57,967 - INFO - epoch: 0, batch_id: 2250, auc:0.758843, avg_reader_cost: 0.00160 sec, avg_batch_cost: 30.66107 sec, avg_samples: 512.00000, ips: 16.69870 ins/s2022-07-27 19:11:17,161 - INFO - epoch: 0, batch_id: 2260, auc:0.758906, avg_reader_cost: 0.00185 sec, avg_batch_cost: 31.90304 sec, avg_samples: 512.00000, ips: 16.04863 ins/s2022-07-27 19:16:20,582 - INFO - epoch: 0, batch_id: 2270, auc:0.758939, avg_reader_cost: 0.00120 sec, avg_batch_cost: 30.32462 sec, avg_samples: 512.00000, ips: 16.88397 ins/s2022-07-27 19:21:13,888 - INFO - epoch: 0, batch_id: 2280, auc:0.758986, avg_reader_cost: 0.00269 sec, avg_batch_cost: 29.31493 sec, avg_samples: 512.00000, ips: 17.46551 ins/s2022-07-27 19:25:49,776 - INFO - epoch: 0, batch_id: 2290, auc:0.759100, avg_reader_cost: 0.00156 sec, avg_batch_cost: 27.58169 sec, avg_samples: 512.00000, ips: 18.56304 ins/s2022-07-27 19:30:09,119 - INFO - epoch: 0, batch_id: 2300, auc:0.759116, avg_reader_cost: 0.00144 sec, avg_batch_cost: 25.92679 sec, avg_samples: 512.00000, ips: 19.74791 ins/s2022-07-27 19:34:56,516 - INFO - epoch: 0, batch_id: 2310, auc:0.759241, avg_reader_cost: 0.00170 sec, avg_batch_cost: 28.73073 sec, avg_samples: 512.00000, ips: 17.82064 ins/s2022-07-27 19:39:41,696 - INFO - epoch: 0, batch_id: 2320, auc:0.759286, avg_reader_cost: 0.00319 sec, avg_batch_cost: 28.50904 sec, avg_samples: 512.00000, ips: 17.95921 ins/s2022-07-27 19:44:29,956 - INFO - epoch: 0, batch_id: 2330, auc:0.759330, avg_reader_cost: 0.00110 sec, avg_batch_cost: 28.81921 sec, avg_samples: 512.00000, ips: 17.76593 ins/s2022-07-27 19:49:42,531 - INFO - epoch: 0, batch_id: 2340, auc:0.759392, avg_reader_cost: 0.00259 sec, avg_batch_cost: 31.24927 sec, avg_samples: 512.00000, ips: 16.38438 ins/s2022-07-27 19:54:57,903 - INFO - epoch: 0, batch_id: 2350, auc:0.759444, avg_reader_cost: 0.00169 sec, avg_batch_cost: 31.52589 sec, avg_samples: 512.00000, ips: 16.24062 ins/s2022-07-27 20:00:11,793 - INFO - epoch: 0, batch_id: 2360, auc:0.759553, avg_reader_cost: 0.00150 sec, avg_batch_cost: 31.38004 sec, avg_samples: 512.00000, ips: 16.31610 ins/s2022-07-27 20:05:52,109 - INFO - epoch: 0, batch_id: 2370, auc:0.759638, avg_reader_cost: 0.00390 sec, avg_batch_cost: 34.02122 sec, avg_samples: 512.00000, ips: 15.04943 ins/s2022-07-27 20:11:53,420 - INFO - epoch: 0, batch_id: 2380, auc:0.759703, avg_reader_cost: 0.00149 sec, avg_batch_cost: 36.12445 sec, avg_samples: 512.00000, ips: 14.17322 ins/s2022-07-27 20:17:56,617 - INFO - epoch: 0, batch_id: 2390, auc:0.759824, avg_reader_cost: 0.00442 sec, avg_batch_cost: 36.30910 sec, avg_samples: 512.00000, ips: 14.10115 ins/s2022-07-27 20:24:00,493 - INFO - epoch: 0, batch_id: 2400, auc:0.759926, avg_reader_cost: 0.00120 sec, avg_batch_cost: 36.37397 sec, avg_samples: 512.00000, ips: 14.07600 ins/s2022-07-27 20:30:08,713 - INFO - epoch: 0, batch_id: 2410, auc:0.759962, avg_reader_cost: 0.00269 sec, avg_batch_cost: 36.81377 sec, avg_samples: 512.00000, ips: 13.90784 ins/s2022-07-27 20:36:11,997 - INFO - epoch: 0, batch_id: 2420, auc:0.760064, avg_reader_cost: 0.00170 sec, avg_batch_cost: 36.31860 sec, avg_samples: 512.00000, ips: 14.09746 ins/s2022-07-27 20:42:17,467 - INFO - epoch: 0, batch_id: 2430, auc:0.760158, avg_reader_cost: 0.00349 sec, avg_batch_cost: 36.53255 sec, avg_samples: 512.00000, ips: 14.01490 ins/s2022-07-27 20:48:18,745 - INFO - epoch: 0, batch_id: 2440, auc:0.760194, avg_reader_cost: 0.00185 sec, avg_batch_cost: 36.11785 sec, avg_samples: 512.00000, ips: 14.17582 ins/s2022-07-27 20:54:31,433 - INFO - epoch: 0, batch_id: 2450, auc:0.760250, avg_reader_cost: 0.00209 sec, avg_batch_cost: 37.26039 sec, avg_samples: 512.00000, ips: 13.74113 ins/s2022-07-27 21:00:33,452 - INFO - epoch: 0, batch_id: 2460, auc:0.760309, avg_reader_cost: 0.00209 sec, avg_batch_cost: 36.18951 sec, avg_samples: 512.00000, ips: 14.14775 ins/s2022-07-27 21:06:15,087 - INFO - epoch: 0, batch_id: 2470, auc:0.760387, avg_reader_cost: 0.00229 sec, avg_batch_cost: 34.15334 sec, avg_samples: 512.00000, ips: 14.99121 ins/s2022-07-27 21:11:44,888 - INFO - epoch: 0, batch_id: 2480, auc:0.760396, avg_reader_cost: 0.00169 sec, avg_batch_cost: 32.97320 sec, avg_samples: 512.00000, ips: 15.52776 ins/s2022-07-27 21:17:03,588 - INFO - epoch: 0, batch_id: 2490, auc:0.760452, avg_reader_cost: 0.00090 sec, avg_batch_cost: 31.86275 sec, avg_samples: 512.00000, ips: 16.06892 ins/s2022-07-27 21:22:30,396 - INFO - epoch: 0, batch_id: 2500, auc:0.760567, avg_reader_cost: 0.00200 sec, avg_batch_cost: 32.66722 sec, avg_samples: 512.00000, ips: 15.67321 ins/s2022-07-27 21:27:59,917 - INFO - epoch: 0, batch_id: 2510, auc:0.760678, avg_reader_cost: 0.00160 sec, avg_batch_cost: 32.93892 sec, avg_samples: 512.00000, ips: 15.54392 ins/s2022-07-27 21:33:25,371 - INFO - epoch: 0, batch_id: 2520, auc:0.760694, avg_reader_cost: 0.00140 sec, avg_batch_cost: 32.53690 sec, avg_samples: 512.00000, ips: 15.73598 ins/s2022-07-27 21:38:43,582 - INFO - epoch: 0, batch_id: 2530, auc:0.760755, avg_reader_cost: 0.00120 sec, avg_batch_cost: 31.80440 sec, avg_samples: 512.00000, ips: 16.09840 ins/s2022-07-27 21:44:17,242 - INFO - epoch: 0, batch_id: 2540, auc:0.760802, avg_reader_cost: 0.00100 sec, avg_batch_cost: 33.35755 sec, avg_samples: 512.00000, ips: 15.34885 ins/s2022-07-27 21:49:37,358 - INFO - epoch: 0, batch_id: 2550, auc:0.760903, avg_reader_cost: 0.00170 sec, avg_batch_cost: 31.99480 sec, avg_samples: 512.00000, ips: 16.00260 ins/s2022-07-27 21:55:03,545 - INFO - epoch: 0, batch_id: 2560, auc:0.760975, avg_reader_cost: 0.00072 sec, avg_batch_cost: 32.60912 sec, avg_samples: 512.00000, ips: 15.70113 ins/s2022-07-27 22:00:33,398 - INFO - epoch: 0, batch_id: 2570, auc:0.761055, avg_reader_cost: 0.00447 sec, avg_batch_cost: 32.97362 sec, avg_samples: 512.00000, ips: 15.52757 ins/s2022-07-27 22:06:06,692 - INFO - epoch: 0, batch_id: 2580, auc:0.761130, avg_reader_cost: 0.00239 sec, avg_batch_cost: 33.31675 sec, avg_samples: 512.00000, ips: 15.36764 ins/s2022-07-27 22:11:29,019 - INFO - epoch: 0, batch_id: 2590, auc:0.761200, avg_reader_cost: 0.00130 sec, avg_batch_cost: 32.22158 sec, avg_samples: 512.00000, ips: 15.88997 ins/s2022-07-27 22:16:58,085 - INFO - epoch: 0, batch_id: 2600, auc:0.761237, avg_reader_cost: 0.00494 sec, avg_batch_cost: 32.89891 sec, avg_samples: 512.00000, ips: 15.56283 ins/s2022-07-27 22:22:16,804 - INFO - epoch: 0, batch_id: 2610, auc:0.761303, avg_reader_cost: 0.00150 sec, avg_batch_cost: 31.86126 sec, avg_samples: 512.00000, ips: 16.06967 ins/s2022-07-27 22:27:36,291 - INFO - epoch: 0, batch_id: 2620, auc:0.761389, avg_reader_cost: 0.00419 sec, avg_batch_cost: 31.93625 sec, avg_samples: 512.00000, ips: 16.03194 ins/s2022-07-27 22:32:54,679 - INFO - epoch: 0, batch_id: 2630, auc:0.761473, avg_reader_cost: 0.00170 sec, avg_batch_cost: 31.82013 sec, avg_samples: 512.00000, ips: 16.09044 ins/s2022-07-27 22:38:05,853 - INFO - epoch: 0, batch_id: 2640, auc:0.761590, avg_reader_cost: 0.00209 sec, avg_batch_cost: 31.10447 sec, avg_samples: 512.00000, ips: 16.46066 ins/s2022-07-27 22:43:20,241 - INFO - epoch: 0, batch_id: 2650, auc:0.761697, avg_reader_cost: 0.00120 sec, avg_batch_cost: 31.42831 sec, avg_samples: 512.00000, ips: 16.29105 ins/s2022-07-27 22:48:35,480 - INFO - epoch: 0, batch_id: 2660, auc:0.761772, avg_reader_cost: 0.00130 sec, avg_batch_cost: 31.51373 sec, avg_samples: 512.00000, ips: 16.24688 ins/s2022-07-27 22:53:51,630 - INFO - epoch: 0, batch_id: 2670, auc:0.761870, avg_reader_cost: 0.00489 sec, avg_batch_cost: 31.60465 sec, avg_samples: 512.00000, ips: 16.20015 ins/s2022-07-27 22:59:10,056 - INFO - epoch: 0, batch_id: 2680, auc:0.761972, avg_reader_cost: 0.00140 sec, avg_batch_cost: 31.82859 sec, avg_samples: 512.00000, ips: 16.08617 ins/s2022-07-27 23:04:24,111 - INFO - epoch: 0, batch_id: 2690, auc:0.762025, avg_reader_cost: 0.00160 sec, avg_batch_cost: 31.39251 sec, avg_samples: 512.00000, ips: 16.30963 ins/s2022-07-27 23:09:37,109 - INFO - epoch: 0, batch_id: 2700, auc:0.762105, avg_reader_cost: 0.00279 sec, avg_batch_cost: 31.28817 sec, avg_samples: 512.00000, ips: 16.36401 ins/s2022-07-27 23:14:54,895 - INFO - epoch: 0, batch_id: 2710, auc:0.762163, avg_reader_cost: 0.00399 sec, avg_batch_cost: 31.75882 sec, avg_samples: 512.00000, ips: 16.12151 ins/s2022-07-27 23:20:07,300 - INFO - epoch: 0, batch_id: 2720, auc:0.762174, avg_reader_cost: 0.00209 sec, avg_batch_cost: 31.22606 sec, avg_samples: 512.00000, ips: 16.39656 ins/s2022-07-27 23:25:24,698 - INFO - epoch: 0, batch_id: 2730, auc:0.762192, avg_reader_cost: 0.00259 sec, avg_batch_cost: 31.72618 sec, avg_samples: 512.00000, ips: 16.13809 ins/s2022-07-27 23:30:41,084 - INFO - epoch: 0, batch_id: 2740, auc:0.762303, avg_reader_cost: 0.00199 sec, avg_batch_cost: 31.62658 sec, avg_samples: 512.00000, ips: 16.18891 ins/s2022-07-27 23:35:56,989 - INFO - epoch: 0, batch_id: 2750, auc:0.762337, avg_reader_cost: 0.00140 sec, avg_batch_cost: 31.58129 sec, avg_samples: 512.00000, ips: 16.21213 ins/s2022-07-27 23:41:06,138 - INFO - epoch: 0, batch_id: 2760, auc:0.762407, avg_reader_cost: 0.00319 sec, avg_batch_cost: 30.90094 sec, avg_samples: 512.00000, ips: 16.56908 ins/s2022-07-27 23:46:20,937 - INFO - epoch: 0, batch_id: 2770, auc:0.762448, avg_reader_cost: 0.00182 sec, avg_batch_cost: 31.46484 sec, avg_samples: 512.00000, ips: 16.27213 ins/s2022-07-27 23:51:32,106 - INFO - epoch: 0, batch_id: 2780, auc:0.762477, avg_reader_cost: 0.00140 sec, avg_batch_cost: 31.10407 sec, avg_samples: 512.00000, ips: 16.46087 ins/s2022-07-27 23:56:51,604 - INFO - epoch: 0, batch_id: 2790, auc:0.762541, avg_reader_cost: 0.00668 sec, avg_batch_cost: 31.93057 sec, avg_samples: 512.00000, ips: 16.03479 ins/s2022-07-28 00:02:07,880 - INFO - epoch: 0, batch_id: 2800, auc:0.762582, avg_reader_cost: 0.00100 sec, avg_batch_cost: 31.61945 sec, avg_samples: 512.00000, ips: 16.19256 ins/s2022-07-28 00:07:23,898 - INFO - epoch: 0, batch_id: 2810, auc:0.762647, avg_reader_cost: 0.00219 sec, avg_batch_cost: 31.59404 sec, avg_samples: 512.00000, ips: 16.20559 ins/s2022-07-28 00:12:48,112 - INFO - epoch: 0, batch_id: 2820, auc:0.762683, avg_reader_cost: 0.00399 sec, avg_batch_cost: 32.40784 sec, avg_samples: 512.00000, ips: 15.79864 ins/s2022-07-28 00:18:02,835 - INFO - epoch: 0, batch_id: 2830, auc:0.762715, avg_reader_cost: 0.00170 sec, avg_batch_cost: 31.46095 sec, avg_samples: 512.00000, ips: 16.27414 ins/s2022-07-28 00:23:03,887 - INFO - epoch: 0, batch_id: 2840, auc:0.762834, avg_reader_cost: 0.00160 sec, avg_batch_cost: 30.09029 sec, avg_samples: 512.00000, ips: 17.01546 ins/s2022-07-28 00:28:13,550 - INFO - epoch: 0, batch_id: 2850, auc:0.762848, avg_reader_cost: 0.00100 sec, avg_batch_cost: 30.95862 sec, avg_samples: 512.00000, ips: 16.53820 ins/s2022-07-28 00:33:33,183 - INFO - epoch: 0, batch_id: 2860, auc:0.762917, avg_reader_cost: 0.00100 sec, avg_batch_cost: 31.95223 sec, avg_samples: 512.00000, ips: 16.02392 ins/s2022-07-28 00:38:55,506 - INFO - epoch: 0, batch_id: 2870, auc:0.763012, avg_reader_cost: 0.00180 sec, avg_batch_cost: 32.22064 sec, avg_samples: 512.00000, ips: 15.89043 ins/s2022-07-28 00:44:24,635 - INFO - epoch: 0, batch_id: 2880, auc:0.763049, avg_reader_cost: 0.00339 sec, avg_batch_cost: 32.89582 sec, avg_samples: 512.00000, ips: 15.56429 ins/s2022-07-28 00:50:09,625 - INFO - epoch: 0, batch_id: 2890, auc:0.763076, avg_reader_cost: 0.00193 sec, avg_batch_cost: 34.49021 sec, avg_samples: 512.00000, ips: 14.84479 ins/s2022-07-28 00:55:47,144 - INFO - epoch: 0, batch_id: 2900, auc:0.763196, avg_reader_cost: 0.00459 sec, avg_batch_cost: 33.74261 sec, avg_samples: 512.00000, ips: 15.17369 ins/s2022-07-28 01:01:06,689 - INFO - epoch: 0, batch_id: 2910, auc:0.763221, avg_reader_cost: 0.00150 sec, avg_batch_cost: 31.94144 sec, avg_samples: 512.00000, ips: 16.02933 ins/s2022-07-28 01:06:23,521 - INFO - epoch: 0, batch_id: 2920, auc:0.763268, avg_reader_cost: 0.00519 sec, avg_batch_cost: 31.67531 sec, avg_samples: 512.00000, ips: 16.16401 ins/s2022-07-28 01:11:37,280 - INFO - epoch: 0, batch_id: 2930, auc:0.763332, avg_reader_cost: 0.00170 sec, avg_batch_cost: 31.36101 sec, avg_samples: 512.00000, ips: 16.32600 ins/s2022-07-28 01:16:49,051 - INFO - epoch: 0, batch_id: 2940, auc:0.763392, avg_reader_cost: 0.00110 sec, avg_batch_cost: 31.16404 sec, avg_samples: 512.00000, ips: 16.42919 ins/s2022-07-28 01:21:58,100 - INFO - epoch: 0, batch_id: 2950, auc:0.763489, avg_reader_cost: 0.00140 sec, avg_batch_cost: 30.89220 sec, avg_samples: 512.00000, ips: 16.57376 ins/s2022-07-28 01:27:06,053 - INFO - epoch: 0, batch_id: 2960, auc:0.763557, avg_reader_cost: 0.00296 sec, avg_batch_cost: 30.78909 sec, avg_samples: 512.00000, ips: 16.62927 ins/s2022-07-28 01:32:16,846 - INFO - epoch: 0, batch_id: 2970, auc:0.763636, avg_reader_cost: 0.00289 sec, avg_batch_cost: 31.06887 sec, avg_samples: 512.00000, ips: 16.47952 ins/s2022-07-28 01:37:54,683 - INFO - epoch: 0, batch_id: 2980, auc:0.763747, avg_reader_cost: 0.00153 sec, avg_batch_cost: 33.77160 sec, avg_samples: 512.00000, ips: 15.16067 ins/s2022-07-28 01:43:21,743 - INFO - epoch: 0, batch_id: 2990, auc:0.763804, avg_reader_cost: 0.00389 sec, avg_batch_cost: 32.70043 sec, avg_samples: 512.00000, ips: 15.65729 ins/s2022-07-28 01:48:52,129 - INFO - epoch: 0, batch_id: 3000, auc:0.763855, avg_reader_cost: 0.00139 sec, avg_batch_cost: 33.02117 sec, avg_samples: 512.00000, ips: 15.50520 ins/s2022-07-28 01:54:10,093 - INFO - epoch: 0, batch_id: 3010, auc:0.763877, avg_reader_cost: 0.00170 sec, avg_batch_cost: 31.78474 sec, avg_samples: 512.00000, ips: 16.10836 ins/s2022-07-28 01:59:29,719 - INFO - epoch: 0, batch_id: 3020, auc:0.763985, avg_reader_cost: 0.00279 sec, avg_batch_cost: 31.95320 sec, avg_samples: 512.00000, ips: 16.02343 ins/s2022-07-28 02:04:46,918 - INFO - epoch: 0, batch_id: 3030, auc:0.764041, avg_reader_cost: 0.00095 sec, avg_batch_cost: 31.69780 sec, avg_samples: 512.00000, ips: 16.15254 ins/s2022-07-28 02:09:59,003 - INFO - epoch: 0, batch_id: 3040, auc:0.764067, avg_reader_cost: 0.00389 sec, avg_batch_cost: 31.19301 sec, avg_samples: 512.00000, ips: 16.41394 ins/s2022-07-28 02:15:13,447 - INFO - epoch: 0, batch_id: 3050, auc:0.764089, avg_reader_cost: 0.00239 sec, avg_batch_cost: 31.43753 sec, avg_samples: 512.00000, ips: 16.28627 ins/s2022-07-28 02:20:20,593 - INFO - epoch: 0, batch_id: 3060, auc:0.764106, avg_reader_cost: 0.00199 sec, avg_batch_cost: 30.70060 sec, avg_samples: 512.00000, ips: 16.67720 ins/s2022-07-28 02:25:51,446 - INFO - epoch: 0, batch_id: 3070, auc:0.764104, avg_reader_cost: 0.01007 sec, avg_batch_cost: 33.07318 sec, avg_samples: 512.00000, ips: 15.48082 ins/s2022-07-28 02:31:28,677 - INFO - epoch: 0, batch_id: 3080, auc:0.764133, avg_reader_cost: 0.00339 sec, avg_batch_cost: 33.71121 sec, avg_samples: 512.00000, ips: 15.18783 ins/s2022-07-28 02:37:00,285 - INFO - epoch: 0, batch_id: 3090, auc:0.764211, avg_reader_cost: 0.00175 sec, avg_batch_cost: 33.14932 sec, avg_samples: 512.00000, ips: 15.44527 ins/s2022-07-28 02:42:29,790 - INFO - epoch: 0, batch_id: 3100, auc:0.764232, avg_reader_cost: 0.00199 sec, avg_batch_cost: 32.93847 sec, avg_samples: 512.00000, ips: 15.54413 ins/s2022-07-28 02:47:53,831 - INFO - epoch: 0, batch_id: 3110, auc:0.764312, avg_reader_cost: 0.00280 sec, avg_batch_cost: 32.39356 sec, avg_samples: 512.00000, ips: 15.80561 ins/s2022-07-28 02:53:17,860 - INFO - epoch: 0, batch_id: 3120, auc:0.764423, avg_reader_cost: 0.00170 sec, avg_batch_cost: 32.39197 sec, avg_samples: 512.00000, ips: 15.80639 ins/s2022-07-28 02:58:36,733 - INFO - epoch: 0, batch_id: 3130, auc:0.764518, avg_reader_cost: 0.00295 sec, avg_batch_cost: 31.87772 sec, avg_samples: 512.00000, ips: 16.06137 ins/s2022-07-28 03:03:46,382 - INFO - epoch: 0, batch_id: 3140, auc:0.764554, avg_reader_cost: 0.00179 sec, avg_batch_cost: 30.95185 sec, avg_samples: 512.00000, ips: 16.54182 ins/s2022-07-28 03:08:58,732 - INFO - epoch: 0, batch_id: 3150, auc:0.764581, avg_reader_cost: 0.00125 sec, avg_batch_cost: 31.21805 sec, avg_samples: 512.00000, ips: 16.40077 ins/s2022-07-28 03:14:13,005 - INFO - epoch: 0, batch_id: 3160, auc:0.764627, avg_reader_cost: 0.00179 sec, avg_batch_cost: 31.41467 sec, avg_samples: 512.00000, ips: 16.29812 ins/s2022-07-28 03:19:55,297 - INFO - epoch: 0, batch_id: 3170, auc:0.764704, avg_reader_cost: 0.00120 sec, avg_batch_cost: 34.21809 sec, avg_samples: 512.00000, ips: 14.96285 ins/s2022-07-28 03:25:31,320 - INFO - epoch: 0, batch_id: 3180, auc:0.764771, avg_reader_cost: 0.00136 sec, avg_batch_cost: 33.59256 sec, avg_samples: 512.00000, ips: 15.24147 ins/s2022-07-28 03:30:58,728 - INFO - epoch: 0, batch_id: 3190, auc:0.764824, avg_reader_cost: 0.00090 sec, avg_batch_cost: 32.73182 sec, avg_samples: 512.00000, ips: 15.64227 ins/s2022-07-28 03:36:25,716 - INFO - epoch: 0, batch_id: 3200, auc:0.764876, avg_reader_cost: 0.00120 sec, avg_batch_cost: 32.68317 sec, avg_samples: 512.00000, ips: 15.66555 ins/s2022-07-28 03:41:48,895 - INFO - epoch: 0, batch_id: 3210, auc:0.764959, avg_reader_cost: 0.00180 sec, avg_batch_cost: 32.30569 sec, avg_samples: 512.00000, ips: 15.84860 ins/s2022-07-28 03:47:03,934 - INFO - epoch: 0, batch_id: 3220, auc:0.765033, avg_reader_cost: 0.00150 sec, avg_batch_cost: 31.49416 sec, avg_samples: 512.00000, ips: 16.25698 ins/s2022-07-28 03:52:18,082 - INFO - epoch: 0, batch_id: 3230, auc:0.765072, avg_reader_cost: 0.00150 sec, avg_batch_cost: 31.40610 sec, avg_samples: 512.00000, ips: 16.30256 ins/s2022-07-28 03:58:05,505 - INFO - epoch: 0, batch_id: 3240, auc:0.765158, avg_reader_cost: 0.00269 sec, avg_batch_cost: 34.73393 sec, avg_samples: 512.00000, ips: 14.74063 ins/s2022-07-28 04:03:37,523 - INFO - epoch: 0, batch_id: 3250, auc:0.765188, avg_reader_cost: 0.00335 sec, avg_batch_cost: 33.19351 sec, avg_samples: 512.00000, ips: 15.42470 ins/s2022-07-28 04:08:56,753 - INFO - epoch: 0, batch_id: 3260, auc:0.765255, avg_reader_cost: 0.00145 sec, avg_batch_cost: 31.90182 sec, avg_samples: 512.00000, ips: 16.04924 ins/s2022-07-28 04:14:18,435 - INFO - epoch: 0, batch_id: 3270, auc:0.765313, avg_reader_cost: 0.00190 sec, avg_batch_cost: 32.15348 sec, avg_samples: 512.00000, ips: 15.92363 ins/s2022-07-28 04:19:33,754 - INFO - epoch: 0, batch_id: 3280, auc:0.765364, avg_reader_cost: 0.00190 sec, avg_batch_cost: 31.52114 sec, avg_samples: 512.00000, ips: 16.24307 ins/s2022-07-28 04:24:49,455 - INFO - epoch: 0, batch_id: 3290, auc:0.765410, avg_reader_cost: 0.00140 sec, avg_batch_cost: 31.55789 sec, avg_samples: 512.00000, ips: 16.22415 ins/s2022-07-28 04:29:55,337 - INFO - epoch: 0, batch_id: 3300, auc:0.765446, avg_reader_cost: 0.00170 sec, avg_batch_cost: 30.57757 sec, avg_samples: 512.00000, ips: 16.74430 ins/s2022-07-28 04:35:31,123 - INFO - epoch: 0, batch_id: 3310, auc:0.765486, avg_reader_cost: 0.00170 sec, avg_batch_cost: 33.57122 sec, avg_samples: 512.00000, ips: 15.25116 ins/s2022-07-28 04:41:17,429 - INFO - epoch: 0, batch_id: 3320, auc:0.765572, avg_reader_cost: 0.00140 sec, avg_batch_cost: 34.61640 sec, avg_samples: 512.00000, ips: 14.79068 ins/s2022-07-28 04:46:53,871 - INFO - epoch: 0, batch_id: 3330, auc:0.765631, avg_reader_cost: 0.00120 sec, avg_batch_cost: 33.63220 sec, avg_samples: 512.00000, ips: 15.22351 ins/s2022-07-28 04:52:14,732 - INFO - epoch: 0, batch_id: 3340, auc:0.765713, avg_reader_cost: 0.00120 sec, avg_batch_cost: 32.07251 sec, avg_samples: 512.00000, ips: 15.96383 ins/s2022-07-28 04:57:34,857 - INFO - epoch: 0, batch_id: 3350, auc:0.765758, avg_reader_cost: 0.00160 sec, avg_batch_cost: 32.00389 sec, avg_samples: 512.00000, ips: 15.99806 ins/s2022-07-28 05:02:47,333 - INFO - epoch: 0, batch_id: 3360, auc:0.765857, avg_reader_cost: 0.00296 sec, avg_batch_cost: 31.23355 sec, avg_samples: 512.00000, ips: 16.39263 ins/s2022-07-28 05:07:51,157 - INFO - epoch: 0, batch_id: 3370, auc:0.765963, avg_reader_cost: 0.00150 sec, avg_batch_cost: 30.37094 sec, avg_samples: 512.00000, ips: 16.85822 ins/s2022-07-28 05:13:35,348 - INFO - epoch: 0, batch_id: 3380, auc:0.765994, avg_reader_cost: 0.00279 sec, avg_batch_cost: 34.40761 sec, avg_samples: 512.00000, ips: 14.88043 ins/s2022-07-28 05:19:14,712 - INFO - epoch: 0, batch_id: 3390, auc:0.766053, avg_reader_cost: 0.00140 sec, avg_batch_cost: 33.92731 sec, avg_samples: 512.00000, ips: 15.09109 ins/s2022-07-28 05:24:43,261 - INFO - epoch: 0, batch_id: 3400, auc:0.766144, avg_reader_cost: 0.00180 sec, avg_batch_cost: 32.84349 sec, avg_samples: 512.00000, ips: 15.58909 ins/s2022-07-28 05:30:02,058 - INFO - epoch: 0, batch_id: 3410, auc:0.766217, avg_reader_cost: 0.00160 sec, avg_batch_cost: 31.87070 sec, avg_samples: 512.00000, ips: 16.06491 ins/s2022-07-28 05:35:16,637 - INFO - epoch: 0, batch_id: 3420, auc:0.766237, avg_reader_cost: 0.00529 sec, avg_batch_cost: 31.43956 sec, avg_samples: 512.00000, ips: 16.28521 ins/s2022-07-28 05:40:35,453 - INFO - epoch: 0, batch_id: 3430, auc:0.766278, avg_reader_cost: 0.00170 sec, avg_batch_cost: 31.87140 sec, avg_samples: 512.00000, ips: 16.06456 ins/s2022-07-28 05:45:46,931 - INFO - epoch: 0, batch_id: 3440, auc:0.766332, avg_reader_cost: 0.00145 sec, avg_batch_cost: 31.13631 sec, avg_samples: 512.00000, ips: 16.44382 ins/s2022-07-28 05:51:00,444 - INFO - epoch: 0, batch_id: 3450, auc:0.766416, avg_reader_cost: 0.00229 sec, avg_batch_cost: 31.34052 sec, avg_samples: 512.00000, ips: 16.33668 ins/s2022-07-28 05:56:08,264 - INFO - epoch: 0, batch_id: 3460, auc:0.766445, avg_reader_cost: 0.00269 sec, avg_batch_cost: 30.77423 sec, avg_samples: 512.00000, ips: 16.63730 ins/s2022-07-28 06:01:32,299 - INFO - epoch: 0, batch_id: 3470, auc:0.766512, avg_reader_cost: 0.00189 sec, avg_batch_cost: 32.39587 sec, avg_samples: 512.00000, ips: 15.80448 ins/s2022-07-28 06:07:08,035 - INFO - epoch: 0, batch_id: 3480, auc:0.766559, avg_reader_cost: 0.00150 sec, avg_batch_cost: 33.56408 sec, avg_samples: 512.00000, ips: 15.25440 ins/s2022-07-28 06:12:46,234 - INFO - epoch: 0, batch_id: 3490, auc:0.766594, avg_reader_cost: 0.00220 sec, avg_batch_cost: 33.80952 sec, avg_samples: 512.00000, ips: 15.14366 ins/s2022-07-28 06:18:28,108 - INFO - epoch: 0, batch_id: 3500, auc:0.766685, avg_reader_cost: 0.00140 sec, avg_batch_cost: 34.17807 sec, avg_samples: 512.00000, ips: 14.98037 ins/s2022-07-28 06:23:49,759 - INFO - epoch: 0, batch_id: 3510, auc:0.766755, avg_reader_cost: 0.00110 sec, avg_batch_cost: 32.15634 sec, avg_samples: 512.00000, ips: 15.92221 ins/s2022-07-28 06:29:11,020 - INFO - epoch: 0, batch_id: 3520, auc:0.766818, avg_reader_cost: 0.00110 sec, avg_batch_cost: 32.11490 sec, avg_samples: 512.00000, ips: 15.94276 ins/s2022-07-28 06:34:26,061 - INFO - epoch: 0, batch_id: 3530, auc:0.766859, avg_reader_cost: 0.00254 sec, avg_batch_cost: 31.49429 sec, avg_samples: 512.00000, ips: 16.25692 ins/s2022-07-28 06:39:39,826 - INFO - epoch: 0, batch_id: 3540, auc:0.766888, avg_reader_cost: 0.00159 sec, avg_batch_cost: 31.35930 sec, avg_samples: 512.00000, ips: 16.32690 ins/s2022-07-28 06:44:49,463 - INFO - epoch: 0, batch_id: 3550, auc:0.766922, avg_reader_cost: 0.00140 sec, avg_batch_cost: 30.95364 sec, avg_samples: 512.00000, ips: 16.54086 ins/s2022-07-28 06:50:01,638 - INFO - epoch: 0, batch_id: 3560, auc:0.766987, avg_reader_cost: 0.00773 sec, avg_batch_cost: 31.20415 sec, avg_samples: 512.00000, ips: 16.40807 ins/s2022-07-28 06:55:52,853 - INFO - epoch: 0, batch_id: 3570, auc:0.767030, avg_reader_cost: 0.00209 sec, avg_batch_cost: 35.09934 sec, avg_samples: 512.00000, ips: 14.58717 ins/s2022-07-28 07:01:33,145 - INFO - epoch: 0, batch_id: 3580, auc:0.767062, avg_reader_cost: 0.00100 sec, avg_batch_cost: 34.01050 sec, avg_samples: 512.00000, ips: 15.05418 ins/s2022-07-28 07:07:14,259 - INFO - epoch: 0, batch_id: 3590, auc:0.767108, avg_reader_cost: 0.00080 sec, avg_batch_cost: 34.10455 sec, avg_samples: 512.00000, ips: 15.01266 ins/s2022-07-28 07:12:40,990 - INFO - epoch: 0, batch_id: 3600, auc:0.767175, avg_reader_cost: 0.00169 sec, avg_batch_cost: 32.66111 sec, avg_samples: 512.00000, ips: 15.67614 ins/s2022-07-28 07:18:01,684 - INFO - epoch: 0, batch_id: 3610, auc:0.767216, avg_reader_cost: 0.00459 sec, avg_batch_cost: 32.06377 sec, avg_samples: 512.00000, ips: 15.96818 ins/s2022-07-28 07:23:16,262 - INFO - epoch: 0, batch_id: 3620, auc:0.767265, avg_reader_cost: 0.00369 sec, avg_batch_cost: 31.44778 sec, avg_samples: 512.00000, ips: 16.28096 ins/s2022-07-28 07:28:33,143 - INFO - epoch: 0, batch_id: 3630, auc:0.767293, avg_reader_cost: 0.00110 sec, avg_batch_cost: 31.67918 sec, avg_samples: 512.00000, ips: 16.16203 ins/s2022-07-28 07:33:47,901 - INFO - epoch: 0, batch_id: 3640, auc:0.767365, avg_reader_cost: 0.00179 sec, avg_batch_cost: 31.46732 sec, avg_samples: 512.00000, ips: 16.27085 ins/s2022-07-28 07:38:53,485 - INFO - epoch: 0, batch_id: 3650, auc:0.767440, avg_reader_cost: 0.00199 sec, avg_batch_cost: 30.54499 sec, avg_samples: 512.00000, ips: 16.76216 ins/s2022-07-28 07:44:37,755 - INFO - epoch: 0, batch_id: 3660, auc:0.767502, avg_reader_cost: 0.00143 sec, avg_batch_cost: 34.41767 sec, avg_samples: 512.00000, ips: 14.87608 ins/s2022-07-28 07:50:10,265 - INFO - epoch: 0, batch_id: 3670, auc:0.767553, avg_reader_cost: 0.00098 sec, avg_batch_cost: 33.23699 sec, avg_samples: 512.00000, ips: 15.40452 ins/s2022-07-28 07:55:46,274 - INFO - epoch: 0, batch_id: 3680, auc:0.767602, avg_reader_cost: 0.00159 sec, avg_batch_cost: 33.59453 sec, avg_samples: 512.00000, ips: 15.24058 ins/s2022-07-28 08:01:01,318 - INFO - epoch: 0, batch_id: 3690, auc:0.767642, avg_reader_cost: 0.00140 sec, avg_batch_cost: 31.49311 sec, avg_samples: 512.00000, ips: 16.25752 ins/s2022-07-28 08:06:22,881 - INFO - epoch: 0, batch_id: 3700, auc:0.767699, avg_reader_cost: 0.00149 sec, avg_batch_cost: 32.14459 sec, avg_samples: 512.00000, ips: 15.92803 ins/s2022-07-28 08:11:37,886 - INFO - epoch: 0, batch_id: 3710, auc:0.767754, avg_reader_cost: 0.00165 sec, avg_batch_cost: 31.48912 sec, avg_samples: 512.00000, ips: 16.25958 ins/s2022-07-28 08:16:43,700 - INFO - epoch: 0, batch_id: 3720, auc:0.767821, avg_reader_cost: 0.00229 sec, avg_batch_cost: 30.57273 sec, avg_samples: 512.00000, ips: 16.74695 ins/s2022-07-28 08:22:22,861 - INFO - epoch: 0, batch_id: 3730, auc:0.767866, avg_reader_cost: 0.00382 sec, avg_batch_cost: 33.89734 sec, avg_samples: 512.00000, ips: 15.10443 ins/s2022-07-28 08:27:59,567 - INFO - epoch: 0, batch_id: 3740, auc:0.767890, avg_reader_cost: 0.00189 sec, avg_batch_cost: 33.65883 sec, avg_samples: 512.00000, ips: 15.21146 ins/s2022-07-28 08:33:39,142 - INFO - epoch: 0, batch_id: 3750, auc:0.767940, avg_reader_cost: 0.00389 sec, avg_batch_cost: 33.94274 sec, avg_samples: 512.00000, ips: 15.08423 ins/s2022-07-28 08:39:05,323 - INFO - epoch: 0, batch_id: 3760, auc:0.767970, avg_reader_cost: 0.00308 sec, avg_batch_cost: 32.60592 sec, avg_samples: 512.00000, ips: 15.70267 ins/s2022-07-28 08:44:26,560 - INFO - epoch: 0, batch_id: 3770, auc:0.768058, avg_reader_cost: 0.00150 sec, avg_batch_cost: 32.11232 sec, avg_samples: 512.00000, ips: 15.94403 ins/s2022-07-28 08:49:46,490 - INFO - epoch: 0, batch_id: 3780, auc:0.768083, avg_reader_cost: 0.00100 sec, avg_batch_cost: 31.98041 sec, avg_samples: 512.00000, ips: 16.00980 ins/s2022-07-28 08:54:50,958 - INFO - epoch: 0, batch_id: 3790, auc:0.768110, avg_reader_cost: 0.00190 sec, avg_batch_cost: 30.43757 sec, avg_samples: 512.00000, ips: 16.82132 ins/s2022-07-28 09:00:31,378 - INFO - epoch: 0, batch_id: 3800, auc:0.768156, avg_reader_cost: 0.00110 sec, avg_batch_cost: 34.03069 sec, avg_samples: 512.00000, ips: 15.04524 ins/s2022-07-28 09:06:16,241 - INFO - epoch: 0, batch_id: 3810, auc:0.768221, avg_reader_cost: 0.00152 sec, avg_batch_cost: 34.46935 sec, avg_samples: 512.00000, ips: 14.85377 ins/s2022-07-28 09:11:55,260 - INFO - epoch: 0, batch_id: 3820, auc:0.768252, avg_reader_cost: 0.00110 sec, avg_batch_cost: 33.88338 sec, avg_samples: 512.00000, ips: 15.11065 ins/s2022-07-28 09:17:22,134 - INFO - epoch: 0, batch_id: 3830, auc:0.768299, avg_reader_cost: 0.00209 sec, avg_batch_cost: 32.67371 sec, avg_samples: 512.00000, ips: 15.67009 ins/s2022-07-28 09:22:38,322 - INFO - epoch: 0, batch_id: 3840, auc:0.768345, avg_reader_cost: 0.00269 sec, avg_batch_cost: 31.60279 sec, avg_samples: 512.00000, ips: 16.20110 ins/s2022-07-28 09:27:48,930 - INFO - epoch: 0, batch_id: 3850, auc:0.768395, avg_reader_cost: 0.00219 sec, avg_batch_cost: 31.05140 sec, avg_samples: 512.00000, ips: 16.48879 ins/s2022-07-28 09:32:57,431 - INFO - epoch: 0, batch_id: 3860, auc:0.768472, avg_reader_cost: 0.00160 sec, avg_batch_cost: 30.84010 sec, avg_samples: 512.00000, ips: 16.60176 ins/s2022-07-28 09:38:35,131 - INFO - epoch: 0, batch_id: 3870, auc:0.768504, avg_reader_cost: 0.00368 sec, avg_batch_cost: 33.75832 sec, avg_samples: 512.00000, ips: 15.16663 ins/s2022-07-28 09:44:12,364 - INFO - epoch: 0, batch_id: 3880, auc:0.768575, avg_reader_cost: 0.00180 sec, avg_batch_cost: 33.71583 sec, avg_samples: 512.00000, ips: 15.18574 ins/s2022-07-28 09:49:37,689 - INFO - epoch: 0, batch_id: 3890, auc:0.768624, avg_reader_cost: 0.00160 sec, avg_batch_cost: 32.51801 sec, avg_samples: 512.00000, ips: 15.74512 ins/s2022-07-28 09:55:05,953 - INFO - epoch: 0, batch_id: 3900, auc:0.768705, avg_reader_cost: 0.00100 sec, avg_batch_cost: 32.81500 sec, avg_samples: 512.00000, ips: 15.60262 ins/s2022-07-28 09:56:12,008 - INFO - epoch: 0, batch_id: 3910, auc:0.768741, avg_reader_cost: 0.00090 sec, avg_batch_cost: 6.59900 sec, avg_samples: 512.00000, ips: 77.58753 ins/s 2022-07-28 09:56:50,994 - INFO - epoch: 0, batch_id: 3920, auc:0.768823, avg_reader_cost: 0.00110 sec, avg_batch_cost: 3.89720 sec, avg_samples: 512.00000, ips: 131.37627 ins/s2022-07-28 09:57:26,291 - INFO - epoch: 0, batch_id: 3930, auc:0.768833, avg_reader_cost: 0.00080 sec, avg_batch_cost: 3.52866 sec, avg_samples: 512.00000, ips: 145.09772 ins/s2022-07-28 09:58:03,521 - INFO - epoch: 0, batch_id: 3940, auc:0.768879, avg_reader_cost: 0.00080 sec, avg_batch_cost: 3.72156 sec, avg_samples: 512.00000, ips: 137.57661 ins/s2022-07-28 09:58:40,785 - INFO - epoch: 0, batch_id: 3950, auc:0.768923, avg_reader_cost: 0.00060 sec, avg_batch_cost: 3.72482 sec, avg_samples: 512.00000, ips: 137.45624 ins/s2022-07-28 09:59:16,445 - INFO - epoch: 0, batch_id: 3960, auc:0.768967, avg_reader_cost: 0.00060 sec, avg_batch_cost: 3.56458 sec, avg_samples: 512.00000, ips: 143.63552 ins/s2022-07-28 09:59:51,552 - INFO - epoch: 0, batch_id: 3970, auc:0.769015, avg_reader_cost: 0.00050 sec, avg_batch_cost: 3.50915 sec, avg_samples: 512.00000, ips: 145.90448 ins/s2022-07-28 10:00:26,954 - INFO - epoch: 0, batch_id: 3980, auc:0.769033, avg_reader_cost: 0.00086 sec, avg_batch_cost: 3.53889 sec, avg_samples: 512.00000, ips: 144.67812 ins/s2022-07-28 10:01:02,704 - INFO - epoch: 0, batch_id: 3990, auc:0.769065, avg_reader_cost: 0.00110 sec, avg_batch_cost: 3.57358 sec, avg_samples: 512.00000, ips: 143.27356 ins/s2022-07-28 10:01:39,519 - INFO - epoch: 0, batch_id: 4000, auc:0.769090, avg_reader_cost: 0.00060 sec, avg_batch_cost: 3.67987 sec, avg_samples: 512.00000, ips: 139.13546 ins/s2022-07-28 10:02:14,744 - INFO - epoch: 0, batch_id: 4010, auc:0.769148, avg_reader_cost: 0.00080 sec, avg_batch_cost: 3.52097 sec, avg_samples: 512.00000, ips: 145.41450 ins/s2022-07-28 10:02:49,465 - INFO - epoch: 0, batch_id: 4020, auc:0.769203, avg_reader_cost: 0.00060 sec, avg_batch_cost: 3.47044 sec, avg_samples: 512.00000, ips: 147.53170 ins/s2022-07-28 10:03:25,117 - INFO - epoch: 0, batch_id: 4030, auc:0.769246, avg_reader_cost: 0.00030 sec, avg_batch_cost: 3.56414 sec, avg_samples: 512.00000, ips: 143.65322 ins/s2022-07-28 10:04:01,384 - INFO - epoch: 0, batch_id: 4040, auc:0.769275, avg_reader_cost: 0.00110 sec, avg_batch_cost: 3.62584 sec, avg_samples: 512.00000, ips: 141.20883 ins/s2022-07-28 10:04:38,620 - INFO - epoch: 0, batch_id: 4050, auc:0.769331, avg_reader_cost: 0.00120 sec, avg_batch_cost: 3.72230 sec, avg_samples: 512.00000, ips: 137.54926 ins/s2022-07-28 10:05:13,796 - INFO - epoch: 0, batch_id: 4060, auc:0.769369, avg_reader_cost: 0.00100 sec, avg_batch_cost: 3.51604 sec, avg_samples: 512.00000, ips: 145.61824 ins/s2022-07-28 10:05:49,404 - INFO - epoch: 0, batch_id: 4070, auc:0.769416, avg_reader_cost: 0.00070 sec, avg_batch_cost: 3.55958 sec, avg_samples: 512.00000, ips: 143.83722 ins/s2022-07-28 10:06:26,827 - INFO - epoch: 0, batch_id: 4080, auc:0.769437, avg_reader_cost: 0.00110 sec, avg_batch_cost: 3.74092 sec, avg_samples: 512.00000, ips: 136.86469 ins/s2022-07-28 10:07:02,354 - INFO - epoch: 0, batch_id: 4090, auc:0.769473, avg_reader_cost: 0.00060 sec, avg_batch_cost: 3.55134 sec, avg_samples: 512.00000, ips: 144.17102 ins/s2022-07-28 10:07:37,302 - INFO - epoch: 0, batch_id: 4100, auc:0.769518, avg_reader_cost: 0.00040 sec, avg_batch_cost: 3.49337 sec, avg_samples: 512.00000, ips: 146.56352 ins/s2022-07-28 10:08:14,173 - INFO - epoch: 0, batch_id: 4110, auc:0.769582, avg_reader_cost: 0.00120 sec, avg_batch_cost: 3.68563 sec, avg_samples: 512.00000, ips: 138.91785 ins/s2022-07-28 10:08:51,786 - INFO - epoch: 0, batch_id: 4120, auc:0.769654, avg_reader_cost: 0.00140 sec, avg_batch_cost: 3.75968 sec, avg_samples: 512.00000, ips: 136.18192 ins/s2022-07-28 10:09:27,956 - INFO - epoch: 0, batch_id: 4130, auc:0.769687, avg_reader_cost: 0.00080 sec, avg_batch_cost: 3.61592 sec, avg_samples: 512.00000, ips: 141.59587 ins/s 2022-07-28 10:10:02,667 - INFO - epoch: 0, batch_id: 4140, auc:0.769731, avg_reader_cost: 0.00080 sec, avg_batch_cost: 3.46921 sec, avg_samples: 512.00000, ips: 147.58395 ins/s2022-07-28 10:10:40,637 - INFO - epoch: 0, batch_id: 4150, auc:0.769763, avg_reader_cost: 0.00050 sec, avg_batch_cost: 3.79522 sec, avg_samples: 512.00000, ips: 134.90663 ins/s

ArtificialZeng avatar Jul 29 '22 05:07 ArtificialZeng

你好; 1.从log来看,未使用GPU训练(2022-07-27 13:50:13,095 - INFO - use_gpu: False, use_xpu: False) 2.可加启动参数:-o runner. use_gpu=True ,使用GPU训练

iamWHTWD avatar Jul 29 '22 11:07 iamWHTWD