pyspider icon indicating copy to clipboard operation
pyspider copied to clipboard

on_cronjob didn't trigger a new crawl job

Open yuliujuan opened this issue 5 years ago • 1 comments

Dear all, My script was running smoothly for several days. Recently, pyspider only has on_cronjob task and didn't trigger a new crawl job. I've check all the tasks in this script were with SUCCESS result. Could you please advise how to check the issue and fix it? Thanks in advance.

SUCCESS Get_OT_for_IPO > data:,_on_cronjob 3 hours ago
SUCCESS Get_OT_for_IPO > data:,_on_cronjob 15 hours ago
SUCCESS Get_OT_for_IPO > data:,_on_cronjob yesterday at 0:00
SUCCESS Get_OT_for_IPO > data:,_on_cronjob Tuesday at 12:00
SUCCESS Get_OT_for_IPO > data:,_on_cronjob Tuesday at 0:00
SUCCESS Get_OT_for_IPO > data:,on_finished Monday at 12:00 0.0+1.21ms +0
SUCCESS Get_OT_for_IPO > http://test.url/api/transform/raw/dingtalk_ots Monday at 12:00 144.2+2.97ms +0
SUCCESS Get_OT_for_IPO > http://another.test.url/user/get?access_token=eca56b098c073645939310d97681f675&userid=0143640458377 Monday at 12:00 159.3+19.49ms +1
SUCCESS Get_OT_for_IPO > http://another.test.url/topapi/processinstance/get?access_token=eca56b098c073645939310d97681f675 Monday at 12:00 386.3+3.07ms +1
SUCCESS Get_OT_for_IPO > http://another.test.url/topapi/processinstance/listids?access_token=eca56b098c073645939310d97681f675 Monday at 12:00 471.2+12.54ms +1
SUCCESS Get_OT_for_IPO > http://another.test.url/gettoken? Monday at 12:00 189.8+1.43ms +1
SUCCESS Get_OT_for_IPO > http://test.url/api/others/token/amberyu Monday at 12:00 23.7+1.17ms +1
SUCCESS Get_OT_for_IPO > data:,_on_cronjob Monday at 12:00
SUCCESS Get_OT_for_IPO > data:,_on_cronjob Monday at 0:00
SUCCESS Get_OT_for_IPO > data:,on_finished Sunday at 12:00 0.0+1.09ms +0
SUCCESS Get_OT_for_IPO > http://test.url/api/transform/raw/dingtalk_ots Sunday at 12:00 118.4+0.66ms +0
SUCCESS Get_OT_for_IPO > http://another.test.url/user/get?access_token=fe4c506603b43827b6c96a9ab729cc04&userid=0143640458377 Sunday at 12:00 125.7+8.67ms +1
SUCCESS Get_OT_for_IPO > http://another.test.url/topapi/processinstance/get?access_token=fe4c506603b43827b6c96a9ab729cc04 Sunday at 12:00 140.2+4.01ms +1
SUCCESS Get_OT_for_IPO > http://another.test.url/topapi/processinstance/listids?access_token=fe4c506603b43827b6c96a9ab729cc04 Sunday at 12:00 400.2+8.52ms +1
SUCCESS Get_OT_for_IPO > http://another.test.url/gettoken? Sunday at 12:00 494.6+1.75ms +1
SUCCESS Get_OT_for_IPO > http://test.url/api/others/token/amberyu Sunday at 12:00 17.6+1.46ms +1
SUCCESS Get_OT_for_IPO > data:,_on_cronjob Sunday at 12:00
SUCCESS Get_OT_for_IPO > data:,_on_cronjob Sunday at 0:00
SUCCESS Get_OT_for_IPO > data:,_on_cronjob Saturday at 12:00
SUCCESS Get_OT_for_IPO > data:,on_finished 6-1 at 0:00 0.0+1.28ms +0
SUCCESS Get_OT_for_IPO > http://test.url/api/transform/raw/dingtalk_ots 6-1 at 0:00 133.0+2.00ms +0
SUCCESS Get_OT_for_IPO > http://another.test.url/user/get?access_token=50132dcb13d438a8ae860f75c119b6b9&userid=1202185328-754481473 6-1 at 0:00 155.0+13.75ms +1
SUCCESS Get_OT_for_IPO > http://another.test.url/topapi/processinstance/get?access_token=50132dcb13d438a8ae860f75c119b6b9 6-1 at 0:00 148.1+1.57ms +1
SUCCESS Get_OT_for_IPO > http://another.test.url/topapi/processinstance/listids?access_token=50132dcb13d438a8ae860f75c119b6b9 6-1 at 0:00 439.5+9.13ms +2
SUCCESS Get_OT_for_IPO > http://another.test.url/gettoken? 6-1 at 0:00 208.2+1.35ms +1
SUCCESS Get_OT_for_IPO > http://test.url/api/others/token/amberyu 6-1 at 0:00 21.6+1.48ms +1
SUCCESS Get_OT_for_IPO > data:,_on_cronjob 6-1 at 0:00
SUCCESS Get_OT_for_IPO > data:,_on_cronjob 5-31 at 12:00
SUCCESS Get_OT_for_IPO > data:,_on_cronjob 5-31 at 0:00
SUCCESS Get_OT_for_IPO > data:,_on_cronjob 5-30 at 12:00
SUCCESS Get_OT_for_IPO > data:,on_finished 5-30 at 10:45 0.0+1.12ms +0
SUCCESS Get_OT_for_IPO > http://test.url/api/transform/raw/dingtalk_ots 5-30 at 10:45 278.5+0.94ms +0
SUCCESS Get_OT_for_IPO > http://another.test.url/user/get?access_token=a245f8e2f3f13521a6dedb81bf886e2b&userid=1202185328-754481473 5-30 at 10:45 229.5+33.05ms +1
SUCCESS Get_OT_for_IPO > http://another.test.url/topapi/processinstance/get?access_token=a245f8e2f3f13521a6dedb81bf886e2b 5-30 at 10:45 275.1+1.30ms +1
SUCCESS Get_OT_for_IPO > http://another.test.url/topapi/processinstance/listids?access_token=a245f8e2f3f13521a6dedb81bf886e2b 5-30 at 10:45 535.5+3.94ms +2
SUCCESS Get_OT_for_IPO > http://another.test.url/gettoken? 5-30 at 10:45 109.3+1.33ms +1
SUCCESS Get_OT_for_IPO > http://test.url/api/others/token/amberyu 5-30 at 10:45 18.7+2.45ms +1
SUCCESS Get_OT_for_IPO > data:,on_start 5-30 at 10:45 0.0+1.41ms +1
SUCCESS Get_OT_for_IPO > data:,_on_get_info 5-30 at 10:44
SUCCESS Get_OT_for_IPO > data:,_on_cronjob 5-30 at 0:00
SUCCESS Get_OT_for_IPO > data:,_on_cronjob 5-29 at 12:00
SUCCESS Get_OT_for_IPO > data:,on_finished 5-29 at 3:30 0.0+0.67ms +0
SUCCESS Get_OT_for_IPO > http://test.url/api/transform/raw/dingtalk_ots 5-29 at 3:30 116.8+1.19ms +0
SUCCESS Get_OT_for_IPO > http://another.test.url/user/get?access_token=3dfe7ea6c4c336e78e2bbc72c65da6f9&userid=1202185328-754481473 5-29 at 3:30 257.8+37.09ms +1
SUCCESS Get_OT_for_IPO > http://another.test.url/topapi/processinstance/get?access_token=3dfe7ea6c4c336e78e2bbc72c65da6f9 5-29 at 3:30 290.2+2.57ms +1
SUCCESS Get_OT_for_IPO > http://another.test.url/topapi/processinstance/listids?access_token=3dfe7ea6c4c336e78e2bbc72c65da6f9 5-29 at 3:30 637.4+4.14ms +2
SUCCESS Get_OT_for_IPO > http://another.test.url/gettoken? 5-29 at 3:30 224.0+2.90ms +1
SUCCESS Get_OT_for_IPO > http://test.url/api/others/token/amberyu 5-29 at 3:30 12.9+1.31ms +1
SUCCESS Get_OT_for_IPO > data:,on_start 5-29 at 3:30 0.0+1.94ms +1
SUCCESS Get_OT_for_IPO > data:,_on_get_info 5-29 at 3:30
SUCCESS Get_OT_for_IPO > data:,_on_cronjob 5-29 at 0:00
SUCCESS Get_OT_for_IPO > data:,_on_cronjob 5-28 at 12:00
SUCCESS Get_OT_for_IPO > data:,on_finished 5-28 at 0:00 0.0+0.65ms +0
SUCCESS Get_OT_for_IPO > http://test.url/api/transform/raw/dingtalk_ots 5-28 at 0:00 224.7+2.88ms +0
SUCCESS Get_OT_for_IPO > http://another.test.url/user/get?access_token=4fd0b0de70c63406a29fc971e4937d48&userid=1202185328-754481473 5-28 at 0:00 132.7+13.92ms +1

yuliujuan avatar Jun 06 '19 03:06 yuliujuan

maybe u should check the start urls

RonnieHwang avatar Aug 07 '19 06:08 RonnieHwang