templatespider icon indicating copy to clipboard operation
templatespider copied to clipboard

你好,为什么点击爬取一点动静没有,是不是cokkie设置有问题,而且怎么停止爬取呢

Open lushan1314 opened this issue 2 years ago • 4 comments

如题

lushan1314 avatar Jan 07 '23 22:01 lushan1314

cache-control: no-cache, private
content-encoding: gzip
content-type: text/html; charset=UTF-8
date: Sat, 07 Jan 2023 23:07:06 GMT
server: nginx
set-cookie: XSRF-TOKEN=eyJpdiI6InU1RWgzYnB4a2ZDOFBtQXhOdzh4SUE9PSIsInZhbHVlIjoiZVM4eGJPK3JpNzNVMVF1amVtbzcwYVJ1bnNOSFR2TytLZnhLNlBQWnJOT1VNUnBiN0RSaTFwZWRxblVKTnl6SVhYcnh3Ymc5MC96cXBqOXB4Z2RVSHE4NXQrWnZPZ2lWbkZrcDVwTE50REVabzN3QnJpRy9LVVY4WTVablA0OUwiLCJtYWMiOiJhMWNmN2E4YjM5MGYzMmM1YzE1NzI4MzFmZDUxMzViMDY1ZmYyMDUyMGJmMzIwZDE4ZWZiODFjZWRkNmMzMDBkIiwidGFnIjoiIn0%3D; expires=Sun, 08-Jan-2023 01:07:06 GMT; Max-Age=7200; path=/; samesite=lax
set-cookie: laravel_session=eyJpdiI6ImFsdVBFL1hSSEtDU0Rya1Bqdklzbnc9PSIsInZhbHVlIjoiNUk1SUptMHRqYnNjZVZqOUN0NGx4cncyOUdjSVBGZlVQTnJncmRMTXQrSFBVeWZkVnNkVk9IeUVVRW5OSm1wZ29VRjhkNVB6U3c2VmxoellIUnRKRklRazlBcWFWNlphc1RXVG5SMVZLck15RVZnRXFrYWwxdEhuQ3JWbW5SUEMiLCJtYWMiOiJjYWNjZDk5NTBlOThkZjIzMjM4YzQ0ODc5NTE0MzAxZmQyMThiZTAxYjNlNDkyNjRlNTgxYWVkMDUxYTkwOTFiIiwidGFnIjoiIn0%3D; expires=Sun, 08-Jan-2023 01:07:06 GMT; Max-Age=7200; path=/; httponly; samesite=lax
strict-transport-security: max-age=31536000

大佬你好,请问上面的cokkie我应该如何添加?说明上是写着;分开,但是每个cookie有好几个参数,是必须要加上

expires=Sun, 08-Jan-2023 01:07:06 GMT; Max-Age=7200; path=/; httponly; samesite=lax

这一段么?

另外,网站是https的

lushan1314 avatar Jan 07 '23 23:01 lushan1314

如果不加cookie,会报一堆如下的错误

sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested targe

lushan1314 avatar Jan 07 '23 23:01 lushan1314

三个文件夹啥也没有,空空如也。wget命令倒是能爬取一些东西

lushan1314 avatar Jan 07 '23 23:01 lushan1314

有的是时间路径等,你只需将name、以及值写上即可,比如 XSRF-TOKEN=eyJpdiI6InU1RWgzYnB4a2ZDOFBtQXhOdzh4SUE9PSIsInZhbHVlIjoiZVM4eGJPK3JpNzNVMVF1amVtbzcwYVJ1bnNOSFR2TytLZnhLNlBQWnJOT1VNUnBiN0RSaTFwZWRxblVKTnl6SVhYcnh3Ymc5MC96cXBqOXB4Z2RVSHE4NXQrWnZPZ2lWbkZrcDVwTE50REVabzN3QnJpRy9LVVY4WTVablA0OUwiLCJtYWMiOiJhMWNmN2E4YjM5MGYzMmM1YzE1NzI4MzFmZDUxMzViMDY1ZmYyMDUyMGJmMzIwZDE4ZWZiODFjZWRkNmMzMDBkIiwidGFnIjoiIn0%3D;laravel_session=eyJpdiI6ImFsdVBFL1hSSEtDU0Rya1Bqdklzbnc9PSIsInZhbHVlIjoiNUk1SUptMHRqYnNjZVZqOUN0NGx4cncyOUdjSVBGZlVQTnJncmRMTXQrSFBVeWZkVnNkVk9IeUVVRW5OSm1wZ29VRjhkNVB6U3c2VmxoellIUnRKRklRazlBcWFWNlphc1RXVG5SMVZLck15RVZnRXFrYWwxdEhuQ3JWbW5SUEMiLCJtYWMiOiJjYWNjZDk5NTBlOThkZjIzMjM4YzQ0ODc5NTE0MzAxZmQyMThiZTAxYjNlNDkyNjRlNTgxYWVkMDUxYTkwOTFiIiwidGFnIjoiIn0%3D;

至于后面的path、expire的不用管,忽略它就好

xnx3 avatar Jan 17 '23 11:01 xnx3