Javier Ruano

How to? the package boost is inside the directory in all subdirectories (include, lib ...) with another packages. i have the same problem than zhouliguo. Perhaps it's possible create another...

the another problem is when you install version boost 1.65, the system not detect -- Boost version: 1.65 NOT FOUND Only 1.62 < 1.65 -- Found the following Boost libraries:...

I am not expert, but scrapy has its own filter, isn't it? (you use not seen) *http://doc.scrapy.org/en/latest/topics/link-extractors.html * *class *scrapy.linkextractors.lxmlhtml.LxmlLinkExtracto * unique* (*boolean*) – whether duplicate filtering should be applied...

Robots.txt is read at the start of crawling. You could disable that feature from settings or to write a middleware apropos robots. https://docs.scrapy.org/en/latest/topics/settings.html https://docs.scrapy.org/en/latest/topics/downloader-middleware.html#topics-dlmw-robots https://stackoverflow.com/questions/37274835/getting-forbidden-by-robots-txt-scrapy El sáb., 16 feb. 2019...