pyspider icon indicating copy to clipboard operation
pyspider copied to clipboard

help! pyspider headers doesn't work, but it's fine in requests;

Open nlpjoe opened this issue 4 years ago • 1 comments

  • pyspider version: 0.3.10
  • Operating system: mac os 10.15.5
  • Start up command: pyspider all

Expected behavior

I hope to scraw text and image information and the image url should show normally like this: image

Actual behavior

But I send a request with the same headers and have many 403 responses; I tried many headers and no one could work normally image

How to reproduce

nlpjoe avatar Sep 20 '20 16:09 nlpjoe

You are loading that image in your browser. How is that the same as requests?

binux avatar Sep 21 '20 05:09 binux