newcrawler icon indicating copy to clipboard operation
newcrawler copied to clipboard

请问这个嵌入iframe是怎么解决跨域问题的呢?

Open stormstone opened this issue 5 years ago • 3 comments

把待爬取的页面通过iframe嵌入进来,是怎样给页面里的元素添加属性和控制的呢?

stormstone avatar Jul 30 '19 06:07 stormstone

代理,变成同域

speed avatar Jul 30 '19 07:07 speed

代理,变成同域

我不太了解这方面,有什么学习资料吗,希望能指点一二,万分感谢!

stormstone avatar Jul 30 '19 07:07 stormstone

找到了nginx反向代理的方法,谢谢指点!

    server {
        listen       8090;
        server_name  localhost;
		
		# 爬虫前端页面代理
		location ^~ /spider {
			rewrite ^/spider/(.*)$ /$1 break;
			root html/spider-front;
		}
		
		# 待爬取网站代理
		location / {
			add_header 'Access-Control-Allow-Origin' $http_origin;
			add_header 'Access-Control-Allow-Credentials' 'true';
			proxy_pass http://www.baidu.com;
		}
}

stormstone avatar Jul 31 '19 00:07 stormstone