xxl-crawler
xxl-crawler copied to clipboard
发送post请求时返回400
你好,我在测试用例中没有找到post请求的模板调用
这是我的调用代码 ` Map<String,String> dataMap = new HashMap<>(); dataMap.put("category","**"); dataMap.put("currentPage","1"); dataMap.put("pageSize","30");
Map<String,String> headerMap = new HashMap<>();
headerMap.put("Accept-Encoding","gzip");
headerMap.put("Content-Type","application/json;charset=UTF-8");
headerMap.put("User-Agent","Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.87 Safari/537.36");
XxlCrawler xxlCrawler = new XxlCrawler.Builder()
.setUrls(url)
.setAllowSpread(false)
.setIfPost(true)
.setHeaderMap(headerMap)
.setParamMap(dataMap)
.setPageParser(new PageParser() {
@Override
public void parse(Document html, Element pageVoElement, Object pageVo) {
XxlJobLogger.log("html:{}",html);
}
})
.build();
xxlCrawler.start(true);
return SUCCESS;`
这是报错:
org.jsoup.HttpStatusException: HTTP error fetching URL. Status=400
内部代码不支持 post raw 方式,需要修改一下源码,放开requestbody赋值。