xxl-crawler icon indicating copy to clipboard operation
xxl-crawler copied to clipboard

发送post请求时返回400

Open 2637977081 opened this issue 5 years ago • 1 comments

你好,我在测试用例中没有找到post请求的模板调用

这是我的调用代码 ` Map<String,String> dataMap = new HashMap<>(); dataMap.put("category","**"); dataMap.put("currentPage","1"); dataMap.put("pageSize","30");

    Map<String,String> headerMap = new HashMap<>();
    headerMap.put("Accept-Encoding","gzip");
    headerMap.put("Content-Type","application/json;charset=UTF-8");
    headerMap.put("User-Agent","Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.87 Safari/537.36");

    XxlCrawler xxlCrawler = new XxlCrawler.Builder()
            .setUrls(url)
            .setAllowSpread(false)
            .setIfPost(true)
            .setHeaderMap(headerMap)
            .setParamMap(dataMap)
            .setPageParser(new PageParser() {
                @Override
                public void parse(Document html, Element pageVoElement, Object pageVo) {
                    XxlJobLogger.log("html:{}",html);
                }
            })
            .build();
    xxlCrawler.start(true);
    return SUCCESS;`
   

这是报错: org.jsoup.HttpStatusException: HTTP error fetching URL. Status=400

2637977081 avatar Oct 31 '19 10:10 2637977081

内部代码不支持 post raw 方式,需要修改一下源码,放开requestbody赋值。

junyong-tsui avatar Oct 17 '23 05:10 junyong-tsui