private void SetOptions(Request request) 方法有bug

[pengwen135]

private void SetOptions(Request request)中 _httpClient.DefaultRequestHeaders 不进行clear 会导致头信息一直被添加

[jxnkwlp]

https://github.com/jxnkwlp/DotnetSpiderLite/blob/352a256e3f2f91b83d629f5d30d1913fdcd978a9/src/DotnetSpiderLite.Node/Downloader/DefaultHttpClientDownloader.cs#L106 https://github.com/jxnkwlp/DotnetSpiderLite/blob/352a256e3f2f91b83d629f5d30d1913fdcd978a9/src/DotnetSpiderLite.Node/Downloader/DefaultHttpClientDownloader.cs#L107

此处是有处理的。

[pengwen135]

_httpClient.DefaultRequestHeaders.Accept.ParseAdd(request.Accept); // _httpClient.DefaultRequestHeaders.AcceptEncoding.ParseAdd(request.AcceptEncoding); _httpClient.DefaultRequestHeaders.AcceptLanguage.ParseAdd(request.AcceptLanguage); 这两句没有处理