httpx icon indicating copy to clipboard operation
httpx copied to clipboard

csv file not utf8 with bom

Open HyWell opened this issue 3 years ago • 1 comments
trafficstars

httpx version:

v1.2.4 image

Current Behavior:

csv file not utf8 with Bom

Expected Behavior:

Add utf8 with bom at the beginning of the csv file

Steps To Reproduce:

1.Run 'echo baidu.com | httpx -path /index.html -o result.csv -csv' image

  1. open excel image
  2. add utf8 with bom at the beginning of the csv file image image use '\ufefft' to file

HyWell avatar Aug 23 '22 12:08 HyWell

@ehsandeep : Converting the output to specified input of encoding scheme will solve this issue and the issue we discussed earlier about non-utf-8 data ingestion. An additional flag can be added to enable optional character encoding of output :

-output-encoding utf8

parthmalhotra avatar Sep 15 '22 11:09 parthmalhotra

@HyWell this is now fixed in dev version - https://github.com/projectdiscovery/httpx/pull/887#pullrequestreview-1196958287

ehsandeep avatar Nov 29 '22 06:11 ehsandeep