duckscript icon indicating copy to clipboard operation
duckscript copied to clipboard

`replace` can not accept a unicode character like \u{FEFF}

Open Dirreke opened this issue 2 years ago • 1 comments

Feature Description

I use readfile to read a file with utf-8-BOM and I get a string start with \u{FEFF}, which means BOM and we can not see it when we print it. I have no idea about delete it.

(using utf-8-BOM because if set the output format of powershell to utf-8(the default is utf-16LE), it will always use BOM to create file.)

by the way, if readfile will support more encoding format like utf-16LE, GBK ...

Describe The Solution You'd Like

make replace able to accept the unicode character.

Dirreke avatar Nov 15 '23 06:11 Dirreke

@Dirreke there is readbinfile for reading binary files and getting raw data so encoding won't impact anything. or you can improve the readfile implementation via PR?

sagiegurari avatar Nov 17 '23 14:11 sagiegurari