Cannot import Chinese articles

[slipbox]

Cannot import Chinese articles, it displays as garbled characters. For example: http://www.nopss.gov.cn/n1/2023/0802/c431029-40049194.html

lable:bug

[mdroidian]

Initial exploration:

https://github.com/RoamJS/workbench/blob/63edf81c3bd16ebe6acf773e4be1e7f0149d0b3b/src/features/article.tsx#L107-L118

• not frontend / roam issue: copy/paste works and html (ln 109) shows untranslatable characters
• charset(r.headers) is returning utf8
• iconv-lite says "Untranslatable characters are set to � or ?. No transliteration is currently supported."

Options for next steps

• check what is happening in apiPost, r.encoded
• find different character encodings provider