Failed to install cchardet

[chrisgoddard]

Error install cchardet==2.1.7

src/cchardet/_cchardet.cpp:196:12: fatal error: 'longintrepr.h' file not found
  #include "longintrepr.h"
           ^~~~~~~~~~~~~~~
1 error generated.
error: command '/usr/bin/clang' failed with exit code 1```

Mac (intel) OSX 14.2.1 - though I had the same issue on my M1.

[charliermarsh]

Can you please include your uv version, the output of running uv pip install with --verbose, and confirmation that you're able to install this package with pip and --no-cache?

[hwong557]

Are you on 3.11? It seems cchardet is unsupported on 3.11 and the package seems to be abandoned.

https://github.com/PyYoshi/cChardet/issues/81

But there seems to be a fork: https://github.com/faust-streaming/cChardet

[chrisgoddard]

Oh weird - 3.12 actually. Normal pip works but I'll check out the fork

[hauntsaninja]

Yeah, cchardet is dead. Fwiw, seems like a lot of people are switching to charset_normalizer anyway

[chrisgoddard]

I'll check that out - quite a few scraping libs have it as an optional dependency for performance.

[notatallshaw-gts]

I'll check that out - quite a few scraping libs have it as an optional dependency for performance.

FYI there is a mypyc mode for charset-normalizer for some performance improvement: https://charset-normalizer.readthedocs.io/en/latest/community/speedup.html

[zanieb]

It looks like there's nothing for us to address here. (please let us know if that's not the case)