discord

discord copied to clipboard

Sourced from charset-normalizer's releases.

Version 3.2.0

3.2.0 (2023-06-07)

Changed

• Typehint for function from_path no longer enforce PathLike as its first argument
• Minor improvement over the global detection reliability

Added

• Introduce function is_binary that relies on main capabilities, and is optimized to detect binaries
• Propagate enable_fallback argument throughout from_bytes, from_path, and from_fp that allow a deeper control over the detection (default True)
• Explicit support for Python 3.12

Fixed

• Edge case detection failure where a file would contain 'very-long' camel-cased word (Issue #289)

Version 3.1.0

3.1.0 (2023-03-06)

Added

• Argument should_rename_legacy for legacy function detect and disregard any new arguments without errors (PR #262)

Removed

• Support for Python 3.6 (PR #260)

Changed

• Optional speedup provided by mypy/c 1.0.1

Version 3.0.1

3.0.1 (2022-11-18)

Fixed

• Multi-bytes cutter/chunk generator did not always cut correctly (PR #233)

Changed

• Speedup provided using mypy/c 0.990 on Python >= 3.7

Version 3.0.0

3.0.0 (2022-10-20)

Added

• Extend the capability of explain=True when cp_isolation contains at most two entries (min one), will log in details of the Mess-detector results
• Support for alternative language frequency set in charset_normalizer.assets.FREQUENCIES
• Add parameter language_threshold in from_bytes, from_path and from_fp to adjust the minimum expected coherence ratio
• normalizer --version now specify if the current version provides extra speedup (meaning mypyc compilation whl)

Changed

• Build with static metadata (not pyproject.toml yet)
• Make language detection stricter
• Optional: Module md.py can be compiled using Mypyc to provide an extra speedup up to 4x faster than v2.1

... (truncated)

Sourced from charset-normalizer's changelog.

3.2.0 (2023-06-07)

Changed

• Typehint for function from_path no longer enforce PathLike as its first argument
• Minor improvement over the global detection reliability

Added

• Introduce function is_binary that relies on main capabilities, and optimized to detect binaries
• Propagate enable_fallback argument throughout from_bytes, from_path, and from_fp that allow a deeper control over the detection (default True)
• Explicit support for Python 3.12

Fixed

• Edge case detection failure where a file would contain 'very-long' camel cased word (Issue #289)

3.1.0 (2023-03-06)

Added

• Argument should_rename_legacy for legacy function detect and disregard any new arguments without errors (PR #262)

Removed

• Support for Python 3.6 (PR #260)

Changed

• Optional speedup provided by mypy/c 1.0.1

3.0.1 (2022-11-18)

Fixed

• Multi-bytes cutter/chunk generator did not always cut correctly (PR #233)

Changed

• Speedup provided by mypy/c 0.990 on Python >= 3.7

3.0.0 (2022-10-20)

Added

• Extend the capability of explain=True when cp_isolation contains at most two entries (min one), will log in details of the Mess-detector results
• Support for alternative language frequency set in charset_normalizer.assets.FREQUENCIES
• Add parameter language_threshold in from_bytes, from_path and from_fp to adjust the minimum expected coherence ratio
• normalizer --version now specify if current version provide extra speedup (meaning mypyc compilation whl)

Changed

• Build with static metadata using 'build' frontend
• Make the language detection stricter
• Optional: Module md.py can be compiled using Mypyc to provide an extra speedup up to 4x faster than v2.1

Fixed

• CLI with opt --normalize fail when using full path for files
• TooManyAccentuatedPlugin induce false positive on the mess detection when too few alpha character have been fed to it
• Sphinx warnings when generating the documentation

... (truncated)

Sourced from charset-normalizer's upgrade guide.

Guide to upgrade your code from v1 to v2

• If you are using the legacy detect function, that is it. You have nothing to do.

Detection

Before

from charset_normalizer import CharsetNormalizerMatches
results = CharsetNormalizerMatches.from_bytes(
'我没有埋怨，磋砣的只是一些时间。'.encode('utf_32')
)

After

from charset_normalizer import from_bytes
results = from_bytes(
'我没有埋怨，磋砣的只是一些时间。'.encode('utf_32')
)

Methods that once were staticmethods of the class CharsetNormalizerMatches are now basic functions. from_fp, from_bytes, from_fp and `` are concerned.

Staticmethods scheduled to be removed in version 3.0

• 0424c80 Add workflow_call for ci.yml workflow (reusable) (#307)
• 782885e Fix issue 289, add function is_binary, add explicit support py 3.12 (#306)
• 1b0fb5c :arrow_up: Bump pytest from 7.3.2 to 7.4.0 (#304)
• 3acf08e :arrow_up: Bump mypy from 1.3.0 to 1.4.1 (#305)
• 5c030b5 Replace emoji shortcodes with UTF-8 emoji (#303)
• f9f686b :arrow_up: Bump pypa/cibuildwheel from 2.13.0 to 2.13.1 (#302)
• d42cdaf :arrow_up: Bump slsa-framework/slsa-github-generator from 1.6.0 to 1.7.0 (#301)
• f8e7db1 :arrow_up: Bump pytest from 7.3.1 to 7.3.2 (#300)
• 6f02962 :arrow_up: Bump pytest-cov from 4.0.0 to 4.1.0 (#298)
• 8028c56 :arrow_up: Bump pypa/cibuildwheel from 2.12.3 to 2.13.0 (#299)
• Additional commits viewable in compare view

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)