[Bug]: Issues with generating new dictionaries using cspell-tools

[gothrek22]

Kind of Issue

Runtime - command-line tools, Building / Compiling

Tool or Library

cspell-tools

Version

8.14.4 and 8.15.2 for cspell-tools-cli

Supporting Library

No response

OS

Other

OS Version

Doesn't really matter

Description

Thanks for the great software.

I've been trying to help out by converting the Hunspell Korean dictionary into a cspell compatible source. But no matter what I try when running conversion, I get core dumps.

That's for sure caused by the size of the dict (11 mb for .aff 44 mb for .dic), I've tried bumping Max old space size up to 60 gigs (I've 64 gigs available right now), and it still dies. Any idea how I could split this job into chunks, so it runs longer but doesn't die?

Reporting this as a bug, because it seems to me that it tries to load up everything at once into memory and process it there, which causes it to run out (probably would run out until some ludicrous size).

Steps to Reproduce

No response

Expected Behavior

No response

Additional Information

No response

cspell.json

No response

cspell.config.yaml

No response

Example Repository

No response

Code of Conduct

• [X] I agree to follow this project's Code of Conduct