Glenn 'devalias' Grant

Partially related context: > I can see that the instructions are in the README here: > > - https://github.com/jehna/humanify#local-mode > > Which suggests I need to run `humanify download 2b`...

> I don't know where the model will be located as I didn't analyse the source code yet `~/.humanifyjs/models` https://github.com/jehna/humanify/blob/14e4ae536588935edada4438cf28b3b5553b2596/src/local-models.ts#L13-L25

Some more relevant links/functions/etc that could be used here: - https://node-llama-cpp.withcat.ai/guide/downloading-models - > **Downloading Models** > `node-llama-cpp` is equipped with solutions to download models to use them in your project....

FYI: It looks like @jehna opted for directly using `ipull` in this PR: - https://github.com/jehna/humanify/pull/166 Rather than the `createModelDownloader` / `combineModelDownloaders` abstractions from `node-llama-cpp` mentioned above in https://github.com/jehna/humanify/issues/58#issuecomment-2381885999

Related issues: - https://github.com/jehna/humanify/issues/2 --- > The top answer does suggest implementing a "back-off" feature, similar to rate-limit prevention techniques. Is it possible to do this? or is there another...

> Does the following seem like an accurate ratio between input and output tokens? @Bruno-Alumn I don't really know what the ratios should look like specifically.. but I would definitely...

> I'm trying to process a pretty huge file and just ran into this: > > ``` > RateLimitError: 429 Rate limit reached for gpt-4o-mini in organization org-abcdefghijklmnopqrstuvwx on requests...

@marijnbent That makes sense, as I don't think any PR's have been merged to change the code to introduce rate limiting/etc. Have you tried hacking something like the workaround proposed...

Potentially duplicate of/similar root cause as the following issues: - https://github.com/jehna/humanify/issues/10 - https://github.com/jehna/humanify/issues/71 - https://github.com/jehna/humanify/issues/50 With some notes from there: > If anyone still cannot make it work in Windows...

> This part might not matter (not 100%, just guessing): > > ``` > npm warn cleanup [ > npm warn cleanup 'C:\\Users\\Administrator\\AppData\\Roaming\\npm\\node_modules\\humanifyjs\\node_modules', > npm warn cleanup [Error: EPERM: operation...