Ben Gubler
Ben Gubler
Create a pull request with what you have if you think it looks good or want feedback.
@taruchit That would be great! Here are some possible ideas: - Improve the styling of the website - Write a script to automatically fetch the Readme from Github and parse...
For now, we're using GitHub Pages, thanks to the most recent pull request by Nimish Mishra. For any potential contributors, remember to enable GitHub Pages on your repository so we...
This isn't supported by the library right now, but PRs are welcome!
I am extremely interested in the solution to this... running out of memory (my node w/ 128GB of RAM is crashing) while training a 128K-vocab tokenizer
I'd be open to merge a PR supporting this!
Looks good! I think it might be better as a separate function though.
As I'm thinking about this, I don't know if this functionality belongs in npm-to-yarn. If a user wants to display the command in a codeblock, they can add syntax highlighting...
I think it might be nice as a separate package to integrate. The rest of #60 looks good to me though.
@Jay-Karia Yeah tests would be great, thanks