Suaj Carrot

icon location Earth icon location This is my old account, my new profile can be found here: https://github.com/gerardo-rp

Results 6 comments of Suaj Carrot

Improved quantize script

Thank you for your comment @sw, I just pushed a commit that applies the changes you suggested. Let me know if there's anything else that should be done to achieve...

Improved quantize script

Thank you for merging! Should I create another pull request with the Bash script added back as well as its deprecation notice in the README?

Improved quantize script

That's great, thank you.

Refactoring `convert-pth-to-ggml.py`: more concise and readable

Exactly what I was thinking, however I think a better approach regarding string concatenation for paths is using os.path.join instead simply to avoid typos either by the user or the...

Supported context window length for each model?

Just mentioning here that although I couldn't manage to get longer outputs (issue #210), the quality increased A LOT by setting the tokens to predict to 2048. Huh.

Supported context window length for each model?

@setzer22 Of course! What makes me think the quality increased is that the model actually seems to be creating new texts as well as understanding the context, before that it...