Hanif Leoputera Lim
Hanif Leoputera Lim
Downgrade to RN 0.68. The older Skia module isn't compatible with RN0.69.X https://github.com/Shopify/react-native-skia/issues/624
Hey @mrousavy, what do you mean by reverse the Path?
Hey Chris Pader, I was playing around with the Spline interpolation method you integration in this PR. I think it might not be implemented correctly, as there were a few...
No worries, thanks for working on this! I have been trying to fix the interpolation issue as well. The current bezier curves only results in such blocky graphs when data...
@chrispader, are there any updates on this?
Hey @gkucsko, I've tried intergrating LoRa using this repo (https://github.com/cccntu/LoRAnanoGPT/pull/1/files). I think I got the model right, however, I noticed that this repo don't have the trainer.py code out. I'm...
@lukasmoellerch Could you share your branch, maybe a second eye can help?
It seems like the alibi-bias in replitLM is calculated differently from how ggml calculates the alibi-bias. [ReplitLM](https://github.com/replit/ReplitLM/blob/c756e0e62b5b5d01461f00e020f17635065c6e5b/replit-code-v1-3b/attention.py#L407) does so by applying an exponentially decreasing bias for each attention head. In...
Actually, you’re right. The max_alibi_bias is fortunately hard-coded to be 8, the same as replit, and it indeed scales as replit does after I tested it out by hand. I...
I can see if I can hell to implement the tokenizer, what’s the idea behind making them into a trie? I saw other ggml ports, including bloomz and neox, they...