Javed
I understand, thank you for the clarification. Side comment: When I was talking about React, I was indeed incorrect with my simple description. React would not re-render everything, but it...
any update on this?
Thank you for the kind and fast reply, looking forward to inshallah seeing this feature implemented
A few days I ago, I was wondering about the very same thing. We would only want the masking to be registered as masked, when the tokens are either masked...
@tekinek When it comes to the distribution, here are some snippets of my code. Note that the code was not intended for publication, the comments were just for my own...
Please feel free to correct me, if I made a mistake in the probability distribution calculations
@tekinek thank you, yes, now I see why there is an advantage in not inserting the mask_index inside the else condition. Just for anybody else, who might not understand it...
Hi, I am one of the guys who are into the dark mode and I saw: [https://sphinx-book-theme.readthedocs.io/en/stable/](https://sphinx-book-theme.readthedocs.io/en/stable/ ). It now offers a small icon that enables the switch between light...
This is something I am interested in too.
It seems to work, loading the 3B version without qlora requires 14GB of GPU RAM, with qlora only 3GB VRAM. You can try it for yourself: ``` # Install latest...