akashe comments

Repositories
Issues
Comments

Results 3 comments of


                                            akashe

[WIP] Add Atlas - Retrieval Augmented Language Model

Hi @ae99, I would also like to contribute. Let me know if there is something I can help you with.

[WIP] Add Atlas - Retrieval Augmented Language Model

Hey @ae99 , are you still working on the integration? If not then let me know, I would be happy to continue from where you left.

[Bug] Auto batch size detection in `generate_ until` is overly conservative

I have had the same experience. The auto batch size detection is way too conservative. I was earlier using 16GB VRAM where it detected auto batch size as 1 for...