Peter Devine
Peter Devine
**Describe the bug** When trying to deploy my Huggingface model through: ```python predictor = huggingface_model.deploy( endpoint_name = endpoint_name, serverless_inference_config = { "MemorySizeInMB": 1024, "MaxConcurrency": 2, } ) ``` I get...
I have installed the app, and it works great on my Nexus 5X! Except that it is pretty slow. Ideally, I would like the model to generate words faster or...
Hey, first off, love the repo, thanks for providing it. I just have a question about the batch size that the model can handle. When I put in a list...
I don't have access to the GPT-3 API yet (A guy can dream, eh?), but I have been reading through the docs and it seems like the completion module would...
### ⚠️ Please check that this feature request hasn't been suggested before. - [X] I searched previous [Ideas in Discussions](https://github.com/OpenAccess-AI-Collective/axolotl/discussions/categories/ideas) didn't find any similar feature requests. - [X] I searched...
### ⚠️ Please check that this feature request hasn't been suggested before. - [X] I searched previous [Ideas in Discussions](https://github.com/OpenAccess-AI-Collective/axolotl/discussions/categories/ideas) didn't find any similar feature requests. - [X] I searched...
### Reminder - [X] I have read the README and searched the existing issues. ### Reproduction I would like to know if there is an option to evaluate the model...
# Why * Chatbot training is probably the most common single use-case for TRL. * As such, it would be nice to give a developer the option to mask the...
Hey, first of all, thanks for the great repo. This is great work. I think I have found a bug regarding how the data is split in qlora.py When you...
### Please check that this issue hasn't been reported before. - [X] I searched previous [Bug Reports](https://github.com/OpenAccess-AI-Collective/axolotl/labels/bug) didn't find any similar reports. ### Expected Behavior When I run a training...