Mark Schmidt

Results 95 comments of Mark Schmidt

> This is a mass message from the AutoGPT core team. Our apologies for the ongoing delay in processing PRs. This is because we are re-architecting the AutoGPT core! >...

> Also not a good idea to beg for merge IMO. I understand it's strange. But the linked Wiki article basically says to do exactly that. "[2. push for your...

Ideally 4bit PEFT like [https://github.com/johnsmith0031/alpaca_lora_4bit,](https://github.com/johnsmith0031/alpaca_lora_4bit,) as this enables training 33b (30b) in under 24GB of VRAM on consumer cards like a single 3090.

[KoboldAI Main](https://github.com/KoboldAI/KoboldAI-Client) / [KoboldAI "United" Beta](https://github.com/henk717/KoboldAI) already handle dozens of models for chatAI. Kobold is used as a back-end for [TavernAI](https://github.com/TavernAI/TavernAI) which is the most popular chat front end next...

> Does this mean there could be a Google Colab page sometime for people to run models there for free? Text-generation-webui has a nice colab which opens in chat mode...