39th president of the United States, probably

Pypi is here https://pypi.org/project/adamw-bf16/ Repo is here https://github.com/AmericanPresidentJimmyCarter/adamw-bf16

> looks like it could be [pytorch/pytorch#118115](https://github.com/pytorch/pytorch/issues/118115) as both optimizers in use that fail in this way do use addcdiv I will look into a fix for this too, if...

@bghira now that you fixed the latents issue, is bf16 training well with my optim?

I am attempting this now training on captions with multiple labels and then querying with single labels, and it works pretty badly compared to any normal multi-label classifier. `{'f1': 0.08291136675917679,...

No, I just trained multilabel classifiers instead and those worked.

> @travellingsasa > > You can do some sort of anti-text or placeholder text to do multi-label classification, ex: > > your objective is checking in there is the presence...

It looks like the weights are right here. https://huggingface.co/nyanko7/LLaMA-7B https://huggingface.co/ricecake/LLaMA/tree/main https://huggingface.co/datasets/nyanko7/LLaMA-65B License is here: https://docs.google.com/forms/d/e/1FAIpQLSfqNECQnMkycAp2jP4Z9TFX0cGR4uf7b_fBxjY_OjhJILlKGA/viewform

As far as I can tell, there is no code in this repo to train an inpainting/outpainting model like the RunwayML model.

Update: there is a training script for inpainting here based off of the ones from diffusers https://github.com/devilismyfriend/StableTuner/blob/main/scripts/trainer.py

So I was unsure how it was pooled before, and we were going through the code trying to figure it out. It seems like ```py pooled_prompt_embeds = prompt_embeds[0] ``` Should...