Phil Wang

@xinmiaolin did it work?

@xinmiaolin how high is your batch size?

ohh that should be good enough ok, keep at it with `1e-5`, i'd be surprised if that didn't work

@xinmiaolin i'll add a learning rate warmup for the decoder trainer some time this weekend; just need to figure out how to make it huggingface accelerate compatible

@xinmiaolin hmm, could you possibly send me your full training script?

oh nice! so the prior network is working then for Katherine?

@rom1504 ahh i see, well it's still good news to hear that the prior works!

> I've got our latest model thrown into the script...and these are the results > > can you tell which one is supposed to be a Siberian husky? 😆 >...

do you have a decoder that's conditioned on the clip image embeddings trained?

ok cool, i'll keep chipping away at the training code - hopefully by the end of the month people with multiple GPUs can at least train something small scale using...