whythisusername
whythisusername
@KohakuBlueleaf Since someone already reported this issue, can confirm something changed specifically after 2.2.0.dev7 update (tested prev and after versions) that drops the speed from ~1.5 it/s to ~1.5s/it with...
@KohakuBlueleaf Yeah, here is some speed measurements between two versions, dropout significantly affects the speed with the latest, still a little slower than old version without it though - 2.2.0.dev7...
@KohakuBlueleaf yes, haven't significantly changed - 2.3.0.dev10 with dropout: 1021/2500 [20:14
@KohakuBlueleaf It's way more better now with my config, but still a little slower than it was with 2.2.0.dev7 - 3.0.0.dev4 with dropout: 1224/2500 [17:51
@KohakuBlueleaf Almost on par with old performance now - 1983/2500 [27:16
> but does adding this param to the end here change anything? No, still the same error
> please try latest main Still the same error for me
> downgrade pytorch to 2.3.1 @tanis2010 Can you give me a hint on commands you was using to downgrade everything to the 2.3.1 version to test that?