Piji Li

performance of multiplying transposed matrix

1

Here is a problem which I am entangled with: http://stackoverflow.com/questions/22288888/multiplying-transposed-matrix-with-jblas Then any tips to optimize this? Thanks.

FusedAdam Hangs during Initialization

1

I am testing the accelerate training code and I modify the optimizer of: https://github.com/huggingface/accelerate/blob/main/examples/nlp_example.py#L141 to the FusedAdam (from deepspeed.ops.adam import FusedAdam), then after "python ./nlp_example.py" I find that the progress...

thanks