Hao Li

The issue is finally solved by this commit: https://github.com/torch/nn/commit/738057ed24c83a47242ab4eb70c30335add804ac

Hi Joeri, Thanks for the suggestion! I haven't updated the list of distributed optimization for a while. I will read it and add it later! Thanks, Hao

Yes, the installation errors occurs when I use `luarocks make mpit-openmpi-1.rockspec`. I build openMPI-2.0.1 following the instructions of https://www.open-mpi.org/faq/?category=building#easy-build and I can compile and run sample programs in C with...

Exactly, this [line](https://github.com/Stability-AI/stablediffusion/blob/main/ldm/modules/attention.py#L318) needs to be fixed as described above. It happens to work when `model_channels` can be divided by `num_head_channels` but fails for other cases, e.g., `model_channels` can be...