Almog Segal comments

Results 8 comments of


                                            Almog Segal

UCC returns an error when modifying non-existing TLs in context config

@manjugv please review.

UCC returns an error when modifying non-existing TLs in context config

Below is how my output looks like when I run with 16 processes, it makes it harder to find what I need in the output when I run with more...

jax.scipy.sparse.linalg.cg inconsistent results between runs

After some debugging, I found out that cuSPARSE isn't being called. The `from_scipy_sparse` function sets `indices_sorted=False` and then in `_bcoo_dot_general_gpu_lowering` the `_bcoo_dot_general_default_lowering` function is being called based on the `indices_sorted`...

jax.scipy.sparse.linalg.cg inconsistent results between runs

@jakevdp do have a suggestion what may be wrong in _bcoo_dot_general_impl? Is it the same algorithm that is being used for TPUs/CPUs?

UCC returns an error when modifying non-existing TLs in context config

@manjugv it definitely does. Thank you! For long term, I think it would be nice to be able to query the context as I suggest so libraries and other users...

Provide a NCCL-like initialization mechanism

@manjugv FYI.

Provide a NCCL-like initialization mechanism

> We discussed this in our WG. When you don’t give OOB, we need Allgather in the implementation and this feature is lacking in the implementation. This requires a lot...

TL/UCP: Add support for active_set broadcast with knomial and dbt for size greater than 2

The use-case for that is to be able perform a "broadcast" on row/col comms without having to create these comms. For linear algebra functionality, when you use 2DBC data layout,...