jax icon indicating copy to clipboard operation
jax copied to clipboard

Document Named Collectives

Open lockwo opened this issue 1 year ago • 2 comments

Named collectives have come up before in documentation for pmap/shmap, but usually links to https://jax.readthedocs.io/en/latest/jax.lax.html#parallel-operators (other relevant issue: https://github.com/google/jax/issues/13794). However, these also work for things such as vmap and I think warrant more documentation, since I discovered them via: https://github.com/google/jax/discussions/22974#discussioncomment-10317061. My proposal is to have a list of all collectives that work under vmap (somewhere) in the docs.

lockwo avatar Aug 12 '24 21:08 lockwo

It seems like this would best fit in an advanced vmap guide, probably related to the work in #18585 (which I've neglected for far too long...)

jakevdp avatar Aug 14 '24 18:08 jakevdp

Are there any links left ?

doshi-kevin avatar Aug 26 '24 11:08 doshi-kevin