Yitong Huang comments

Repositories
Issues
Comments

Results 2 comments of


                                            Yitong Huang

Using CC ops with mark_sharding API throws an error.

Based on previous experience, you will need to do the following things on GPU: 1. Support communication operations such as all-reduce on the Python side within SPMD. For example, support...

Unexpected memory usage by the view op

@JackCaoG Yes, I am aware that view operations cannot be expressed in HLO, but with the introduction of aliasing, these operators should use the same buffer during buffer assignment. As...