Rahul Solanki comments

Repositories
Issues
Comments

Results 13 comments of


                                            Rahul Solanki

handle weight sharing with init_on_device

I'll add some tests soon. Context for the change: For our pipeline parallel implementation [here](https://github.com/aws-neuron/neuronx-distributed/blob/main/src/neuronx_distributed/pipeline/model.py#L46), we first create the model and then trace it, use the traced model to partition...

While operator test generates condition input as a parameter instead of a constant

I want the ability to unroll the while loop, which requires the xla to know the trip count. I generated the constant by using xla_builder and passed that as input...

While operator test generates condition input as a parameter instead of a constant

So for the while loop unroller pass in openxla, the condition input to the while loop needs to be a constant for the unroller pass to determine the trip count....