Bairen Yi comments

Results 36 comments of


                                            Bairen Yi

Cannot build due to "Unable to find package for @org_tensorflow//tensorflow/core..."

> This is really sad. TF without MPI on clusters will use the very slow Ethernet connections You could build TF 1.x with built-in MPI support. For TF 2.x, you...

Cannot build due to "Unable to find package for @org_tensorflow//tensorflow/core..."

Also ping @jbedorf who is the author of the MPI plugin.

Optimize verbs with static memory registration and multi request buffers

Thanks for your contribution! The performance figure looks promising. It is interesting to see some additional improvement of the original BFC allocator design, as it already does proactive registration of...

[RFC] PyTorch DistributedTensor

Nit: why post here instead of https://github.com/pytorch/rfcs? Edit: never mind, found https://github.com/pytorch/rfcs/pull/44 :)

Dataset.shuffle leads to worse training performance due to chunked processing

I am working on a "TFIndexedDataset" RFC for externally shuffling dataset whose limit is beyond memory size. Let me know your preferred use case and I will consider adding it...

Dataset.shuffle leads to worse training performance due to chunked processing

> I am working on a "TFIndexedDataset" RFC for externally shuffling dataset whose limit is beyond memory size. Let me know your preferred use case and I will consider adding...