rust icon indicating copy to clipboard operation
rust copied to clipboard

Published 20 hours ago • verified publisher icon tensorflow

Distributed training

Open rhobro opened this issue 2 years ago • 4 comments

Hi there,

Like tensorflow python has tf.distribute, what is the equivalent for the rust version?

Thanks

rhobro avatar May 08 '22 14:05 rhobro

there should be something in the private section of the codebase under config where you can specify this (I am basing this off memory) I'll follow up with more information when I get back to deving this project (I want to use TPUs which is a strategy spec).

Corallus-Caninus avatar Jul 07 '22 21:07 Corallus-Caninus

Upon searching the repo for "distribut" it doesn't return any results.

rhobro avatar Jul 09 '22 18:07 rhobro

You would probably pass the strategy as a string into a config struct.

Corallus-Caninus avatar Jul 19 '22 11:07 Corallus-Caninus

https://www.tensorflow.org/api_docs/cc/class/tensorflow/client-session#classtensorflow_1_1_client_session_1ac52798100986741ff24aba4a758d8e4d

Shows how a client can connect and it seems with SessionOptions you can specify these parameters.

https://docs.rs/tensorflow/0.19.1/tensorflow/struct.SessionOptions.html

I might be trying this soon and am also unsure.

Corallus-Caninus avatar Jan 15 '23 15:01 Corallus-Caninus