ecosystem icon indicating copy to clipboard operation
ecosystem copied to clipboard

TensorFlow on Apache Ignite

Open dmitrievanthony opened this issue 6 years ago • 2 comments

Apache Ignite is a memory-centric distributed database. The goal of TensorFlow on Apache Ignite is to allow users to train and inference neural network models on a data stored in Apache Ignite utilizing all TensorFlow functionality and Apache Ignite data collocation abilities.

Our team is currently working on an Apache Ignite for this purpose, corresponding task is IGNITE-8335 in Apache JIRA. We would like to contribute our work here as well as accept any contribution.

As a first step we'd like to publish the first version of our design document. We will be grateful for any comments and remarks regarding this document and any other ideas from TensorFlow community.

dmitrievanthony avatar Apr 27 '18 16:04 dmitrievanthony

@dmitrievanthony Does this mean that in near future Rapids which depends on Apache Arrow can support tensorflow? Currently, only PyTorch and Chainer might be supported.

pbk0 avatar Nov 19 '18 02:11 pbk0

Hi, @SpikingNeurons. In case of Apache Arrow it makes sense to keep looking at https://github.com/tensorflow/tensorflow/pull/23002 pull requests (the goal of it is to add Apache Arrow support into TensorFlow).

dmitrievanthony avatar Nov 19 '18 08:11 dmitrievanthony