ecosystem

ecosystem copied to clipboard

I am running the docker mnist example using distributed training with kubernetes template project. I had created train.tfrecords and stored as volume for all the images under /tmp/data. All the...

asheeshgarg

Hi, I came across the same issue with #104 when using spark-submit to generate TFRecords. I analysis the dependency using 'mv dependency:tree' command and 100% sure there is only one...

Richardxxxxxxx

This link https://github.com/kubeflow/kubeflow/blob/master/user_guide.md#submitting-a-tensorflow-training-job will return 404.

manuzhang

Caused by: java.lang.NoSuchMethodError

1

Caused by: java.lang.NoSuchMethodError: org.tensorflow.example.BytesList$Builder.addValue(Lorg/tensorflow/spark/shaded/com/google/protobuf/ByteString;)Lorg/tensorflow/example/BytesList$Builder; at org.tensorflow.spark.datasources.tfrecords.serde.BytesListFeatureEncoder$$anonfun$encode$3.apply(FeatureEncoder.scala:68) at org.tensorflow.spark.datasources.tfrecords.serde.BytesListFeatureEncoder$$anonfun$encode$3.apply(FeatureEncoder.scala:67) at scala.collection.immutable.List.foreach(List.scala:381) at org.tensorflow.spark.datasources.tfrecords.serde.BytesListFeatureEncoder$.encode(FeatureEncoder.scala:67) at org.tensorflow.spark.datasources.tfrecords.serde.DefaultTfRecordRowEncoder$.org$tensorflow$spark$datasources$tfrecords$serde$DefaultTfRecordRowEncoder$$encodeFeature(DefaultTfRecordRowEncoder.scala:118) at org.tensorflow.spark.datasources.tfrecords.serde.DefaultTfRecordRowEncoder$$anonfun$encodeExample$1.apply(DefaultTfRecordRowEncoder.scala:64) at org.tensorflow.spark.datasources.tfrecords.serde.DefaultTfRecordRowEncoder$$anonfun$encodeExample$1.apply(DefaultTfRecordRowEncoder.scala:61) at scala.collection.immutable.List.foreach(List.scala:381) at org.tensorflow.spark.datasources.tfrecords.serde.DefaultTfRecordRowEncoder$.encodeExample(DefaultTfRecordRowEncoder.scala:61) at org.tensorflow.spark.datasources.tfrecords.DefaultSource$$anonfun$2.apply(DefaultSource.scala:59) at org.tensorflow.spark.datasources.tfrecords.DefaultSource$$anonfun$2.apply(DefaultSource.scala:56) at scala.collection.Iterator$$anon$11.next(Iterator.scala:409) at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:462)...

charmby

Any version of this project can't running

1

org.spark_project.guava.util.concurrent.ExecutionError: java.lang.NoClassDefFoundError: org/codehaus/janino/ClassBodyEvaluator at org.spark_project.guava.cache.LocalCache$Segment.get(LocalCache.java:2261) at org.spark_project.guava.cache.LocalCache.get(LocalCache.java:4000) at org.spark_project.guava.cache.LocalCache.getOrLoad(LocalCache.java:4004) at org.spark_project.guava.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4874) at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$.compile(CodeGenerator.scala:905) at org.apache.spark.sql.catalyst.expressions.codegen.GenerateUnsafeProjection$.create(GenerateUnsafeProjection.scala:412) at org.apache.spark.sql.catalyst.expressions.codegen.GenerateUnsafeProjection$.create(GenerateUnsafeProjection.scala:366) at org.apache.spark.sql.catalyst.expressions.codegen.GenerateUnsafeProjection$.create(GenerateUnsafeProjection.scala:32) at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator.generate(CodeGenerator.scala:889) at org.apache.spark.sql.catalyst.expressions.UnsafeProjection$.create(Projection.scala:130) at org.apache.spark.sql.catalyst.expressions.UnsafeProjection$.create(Projection.scala:120) at org.apache.spark.sql.catalyst.expressions.UnsafeProjection$.create(Projection.scala:114) at org.apache.spark.sql.execution.RDDScanExec$$anonfun$doExecute$2.apply(ExistingRDD.scala:194) at...

charmby

TensorFlow on Apache Ignite

2

[Apache Ignite](https://ignite.apache.org/) is a memory-centric distributed database. The goal of TensorFlow on Apache Ignite is to allow users to train and inference neural network models on a data stored in...

dmitrievanthony

I try to use mvn to build hadoop project by following the link https://github.com/yahoo/TensorFlowOnSpark/wiki/GetStarted_YARN. After I run `mvn clean package -Dmaven.test.skip=true` the files in ./target is drwxr-xr-x 8 root root...

kyauaa

TensorFlow on Hadoop YARN

11

Hadoop YARN is a commonly deployed cluster manager. Having the ability to run TensorFlow on YARN would be very useful in such environment. Our team is currently working on a...

tslam75

Does Spark tf connect support in memory transform?

1

I have a lot of data in parquet format on hdfs, which I want to use for tensorflow. Currently, I can read parquet files into spark and output the dataframe...

darouwan

Do we have official docker image for distributed training sample in docker hub?

1

Just for https://github.com/tensorflow/ecosystem/tree/master/docker? I can see the docker file, but not official docker image. Can we provide the official images? Thanks.

cheyang