benchmarks
benchmarks copied to clipboard
tensorflow
A benchmark framework for Tensorflow
Due to refactoring in the tf models repo, the estimator benchmarks seem to have moved or no longer exist. For example, running the following command ``` $ python3 lib/benchmark.py \...
Execute: ` python3 perfzero/lib/benchmark.py --git_repos="https://github.com/tensorflow/models.git;benchmark" --python_path=models --data_downloads="gs://tf-perf-imagenet-uswest1/tensorflow/cifar10_data/cifar-10-batches-bin" --benchmark_methods=official.r1.resnet.estimator_benchmark.Resnet50EstimatorBenchmarkReal.benchmark_graph_1_gpu` Error: ``` [...] benchmarks/perfzero/lib/perfzero/utils.py", line 288, in run_commands cmd, exit_code, stdout)) Exception: "['gsutil', '-m', 'cp', '-r', '-n', 'gs://tf-performance/auth_tokens/benchmark_upload_gce.json', '/benchmarks/perfzero/workspace']" failed with code:1...
Hello community and devs, a quick question from my side. I see that tf_cnn_benchmark is no longer actively maintained. I see that this makes sense to reduce the code volume...
I am running distributed Tensorflow with GRPC protocol on only CPUs. I enabled distributed_all_reduce type of variable update with 'all_reduce_spec = xring': I am wondering, if this mode is supposed...
Hi I'm trying to evaluate the performance of each worker independently in a cluster with multiple machines while training them using the same model. My goal is to record each...
I was running SSD on 4 nodes, each has 8 GPUs Here is my running code: (I can't include the mpirun or the format will be bad) ` mpirun -np...
hi all, I am running Alexnet with benchmark 1.12 but getting the different performance. I saw in the trace log that the metric "jitter" is different on each test with...
I am trying to run perfzero on Openshift/RHEL platform. Getting error while building docker image. Need to know whether perfzero supports for openshift platfom ? can anyone help me on...
the model path is changed to under r1. Also added specific branch name for model git repo
