How easy it is to externalize the visibility of the benchmarks we already run continuously?

Open bhack opened this issue 5 years ago • 1 comments

This a pinpoint to not lost the benchmarking subthread started at https://github.com/tensorflow/tensorflow/pull/33945#issuecomment-652471742

Quoting @zongweiz

We have [TF2 benchmarks] (https://github.com/tensorflow/models/tree/master/official/benchmark) from every official model garden model and they continuously running internally, using PerfZero framework. We should be able to select a set of benchmarks and hook it up with github CI (jenkins). Added @sganeshb to this thread for information and we will follow up. Another thought is to start CI tests using a selected set of tf_benchmarks

/cc @alextp @naveenjha123 @sganeshb

Jul 02 '20 17:07 bhack

Is it ok to track this here?

Jul 15 '20 15:07 bhack