Izak Marais

A possible solution might be to expose the max-batch-size setting on the BulkInferrer Inference spec proto and pass it all the way through. If I had a way of fixing...

I am repeatedly getting this same bug with the **Transform component** too. `Node: 'xception/block2_sepconv1/separable_conv2d' OOM when allocating tensor with shape[512,128,167,167] and type float`. Full logs: [downloaded-logs-20230413-082707.json.zip](https://github.com/tensorflow/tfx/files/11218815/downloaded-logs-20230413-082707.json.zip) This is using the...

> Splitting the dataset into 12 (180k examples each) and running a separate Transform for each resulted in 11 of the 12 Transforms passing and one failing with a similar...

That sounds promising, thank you. I would very much like to upgrade, but unfortunately I am blocked by https://github.com/tensorflow/recommenders/issues/671. Once that is resolved, I will give feedback.

Thanks for the tips. I would like to apply them to the Transform component. > Depending on how exactly you use transform and BulkInferrer you may also be able to...

Thanks for the confirmation, will let you know once we test 1.13 after a compatible ScaNN release has been made.

A new release of ScaNN is available but [it looks like they skipped tensorflow 2.12 altogether and went from 2.11 to 2.13](https://github.com/google-research/google-research/issues/1594#issuecomment-1682255720). I will wait for a future release of...

~~While trying to test this in 1.14.0, I got blocked by https://github.com/tensorflow/tfx/issues/6335.~~ Resolved. I have upgraded to TFX 1.14.0. This wil be tested in the next scheduled run of the...

The upgrade to TFX 1.14.0 was held back by https://github.com/tensorflow/tfx/issues/6386. I am now applying the workaround mentioned there and should then have results after the next scheduled run at the...

Unfortunately the fix does not work. The Transform component running TFX 1.14.0 ran out of memory on the 16GB GPU in exactly the same way as [described previously](https://github.com/tensorflow/tfx/issues/5777#issuecomment-1506421387).