recommenders icon indicating copy to clipboard operation
recommenders copied to clipboard

Question: examples/best practices for integrating tfrs with tfx

Open yrianderreumaux opened this issue 3 years ago • 7 comments

I am currently working on integrating a tfrs model into an existing TFX pipeline to provide on-service recommendations. I am quite new to both TFX and tfrs and am not seeing any resources on integrating the two. I want to be sure I am implementing best practices–in particular with TFT and TFMA. Does anyone know of existing docs that may help me with this, or better yet, an existing example pipelines? I posted a similar question on the forum but have not received any feedback. Maybe @maciejkula, you would have some insight?

Any help would be much appreciated!

yrianderreumaux avatar Oct 04 '21 16:10 yrianderreumaux

any updates on this?

yrianderreumaux avatar Oct 15 '21 01:10 yrianderreumaux

Hello, can you send the detailed code for saving the model? I want to save the model now, but I don't know how to implement it

Jobo-RS avatar Nov 22 '21 12:11 Jobo-RS

TFX ExampleGen does not currently support TFDS (https://github.com/tensorflow/tfx/issues/2027). This is a limitation on TFX.

One hacky way to do it is to just feed an empty csv to CsvExampleGen but do all the data ingestion in the trainer. Or you can create a custom ExampleGen (I think).

Once you figure out the ExampleGen part, the rest of the pipeline should just work.

windmaple avatar Jan 12 '22 03:01 windmaple

We have released a ranking tutorial with TFX.

windmaple avatar Mar 31 '22 01:03 windmaple

@windmaple will there be a TFRS-TFX tutorial using all components?

MyPetOctocat avatar Jun 09 '22 12:06 MyPetOctocat

Our TFX colleague @rcrowe-google is working on one

windmaple avatar Jun 10 '22 04:06 windmaple

This new TFX+TFRS retrieval tutorial (https://www.tensorflow.org/tfx/tutorials/tfx/recommenders) has finally landed. It uses all major TFX components.

Thanks to the hard work from @rcrowe-google.

windmaple avatar Oct 27 '22 10:10 windmaple