DeepRec icon indicating copy to clipboard operation
DeepRec copied to clipboard

[Modelzoo] Add serving for DIEN, DeepFM and WDL.

Open Zhang-Zhenning opened this issue 3 years ago • 7 comments

I have finished exporting savedmodel for models in modelzoo. Under Deeprec/modelzoo there is a Get_SavedModel.md for new user to learn how to export and where the result model will locate.

Zhang-Zhenning avatar Jul 15 '22 09:07 Zhang-Zhenning

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

CLAassistant avatar Jul 15 '22 09:07 CLAassistant

for #232

shanshanpt avatar Jul 17 '22 10:07 shanshanpt

CLA required.

shanshanpt avatar Jul 17 '22 10:07 shanshanpt

I have finished exporting savedmodel, extracting data from the input file to generate requests and serving for DIEN DeepFM WDL under modelzoo/features/EmbeddingVariable, please check. One thing that needs to be emphasized for models with non-string inputs like DIEN, is the model_instance.cc will automatically run CreateWarmup to accelerate real serving, which is inappropriate under cases such as the input placeholders don't have a fixed length. During my local test I comment it out, please contact me if there is any problem.

Zhang-Zhenning avatar Jul 25 '22 09:07 Zhang-Zhenning

先删除掉不必要的修改。

shanshanpt avatar Jul 28 '22 02:07 shanshanpt

请问下,这个代码还是没有合并嘛? 现在仍然只有训练,没有推理部署,文档也没说

gumanchang avatar Oct 25 '23 09:10 gumanchang

请问下,这个代码还是没有合并嘛? 现在仍然只有训练,没有推理部署,文档也没说

DeepRec 本身具备推理的能力,这个PR只是这三个model 的推理例子,你可以参考

candyzone avatar Oct 25 '23 10:10 candyzone