How to link more than one models to one application?

[Insullone]

I deployed two modes and tried to link them to one application, but I got error:

19-02-07:13:25:52 ERROR [clipper_admin.py:258] Received error status code: 400 and message: Applications must be linked with at most one model. Attempted to add links to 2 models.

I checked the code in function std::string add_model_links(const std::string& json) in clipper/src/management/src/management_frontend.hpp, and I find an extract of code is:

// Confirm that the user supplied only one model_name if (model_names.size() != 1) { std::stringstream ss; if (model_names.size() == 0) { ss << "Please provide the name of the model that you want to link to " "the application " << "'" << app_name << "'"; } else { ss << "Applications must be linked with at most one model. "; ss << "Attempted to add links to " << model_names.size() << " models."; }

It seems that only one model is allowed to link to one application. Can we link two models? Later, I also want to do some experiments on the policy selection layer in the query frontend, and the experiments will be meaningless if only one model is linked. Could anyone help me? Thank you.

[withsmilo]

@Insullone : Hi, Current Clipper supports only the link between one model and one application. I found an old issue, @simon-mo , do you know the progress of this issue?

[rkooo567]

Hi, @withsmilo, @Insullone. Currently, some people are working on query frontend proxy to support the connection of many models to one application. This feature will be on the next version of Clipper I believe.

[rkooo567]

Some people are planning to work on flask app to enable this, but we are not sure when it will be released. The quick solution you can do is to use this solution. https://github.com/ucbrise/clipper/issues/683