MLServer
MLServer copied to clipboard
Deal with inference models that dont consume directly np.ndarray
trafficstars
The are inference cases e.g. tf models trained with mlflow (TypeError: Only dict and DataFrame input types are supported) that dont consume directlynp.ndarray
In these cases the alibi runtime will not be able to send inference query as currently we only support np.
This might require having to consume the metadata endpoint to decide what to do.