MLServer
MLServer copied to clipboard
merging the huggingface and mlserver batch variable
trafficstars
As per https://github.com/SeldonIO/MLServer/pull/740#discussion_r981259626 it would be possible to just merge both huggingface batch variable into the mlserver batch variable for less redundancy in the model-settings.json file.