OleksandrKorovii
OleksandrKorovii
Is it the proper way to use sequence tagger for multi-label token classification? I have a dataset where one token can have one or more labels.
I tried to implement `token-classification` task but faced a problem like: `{"error": "Failed to process the request(s) for model instance 'transformer_tensorrt_inference_0', message: Stub process is not healthy."}` For the model...
Hi, I run Triton web server on two GPUs NVIDIA RTX3090Ti with `--shm-size 20g`. When I do inference, I get time near `1.56s`. But if I run web server with...