serve

serve copied to clipboard

## Description Please read our [CONTRIBUTING.md](https://github.com/pytorch/serve/blob/master/CONTRIBUTING.md) prior to creating your first pull request. Please include a summary of the feature or issue being fixed. Please also include relevant motivation and...

csJoax

### 🚀 The feature Maybe we need to keep the root dir because: - somtimes the structure is complicated; - somtimes there are the same filenames. ```shell (torch) ➜ pytorch_serve...

csJoax

## Is your feature request related to a problem? Please describe. When multiple models are deployed, it would be helpful to have a functionality to list all models in model...

rashmikaslikar

java.lang.AssertionError: Unexpected nvidia-smi response

1

### 🐛 Describe the bug I'm using pytorch/torchserve:0.6.0-gpu to build my own docker image. when I run the docker image, it raise an error as below **_Starting docker image Warning:...

jack-gits

asyncio example

2

## 📚 Documentation When doing batch inferencing the default way a lot of python programmers will go about it is making a call with `requests`. Unfortunately the library is synchronous...

msaroufim

Error in loading model in Windows os

4

I've noticed that there is an error in the code: https://github.com/pytorch/serve/blob/a4d5090e114cdbeddf5077a817a8cd02d129159e/ts/model_loader.py#L92 There is an attempt to read the `MANIFEST.json` file, and there is use of the `/` charecter which used...

DPeled

### 🚀 The feature According to [PyTorch installation instruction](https://pytorch.org/), Torchserve needs to update PyTorch installation and docker for Mac M1. "MacOS Conda binaries are for x86_64 only, for M1 please...

lxning

DLRM example

1

please provide [DLRM](https://github.com/facebookresearch/dlrm) example. ## Is your feature request related to a problem? Please describe. ## Describe the solution ## Describe alternatives solution

lxning

Any examples on serving Speech2Text models from Huggingface, such as Wav2Vec2 ?

6

### 🚀 The feature As far as I know, there are no examples or documentation on serving Speech2Text models from Huggingface, such as Wav2Vec2. How could I enable serving with...

thangld201

## 📚 Documentation Need to touch on * [x] `pre-commit` #1598 * [x] Linting in CI #1645 * [x] Move to squash and merge - done in Github settings *...

msaroufim