serve

serve copied to clipboard

## Description The CI runs can be flaky because of network issues. Added a retry action to run the sanity script with the following properties - Timeout = 60 minutes...

agunapal

Commit 4f7caa30bae521ae1e4b0ac337884e35f2734af2 daily scheduled [CI run](https://github.com/pytorch/serve/actions/runs/3102593621) failed, please check why

github-actions[bot]

Validate torchserve process in pid file before starting

3

## Description Fixes #1862 - There's an edge case where if `.model_server.pid` file is not deleted when torchserve stops abruptly and another process with same pid is started before torchserve...

rohithkrn

I think i have started the model successfully,but there is some trouble i can't find

1

### 🐛 Describe the bug i can't curl it, in fact i can find that the port(8080) not in use, may you give me some help ### Error logs 2022-09-16T19:38:09,388...

jdddp

Show warning to increase `max_response_size` if `CorruptedFrameException`

2

### 🚀 The feature A few customers I've chatted with have been confused with a `CorruptedFrameException` error https://github.com/pytorch/serve/issues?q=CorruptedFrameException The fix is to increase the `max_response_size` in `config.properties` so we should...

msaroufim

Add linting steps to doc-automation workflow

13

spellcheck and linkcheck was added to workflow yml file. ## Checklist: - [x] Did you have fun?

sadra-barikbin

Kserve v0.9.0 release fixes log4j security vulnerability issue: https://github.com/kserve/kserve/releases/tag/v0.9.0 torchserve-kfs 0.6.0 docker image currently uses kserve v0.8.0 Can we please upgrade the kserve version and release a new version of...

mansigoel

dense161 example

2

### 🐛 Describe the bug Hi the default densnet161 example worked but when I tried to run it with ts/torch_handler/densenet_handler.py it looked like stuck on the request curl http://127.0.0.1:8080/predictions/densenet161 -T...

divastar

Streaming video inference with client-side batching

1

## Description For some near real-time streaming video applications, there might be a need for batching on the application side. This example shows how this can be achieved using TorchServe....

agunapal

### 🚀 The feature Torchserve needs to verify the [pid](https://github.com/pytorch/serve/blob/master/ts/model_server.py#L39) is a real torchserve process. ### Motivation, pitch This feature is able to avoid torchserve restart failure if system reuses...

lxning