serve

serve copied to clipboard

huge performance gap on intel mac metal vs docker

3

### 🐛 Describe the bug The results obtained by running in different environments vary greatly - run in macbook pro 2019 metal - run in the same metal, but use...

yayuntian

Fix #1740: Handle OPTIONS in management API

2

## Description Please read our [CONTRIBUTING.md](https://github.com/pytorch/serve/blob/master/CONTRIBUTING.md) prior to creating your first pull request. Please include a summary of the feature or issue being fixed. Please also include relevant motivation and...

xyang16

Unsupported model output data type

1

### 📚 The doc issue Where is list of supported data type? How could I return numy-array, tensor, or bytes in postprocess()? ### Suggest a potential alternative/fix _No response_

hungtooc

Fixed broken path joins and unclosed files

8

## Description After a bug occurred to me while running over Windows, I found out that there are a lot places in the code where there is a path join...

DPeled

RuntimeError: CUDA error: no kernel image is available for execution on the device

7

I am deploying a model using torchserve. It was easily deployed on Tesla K80 GPU. But now when i shifted it to newer GPU Nvidia A30. I am getting this...

amanjain1397appy

fix: volume permission in kubernetes setup

2

Signed-off-by: jagadeesh ## Description Fixes security context issue while installing TS helm chart. The model-server user own the `/home/model-server` path where the volume is being mounted. Fixes #1337 TS install...

jagadeeshi2i

fix: upgrade hpa with v2beta2 api version

1

Signed-off-by: jagadeesh ## Description Kubernetes hpa object API version upgrade from v2beta1 to v2beta2. V1beta1 will be deprecated from 1.22+ Kubernetes version. Gif of pod autoscaling  ## Type of...

jagadeeshi2i

upgrade PT to 1.12

3

## Description Please read our [CONTRIBUTING.md](https://github.com/pytorch/serve/blob/master/CONTRIBUTING.md) prior to creating your first pull request. Please include a summary of the feature or issue being fixed. Please also include relevant motivation and...

lxning

fix: pv creation for k8s setup

1

Signed-off-by: jagadeesh ## Description Updated the PV creation steps for TS kubernetes with aws-efs-csi-driver as efs-provisioner is not maintained anymore. ## Type of change Please delete options that are not...

jagadeeshi2i

/models returns empty list of models when models is specified

6

### 🐛 Describe the bug Please note that this is related to https://github.com/pytorch/serve/blob/master/docs/configuration.md#config-model I have a config file in the config section below. In the serve logs I can see...

ridhwan-saal