BentoML icon indicating copy to clipboard operation
BentoML copied to clipboard

The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!

Results 244 BentoML issues
Sort by recently updated
recently updated
newest added

## What does this PR address? Fixes #2888 eg ```yaml runners: timeout: 400 #seconds ``` only global configuration is respected. ## Before submitting: - [ ] Does the Pull Request...

This is an issue that occurred when you received API with FastAPI and created BentoML Docker Image. Returns the home modified with build_ctx to correct errors that could not be...

## What does this PR address? ## Before submitting: - [x] Does the Pull Request follow [Conventional Commits specification](https://www.conventionalcommits.org/en/v1.0.0/#summary) naming? Here are [GitHub's guide](https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/proposing-changes-to-your-work-with-pull-requests/creating-a-pull-request) on how to create a pull...

solution: * only allow scheduling_strategy to control the env variables * setting up environ before importing bentoml WARNING: a breaking change for a not documented public API `custom scheduler`

## What does this PR address? Fixes #2770 With this change, the `NvidiaGpuResource` will accept and return a list that specifies the exact GPUs to use. This enables the user...

## What does this PR address? adding gRPC support for the remaining of the IO descriptor Pandas will be handled by @Proto007 Test will be with a follow up PR....

### Describe the bug I inquired about the issue before ==> https://github.com/bentoml/BentoML/issues/2602 First of all, thank you so much for answering my inquiry and giving me a solution. https://github.com/bentoml/gallery/tree/main/custom_runner/torch_hub_yolov5 So...

bug

### Feature request Request from slack DM I would like to save pyspark model with bentoml. A suggested workaround right now is to use a custom runner. ### Motivation _No...

from community