BentoML icon indicating copy to clipboard operation
BentoML copied to clipboard

feature: make sync_with_hub_version optional

Open Epsilon314 opened this issue 1 year ago • 2 comments
trafficstars

Feature request

When starting service bento tries to access hf hub, which is blocked in deploy cluster. Found an inner parameter sync_with_hub_version to control this feature, would it be possible to config this feature somewhere?

Motivation

No response

Other

No response

Epsilon314 avatar Dec 22 '23 11:12 Epsilon314

@Epsilon314 sorry for the late response, but sync_with_hub_version by default is already set to False.

aarnphm avatar Jan 11 '24 03:01 aarnphm

@Epsilon314 sorry for the late response, but sync_with_hub_version by default is already set to False.

@aarnphm thanks for ur reply

backtracing that hf hub access leads to this method call: https://github.com/bentoml/BentoML/blob/b954ee7b44c5c8d5ba4bb01362d03b8e33579c70/src/bentoml/_internal/frameworks/diffusers_runners/utils.py#L61

perhaps it only applies to diffuser based models, or i am not on the correct branch?

Epsilon314 avatar Jan 11 '24 11:01 Epsilon314