mlstacks icon indicating copy to clipboard operation
mlstacks copied to clipboard

Add `huggingface` model deployer support

Open strickvl opened this issue 10 months ago • 6 comments

ZenML recently added support for the use of Hugging Face as a model deployer. This issue would bring support for that into mlstacks through a stack component. The component would probably be quite simple, as all that needs to happen is to define the interfaces and the output as part of the stack.yaml file. This would allow the deployer to be seamlessly imported into core ZenML and used.

The update would include:

  • the core implementation
  • documentation updates for all cloud providers
  • any testing needed (probably minimal for this one)

strickvl avatar Apr 03 '24 06:04 strickvl

Hi, I’m interested in working on this issue. I have experience with Python and some AI concepts, but I’m new to ZenML and Hugging Face. I’m eager to learn and would appreciate any initial guidance or resources you can provide. Could I be assigned to this issue? Thanks!

sanskriti2005 avatar Jun 05 '24 15:06 sanskriti2005

This probably needs less ML / AI and more just Python + a willingness to see how mlstacks works. I'd suggest you get to know the codebase and play around with it (try the k3d provider as it's free). Happy to assign it to you and please let me know when you have any questions.

strickvl avatar Jun 05 '24 15:06 strickvl

Alrighty, thank you!

sanskriti2005 avatar Jun 05 '24 15:06 sanskriti2005

@strickvl I encountered an issue while trying to install mlstacks. It seems there's a conflict with the PyYAML dependency version. mlstacks insists on installing PyYAML 6.0 version.

I installed the dependencies externally and successfully installed the latest PyYAML 6.0.1 version as well as other dependencies but when I tried to install mlstacks I ran into an error as mlstacks insists on downloading PyYAML 6.0 version.

sanskriti2005 avatar Jun 06 '24 03:06 sanskriti2005

I would like to work on this if it is available @strickvl

parthmshah1302 avatar Jul 10 '24 23:07 parthmshah1302

@parthmshah1302 this is actually being worked on by @sanskriti2005. There is an open PR already for this request...

strickvl avatar Jul 11 '24 08:07 strickvl