semantic-kernel icon indicating copy to clipboard operation
semantic-kernel copied to clipboard

Python: hf sample and generator

Open eavanvalkenburg opened this issue 1 year ago • 1 comments

Motivation and Context

Adds a parameter to the hugging face text completion class to supply the Pipeline, this allows more customization. Added a sample that shows how to setup quantization for HF models. Not ready to use because of differences in setup and hardware.

Closes: #6374

Description

Contribution Checklist

eavanvalkenburg avatar Jun 24 '24 12:06 eavanvalkenburg

Py3.10 Test Coverage

Python 3.10 Test Coverage Report •
FileStmtsMissCoverMissing
semantic_kernel/connectors/ai/hugging_face/services
   hf_text_completion.py431467%92–93, 95, 121–144
TOTAL652972789% 

Python 3.10 Unit Test Overview

Tests Skipped Failures Errors Time
1547 1 :zzz: 0 :x: 0 :fire: 24.262s :stopwatch:

markwallace-microsoft avatar Jun 24 '24 12:06 markwallace-microsoft

@eavanvalkenburg, are you still working on this one? Or should we close it out?

madsbolaris avatar Jul 23 '24 15:07 madsbolaris

@matthewbolanos still want to add this, just has not been a prio, it adds some additional capabilities to the connector as well as a new sample

eavanvalkenburg avatar Jul 24 '24 09:07 eavanvalkenburg

Please re-open if/when we want to get this into main.

moonbox3 avatar Nov 04 '24 16:11 moonbox3