Antti Puurula comments

Repositories
Issues
Comments

Results 23 comments of


                                            Antti Puurula

[Feature] Support for Hugging Face Inference Endpoints custom handlers?

> Hi @anttttti > > It's really hard to create a `handler.py` within TGI itself. The reason is that the current code is a tight loop highly catered for performance....

is it possible to release a python wrapper, like xgboost

TZ: other tree ensemble libraries have Python interfaces, both Scikit-learn and non-sklearn. For example, this is a sklearn wrapper for the original RGF library : https://github.com/fukatani/rgf_python

[Installation]: Failed to build form source code. Python=3.9 CUDA=12.1

Same here, occurring with the latest commits. Ubuntu 22.04.4, Python 3.10, CUDA 12.2, NVIDIA-SMI 535.171.04, torch-2.2.1, gcc 12.3.0 Just installed torch and cudatoolkit a few days ago with previous vLLM...