Henry Tang

HuggingFace Accelerate Support for Gaudi

1

This requirement is HuggingFace Accelerate to support the Gaudi architecture, a high-performance AI accelerator developed by Habana Labs.

support local GPU server without runhouse !!!

2

### Feature request Hi guys, can we just launch SelfHostedEmbedding without runhouse, as a matter of fact, runhouse its self is still in the early development stage and has some...

Hit "failed to rsync up" to test test_self_hosted_huggingface_instructor_embedding_documents()

4

**Describe the bug** Test with langchain function self_hosted_huggingface_instructor_embedding_documents(), it transfers small files from client to server, the client hits the following error during the process: INFO | 2023-08-01 21:57:49,547 |...

A100 8GPU machine with NVLink connections; docker image: nvcr.io/nvidia/pytorch:23.12-py3; git clone https://github.com/foundation-model-stack/fms-fsdp.git git clone https://github.com/foundation-model-stack/foundation-model-stack.git git clone https://github.com/huggingface/optimum-nvidia.git cd foundation-model-stack pip install -e . cd ../fms-fsdp/ pip install -r requirements.txt...

The default model variant is 7b but it is not supported.

2

the default model variant is "7b": https://github.com/foundation-model-stack/fms-fsdp/blob/65b0ea670fa375bb0f7f6a285e7229bb96ebdd0f/fms_fsdp/config/training.py#L8 but it is not in the supported white list: https://github.com/foundation-model-stack/fms-fsdp/blob/65b0ea670fa375bb0f7f6a285e7229bb96ebdd0f/fms_fsdp/utils/config_utils.py#L25