llm-foundry

llm-foundry copied to clipboard

Allow multiprocessing when preparing ICL dataset

8

## 🚀 Feature Request Allow passing `num_proc`/`num_workers` parameter in`InContextLearningDataset` so that preparation of dataset can use more than one processes. ## Motivation When loading bigger ICL eval datasets, it is...

sanjari-orb

aspfohl

could you give an elaborated steps about how to run llm-foundry on AMD mi250 devices

1

could run the llm-foundry on AMD 4xMi250 machine Steps to reproduce the behavior: 1. follow latest instructions from: https://github.com/ROCm/flash-attention/tree/flash_attention_for_rocm start from docker image: rocm/pytorch:rocm5.7_ubuntu22.04_py3.10_pytorch_2.0.1 export GPU_ARCHS="gfx90a" export PYTHON_SITE_PACKAGES=$(python -c 'import...

Alice1069

Previously the dataloader will throw the error message that contain duplicated fileName + extension in the `Could not find a file with any of the supported extensions:`. This PR patched...

shitaoli-db

Conversion Sharded -> Monolithic checkpoint

1

I was wondering if there was a straightforward way to convert from sharded to monolithic checkpoint for a subsequent conversion to hf format (not a direct conversion sharded -> hf)....

pretidav

bigning

Allow parameters with requires_grad=False in meta init

1

sashaDoubov

In order to support customers with sensitive storage network configurations, we have to use the `log_model` API. This will cause duplicate artifact uploads, which is not efficient, so we will...

nancyhung

MI300X Compatibility

1

At TensorWave we're actively using LLM-Foundry on our MI300X systems with great success, since ROCm version 6.1. What information do you need to see in order to add MI300X to...

nikhil-tensorwave

Update transformers requirement from <4.44,>=4.43.2 to >=4.43.2,<4.46

2

Updates the requirements on [transformers](https://github.com/huggingface/transformers) to permit the latest version. Release notes Sourced from transformers's releases. Patch Release v4.45.1 Patches for v4.45.1 [MllamaProcessor] Update errors and API with multiple image...

dependabot[bot]