Doug J

Results 9 comments of Doug J

Feature Request: ROCm support (AMD GPU)

Found this rocm version of bitsandbytes: https://github.com/Lzy17/bitsandbytes-rocm/tree/main

HuggingFaceH4/oasst1_en - missing dataset

Hi, can anyone help find the dataset?

<class 'src.pipeline_stable_diffusion_ait.StableDiffusionAITPipeline'> is incorrectly implemented. Expected {'feature_extractor', 'scheduler', 'tokenizer', 'text_encoder', 'safety_checker', 'unet', 'vae'} to be defined

> Maybe worth checking whether the huggingface packages that you use are supported by AIT. AIT SD support hasn't been updated for a while. https://github.com/facebookincubator/AITemplate/tree/main/examples/05_stable_diffusion. I am strictly following the...

Error to run examples on ROCm

Is this problem solved?

Deprecation Warnings with orbax 0.5.3

Hi, I am still receiving this warning `WARNING:absl:SaveArgs.aggregate is deprecated, please use custom TypeHandler (https://orbax.readthedocs.io/en/latest/custom_handlers.html#typehandler) or contact Orbax team to migrate before May 1st, 2024. If your Pytree has empty...

RuntimeError: unable to open file when calling from_pretrained on multiple processes after upgrading hugginface_hub to 0.23.1

Still impacted by this issue.

RuntimeError: unable to open file when calling from_pretrained on multiple processes after upgrading hugginface_hub to 0.23.1

The error seems to be caused by the pipeline is trying to access the model without waiting for the pipeline to finish downloading the model.

Flops counter issue

@HamidShojanazeri Could you please take a look? Thank you!

Flops counter issue

> [@jiagaoxiang](https://github.com/jiagaoxiang) From this [line](https://github.com/meta-llama/llama-cookbook/blob/341539afeeb8c8c50519618c3a7cf8a0a70a6d7f/src/llama_cookbook/finetuning.py#L237), num_freeze_layers will not affect anything if freeze_layers is False (which by default it is [False](https://github.com/meta-llama/llama-cookbook/blob/main/src/llama_cookbook/configs/training.py#L36)). From your statement `The total flops count with pytorch2.5 and...