Luân issues

Repositories
Issues
Comments

Results 2 issues of


                                            Luân

FSDP QLoRa

### Reminder - [X] I have read the README and searched the existing issues. ### Reproduction accelerate launch \ --config_file examples/accelerate/fsdp_config.yaml src/train.py \ --stage sft \ --lora_target q_proj,v_proj \ --finetuning_type...

pending

Fix Semantic Feature Extraction from Incorrect Layer

This PR addresses an inconsistency between the code and the paper regarding which layer is used for semantic feature extraction in W2v-BERT 2.0. The [paper](https://arxiv.org/abs/2409.00750) specifies: > "In detail, we...