Ashwinee Panda

The AV overview on the course page has two hyperlinks for pdf and pptx but both link to the pptx.

gaussian_query_test.py tests fail

4

Cloned the repo, `conda install tensorflow`, followed setup instructions inside the repo and then tried to run `gaussian_query_test.py` but it seems that some of the tests fail. ``` Running tests...

No source code?

1

The README says that source code will be 'available soon'. When can this be expected?

### Describe the bug If you download Squad, it will download the plain_text version, but the config still specifies "default", so if you set the offline mode the cache will...

Improve noise multiplier finding

6

## 🚀 Feature Implement Brent's method to find the best value of sigma for a given epsilon. ## Motivation https://github.com/google/differential-privacy/blob/main/python/dp_accounting/mechanism_calibration.py uses a much better method to find the best value...

Update Installation Instructions

3

The latest version on PyPi is pretty outdated, so the pip install is going to leave folks with issues that have since been fixed in the code. We should either...

Lora downcasting issue

18

When creating a PEFT model and then trying to train it, we get an error; ``` File "/scratch/gpfs/ashwinee/unsloth/unsloth/kernels/fast_lora.py", line 106, in backward d_downA = h.t() @ (dY @ downB.t()) RuntimeError:...

Llama Attention Call should not pass **kwargs

4

### System Info - `transformers` version: 4.40.1 - Platform: Linux-4.18.0-513.24.1.el8_9.x86_64-x86_64-with-glibc2.28 - Python version: 3.10.13 - Huggingface_hub version: 0.22.2 - Safetensors version: 0.4.1 - Accelerate version: 0.29.2 - Accelerate config: not...