Stas Bekman

fix a memory leak on exception (caused by the stored traceback)

28

Currently ipython stores the traceback on exception. The problem is that it creates a circular reference to locals() in each frame of the traceback. And until next exception arrives gc.collect()...

adding yaml config interpolation

5

**Is your feature request related to a problem? Please describe.** Could SimpleParsing add support for interpolation? here is an example of how omegaconf does it: https://omegaconf.readthedocs.io/en/2.3_branch/usage.html#config-node-interpolation **Describe the solution you'd...

scientific notation in dict values doesn't get converted to float

2

**Describe the bug** If I have: ``` @dataclass class OptimizerParams: name: str = "AdamW" params: Dict[str, Any] = dict_field( dict( # learning rate lr=3e-4, ) ) ``` and in a...

`huggingface-cli delete-cache --disable-tui` improvements

13

I tried `huggingface-cli delete-cache --disable-tui` for the first time. Great intention, very problematic usage when one had thousands of hub objects to cleanup. Once I understood its quirks I was...

several breakages due to recent `datasets`

9

It seems that `datasets==2.16.0` and higher breaks `evaluate` ``` $ cat test-evaluate.py from evaluate import load import os import torch.distributed as dist dist.init_process_group("nccl") rank = int(os.environ.get("LOCAL_RANK", 0)) world_size = dist.get_world_size()...

following with the installation instructions: ``` pip install evaluate ``` then it fails with missing `sklearn` ``` Traceback (most recent call last): File "/home/stas/test/test-evaluate.py", line 10, in metric = load("accuracy",...

[feature request] accelerate launcher: add numa affiinities control

20

### Feature request As explained here https://github.com/pytorch/pytorch/issues/115305 when using 2-cpu nodes it's important to get the NUMA affinities right to avoid cross NUMA node talk As torchrun currently doesn't support...

missing online doc even though the docstring exists

11

https://huggingface.co/docs/accelerate/main/en/package_reference/accelerator?search=true doesn't seem to cover all the documented functions/methods. e.g. searching for `gather_object` gives nada:  but the docstring is there: https://github.com/huggingface/accelerate/blob/d1abd59114ada8ba673e1214218cb2878c13b82d/src/accelerate/utils/operations.py#L417-L426 It does find `gather` on the other hand.

Hi, I installed dart following the instructions from your linux link https://www.dartlang.org/install/linux, and then: `$ pub global activate linkcheck Command 'pub' not found ` Checking the dart .deb package, it...

[doc] issues with rendering docs in FF

6

There are doc rendering issues in FF, at least for: https://huggingface.co/docs/peft/main/en/accelerate/deepspeed Fine in chrome:  Broken in FF 124.0.1 (Ubuntu)