Nouamane Tazi

Results 31 comments of Nouamane Tazi

I tried updating and reinstalling all the packages. I still get the same error. Where is `delegates` supposed to be imported from?

When running `from fastcore.all import *`, the function `delegates` is imported correctly. But it seems the way it's imported in fastai/torch_core.py doesnt work for me. When I added that import...

Problem solved! The issue was that I had a folder in `C:\Users\Nouamane\Anaconda3\Lib\site-packages\fastai` called like this: ``` └───imports core.py torch.py __init__.py ``` I just deleted the `imports` folder and it resolved...

Because I think the `imports` folder comes from a previous version. The corch and torch modules are imported in another file

Yes, I did confirm their equivalence a while ago **for some tasks only**. It could be the difference in the number of final results we return: * For DRPES [it's...

Interesting. Can you share the code you use for testing @Muennighoff , and your environment please? For me I do get closer results between DRES and DRPES by running this...

And after further investigation, it does seem that DRPES results depend on `corpus_chunk_size` For example, using: ```python evaluation.run(model, output_folder=None, eval_splits=["test"]) ``` would set `corpus_chunk_size=260` which greatly influence the final results:...

I'll try to debug this weird behaviour and make a more stable DRPES. But for now please refrain from using it for your experiments @Muennighoff. Thank you for raising the...

### Should we make .to(non_blocking=True) the default in **accelerate**? Let’s use this script to find out ```python import torch if __name__ == '__main__': seed = 0 torch.manual_seed(seed) torch.cuda.manual_seed(seed) torch.cuda.manual_seed_all(seed) stream...

@Chris-hughes10 CPU -> GPU and GPU -> CPU both lead to the same issues as mentioned above. Only GPU -> GPU is the safe operation but as I said above,...