Sh S

Results 14 comments of Sh S

Where is the code for Figure 3 in paper?

Hey, I am also looking for the code to reproduce Figure 3. Could you please provide the code for the gradient-based measures of feature importance? Thanks

Error:"Watchdog caught collective operation timeout" when finetuning MPT-7B on a local dataset using 2 A100 GPUs

I still have the same issue after setting export NCCL_P2P_LEVEL=NVL

Error:"Watchdog caught collective operation timeout" when finetuning MPT-7B on a local dataset using 2 A100 GPUs

I updated my code with the main branch and reinstalled the whole environment. It's working now... thanks

Error:"Watchdog caught collective operation timeout" when finetuning MPT-7B on a local dataset using 2 A100 GPUs

Follow-up on this error: when I use a larger local dataset, I get the error again when saving the checkpoint. Do you have any ideas on that? thanks RuntimeError: NCCL...

TypeError: linear(): argument 'input' (position 1) must be Tensor, not NoneType

Did you find a solution to this?

Automatic adjustment of ZeRO's optimizer state partitioning with a new world size is not currently supported.

Hi, Can you share your solution to this? thanks

JSON serialization does not work

Dear Author, Could you please explain how to unpickle the target file and obtain the information? Thank you very much, Shima

JSON serialization does not work

Dear Markus, Thank you very much for your reply. I managed to transfer data to a *.mat file as I need it in MATLAB. Also I asked about some problems,...

JSON serialization does not work

Hi, Any idea? :)

JSON serialization does not work

Dear Markus, Thank you very much for the reply. Now I know the procedure. The reason that I am looking for phrase level polarity, is that: I am doing a...