LESS

LESS copied to clipboard

RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:6 and cuda:0!

3

Hi! I try to do step 2 on device cuda"6" since cuda "0" is in use,so I move the batches and model to cuda"6". I print device of batch and...

Haruka1307

kykim0

At step1, single GPU works while multiple GPUs get stuck.

1

When I follow the same process as step 1. It's OK for me to set the nproc_per_node to 1 in `base_training_args.sh` (and export CUDA_VISIBLE_DEVICES to my custom device). However when...

timturing

Questions about the influence value

1

I'm wondering what's the appropriate influence value in LESS setting. I'm reproducing it and the max influence value across all sub-tasks are about 0.1-0.4 for some samples. Is this value...

simplelifetime

The latest version of `open_instruct` does not contain function `encode_with_prompt_completion_format`, which is used in `utils.py`. I found the code in: https://github.com/allenai/open-instruct/blob/58f92c8739d4c4219f8b192e04e595b9d97cd90c/open_instruct/finetune.py might be the right version used in `LESS`, not...

cafeii

Why does the CSV extracted according to the steps show all the scores as nan?

1

file name, index, score cos, 0, nan cos, 1, nan cos, 2, nan cos, 3, nan cos, 4, nan cos, 5, nan cos, 6, nan cos, 7, nan cos, 8,...

SsmallSong