lionday

launch.py:428:sigkill_handler] Killing subprocess 31472

2

When training wizardlmcoder, running according to the training instructions results in an error.（My deivce is A100*4） Allowing ninja to set a default number of workers... (overridable by setting the environment...

Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass,RuntimeError: element 0 of tensors does not require grad and does not have a grad_fn

2

"I don't want to use 8-bit training. I hope to use fp16 training. After commenting out these two lines, there was an error. How should I modify it? In addition,...

Why is the inference speed using fp16 or bf16 similar to fp32?

1

Is there any specific configuration method? model = AutoModelForCausalLM.from_pretrained(checkpoint,trust_remote_code=True,torch_dtype=torch.float16)