alignment-handbook
alignment-handbook copied to clipboard
Published
20 hours ago •
huggingface
huggingface
ModuleNotFoundError: No module named 'h4'
Hello, I want to load the training_arg.bin of zephyr-7b-beta and pass it to DPOTrainer of trl to compute the implicit rewards and logps conveniently, but it seems lack some private modules.
import torch
training_args = torch.load("training_args.bin")
ModuleNotFoundError: No module named 'h4'
