TSPO

TSPO copied to clipboard

TSPO reproduction question

3

Hi, authors, thank you for your great work! I tried to reproduce your results by training TSPO following the training scheme and data described in the repository. My training platform...

yiheng-wang-duke

This is conducting RL training on the 0.4B model. Is my understanding correct?

1

The GPU usage is approximately 40GB, but during reproduction, I noticed that the loss is always 0, the inter-group advantages calculated are all 0, and the reward for each group...

whu125

Error while merging

1

Hello thanks for sharing the code! I am using the weights from https://huggingface.co/hzf666/TSPO-0.4B when i run python scripts/merge_weights.py i get selector.load_state_dict(module_state_dict) File "/home/BIMBA/.venv/lib/python3.11/site-packages/torch/nn/modules/module.py", line 2152, in load_state_dict raise RuntimeError('Error(s) in...

AmeenAli