ImageReward icon indicating copy to clipboard operation
ImageReward copied to clipboard

一些问题

Open zhou431496 opened this issue 1 year ago • 5 comments

您好,非常好的工作,我是做文生3D的。如果我将其用于3D生成,有一些疑惑。1 产生的reward可以理解为损失的梯度嘛用来优化3D的表示例如NERF, DMTet这些。2 我只提供一个prompt和image是否可行 3 imagereward可以对法线图,深度图这些产生一个reward嘛 这是我的三个疑惑,期待您的回复

zhou431496 avatar Apr 22 '24 02:04 zhou431496

你好,多谢关注!

  1. 可以的,有一些3D的Reward使用了ImageReward,例如https://github.com/THU-LYJ-Lab/T3Bench 和 https://github.com/liuff19/DreamReward
  2. 只提供一个prompt和image完全可行,就是这么用的
  3. 这些图片类型没有验证过,应该需要专门微调一下

Hi, thanks for your attention! 1. it's possible, there are some 3D Rewards that use ImageReward, for example https://github.com/THU-LYJ-Lab/T3Bench https://github.com/liuff19/DreamReward 2. it's perfectly possible to provide only a prompt and an image, that's how it works! 3. these image types are not verified, they should need some special fine-tuning

xujz18 avatar Apr 26 '24 03:04 xujz18

你好,多谢关注!

  1. 可以的,有一些3D的Reward使用了ImageReward,例如https://github.com/THU-LYJ-Lab/T3Bench 和 https://github.com/liuff19/DreamReward
  2. 只提供一个prompt和image完全可行,就是这么用的
  3. 这些图片类型没有验证过,应该需要专门微调一下

Hi, thanks for your attention! 1. it's possible, there are some 3D Rewards that use ImageReward, for example https://github.com/THU-LYJ-Lab/T3Bench https://github.com/liuff19/DreamReward 2. it's perfectly possible to provide only a prompt and an image, that's how it works! 3. these image types are not verified, they should need some special fine-tuning

十分感谢你的回复,这对我们十分重要。 当我们要训练ImageReward时,bash scripts/train_one_node.sh 没有被发现,请问是否可以提供

zhou431496 avatar Apr 26 '24 06:04 zhou431496

https://github.com/THUDM/ImageReward/blob/main/train/scripts/train_one_node.sh

xujz18 avatar Apr 26 '24 08:04 xujz18

https://github.com/THUDM/ImageReward/blob/main/train/scripts/train_one_node.sh

十分感谢你的回复

zhou431496 avatar Apr 26 '24 11:04 zhou431496

您好,如果我在prompt中引入带有视角的描述,reward是否可以准确的评判。

zhou431496 avatar May 11 '24 01:05 zhou431496