MTTOD icon indicating copy to clipboard operation
MTTOD copied to clipboard

DB states as training labels

Open xiami2019 opened this issue 2 years ago • 3 comments

Hi, I think it may be a little wrong here. The model should not learn to predict db_state tokens, thus I think it doesn't make sense taking db_state tokens as labels. Maybe putting db states into inputs make more sense.

xiami2019 avatar Apr 25 '22 06:04 xiami2019

I agree with you in that the db_state token can be regarded as a prompt.

But other models such as SimpleTOD, UBAR learn the TOD workflow including the db_state token prediction.

I think it's a difference in perspective on whether to consider the db_state token as a prompt or TOD workflow.

bepoetree avatar Apr 26 '22 02:04 bepoetree

Thanks for your reply, it seems that predicting db does not influence the preformance. However, some TOD work, like PPTOD, use db as a part of inputs when training.

xiami2019 avatar Apr 26 '22 02:04 xiami2019

Yes, PPTOD uses the db state as a kind of prompt.

But, as you said, I think predicting db state does not have a significant impact on the performance.

bepoetree avatar Apr 26 '22 04:04 bepoetree