ditto icon indicating copy to clipboard operation
ditto copied to clipboard

drop_col gives error?

Open utsgr opened this issue 4 years ago • 5 comments

When I try to use data augmentation with drop_col, I get the error below. I did not change anything about the model or data, is there something I'm missing?

Screen Shot 2021-11-29 at 5 38 14 PM

utsgr avatar Nov 29 '21 22:11 utsgr

When I try to use data augmentation with drop_col, I get the error below. I did not change anything about the model or data, is there something I'm missing?

Screen Shot 2021-11-29 at 5 38 14 PM

did you solve the problem? I got the same error

soodeh-nilforoushan avatar Dec 06 '21 02:12 soodeh-nilforoushan

Sadly no, I'm hoping someone can help.

utsgr avatar Dec 06 '21 03:12 utsgr

Sadly no, I'm hoping someone can help.

They added the ditto light on their code, and after this changes, this error happens. I hope authors answer this question

soodeh-nilforoushan avatar Dec 06 '21 03:12 soodeh-nilforoushan

Problem appears to be that they are using \t instead of [SEP]. Also, the variable combined is split as well and by just ignoring this line of code it seems to work for me.

progsi avatar Nov 17 '22 13:11 progsi

I do not think the issue is caused by using \t instead of [SEP] as that is also used in the other data augmentation functions. I noticed a different pattern; if the column before the separator is the one to be removed, it also removes the [SEP] indicator from the resulting tokens.

I'll attempt to fix the algorithm for dropping columns, I'll keep you posted.

rinkstiekema avatar Jan 02 '23 16:01 rinkstiekema