LDAM-DRW icon indicating copy to clipboard operation
LDAM-DRW copied to clipboard

how bout both training set and test set are same imbalanced?

Open SeunghyunSEO opened this issue 4 years ago • 2 comments

Hi Mr.kaidic

Firstly, Thanks for you sharing your code and paper.

I read your paper and used your code to be impressed.

As i read this paper, there are comments for 2 cases.

    1. training set imbalance, test set is not, and their distributions are different.
    1. training set imbalance, test set is also imbalnced, and their distributions are different.

But you know, unfortunately real data is more imabalanced and challenging.

  • My data distribution is not only imbalanced in training set but in test set too. I mean both sets are imbalanced and have same distribution.
  • and in my dataset some of classes even got 1 instance for 1 class. ( extremely low )

Then Here's my question to you. Do you think this LDAM-DRW loss also works to this dataset? I'm doing experiments changing betas, and delta j (m_list) so on.

i would be very much appreciated if you answer to me ! Ty so much kaidic :)

SeunghyunSEO avatar Mar 31 '20 11:03 SeunghyunSEO

Hi Mr.kaidic

Firstly, Thanks for you sharing your code and paper.

I read your paper and used your code to be impressed.

As i read this paper, there are comments for 2 cases.

    1. training set imbalance, test set is not, and their distributions are different.
    1. training set imbalance, test set is also imbalnced, and their distributions are different.

But you know, unfortunately real data is more imabalanced and challenging.

  • My data distribution is not only imbalanced in training set but in test set too. I mean both sets are imbalanced and have same distribution.
  • and in my dataset some of classes even got 1 instance for 1 class. ( extremely low )

Then Here's my question to you. Do you think this LDAM-DRW loss also works to this dataset? I'm doing experiments changing betas, and delta j (m_list) so on.

i would be very much appreciated if you answer to me ! Ty so much kaidic :)

I am also considering the imbalance of test set, does LDAM-DRW work effectively when it used for imbalanced test set.

zzw-zwzhang avatar Jul 27 '20 12:07 zzw-zwzhang

My data distribution is similar with yours ! Have you found some hyperparameter settings work? Thanks a lot! :)

Raf-Chen avatar Jan 06 '23 07:01 Raf-Chen