bugbug icon indicating copy to clipboard operation
bugbug copied to clipboard

[WIP] Multi Task Learning

Open chidauri opened this issue 6 years ago • 5 comments

#40 Currently implemented for bugtype model only

chidauri avatar Aug 21 '19 09:08 chidauri

@chidauri Why are you unable to run this on your system? I'd love to see how this compares to our current bugtype model. You could try running on colab, or reducing the size of the dataset you're training on.

ashridh avatar Aug 21 '19 09:08 ashridh

@ayush-1506 @marco-c I am only able to run it for 7000 bugs( on colab) , if i go more, memory overflow occurs :( For 7000 bugs:

6300/6300 [==============================] - 21s 3ms/step - loss: 0.1978 - acc: 0.9311
Epoch 2/2
6300/6300 [==============================] - 12s 2ms/step - loss: 0.1066 - acc: 0.9769

chidauri avatar Aug 21 '19 14:08 chidauri

I'm no expert, but an accuracy of 0.97 sounds too good to be true.

ashridh avatar Aug 21 '19 18:08 ashridh

I'm no expert, but an accuracy of 0.97 sounds too good to be true.

yeah it is probably overfitting(probably due to such a small training set ), so first of all we need to focus on reducing memory requirements so that we can train on larger dataset.

chidauri avatar Aug 21 '19 18:08 chidauri

I was able to run models on the entire DB on colab (though they weren't deep learning models). I guess you could wait for Marco to return so he could test it on the 64 gb RAM cluster he has.

ashridh avatar Aug 21 '19 18:08 ashridh