LSTM_tsc icon indicating copy to clipboard operation
LSTM_tsc copied to clipboard

Accuracy vs Cost

Open AziziShekoofeh opened this issue 8 years ago • 6 comments

Hi, Thanks for the nice example. I have a question about your check_test() function. When you're running the session and generating the output, it's [model.cost, model.accuracy] but after append and tuple you have [accuracy, cost]. I'm afraid to say that it's a swap between accuracy and cost. Even, when I ran it on another time-series dataset, it generates the accuracy of greater than 1, which is definitely incorrect.

Thanks, Shekoofeh

AziziShekoofeh avatar Feb 05 '17 02:02 AziziShekoofeh

Hi, If one flips the cost and acc to cost,acc = [np.mean(x) for x in zip(*perfs)] in the check_test() it looks like the accuracy drops down to roughly 30%. I have tested it on the two_patterns example. Is there any way to tweak the LSTM to increase the accuracy?

ghost avatar Mar 13 '17 09:03 ghost

@JosefHook You are right. It seems it's the bug in the code and the reported 80-90% accuracy is not correct. I think the only way is to retrain and research for the correct hyperparameters.

AziziShekoofeh avatar Mar 22 '17 23:03 AziziShekoofeh

@JosefHook @JosefHook cost,acc = [np.mean(x) for x in zip(*perfs)] is the right code?

hackerwei avatar Mar 28 '17 09:03 hackerwei

Hi! I feel very strange,I couldn't find the check_test() function in the tsc_model.py. if you know, could you tell me where I can find the check_test() function. Thanks

onesmileapp avatar Jun 07 '17 14:06 onesmileapp

Hi @onesmileapp I couldn't find it either. Maybe after the recent commits for the version compatibility, it has been changed to something else.

If you check my fork from this directory it's showing this function in line 83, tsc_main.py .

AziziShekoofeh avatar Jun 08 '17 17:06 AziziShekoofeh

@AziziShekoofeh yes, I have found it . thank you~

onesmileapp avatar Jun 11 '17 06:06 onesmileapp