DCRNN_PyTorch icon indicating copy to clipboard operation
DCRNN_PyTorch copied to clipboard

Published 20 hours ago • verified publisher icon chnsh

Testing results during training

Open razvanc92 opened this issue 4 years ago • 7 comments

Hello, firstly I would like to thank you for the implementation. I've been trying to use your implementation and I've noticed a big difference, during training when evaluating (fx every 10 steps) you're only reporting the mae (over all 12 time stamps), while DCRNN reports mae/mape/rmse for every time stamp. I would be interested to see those numbers during training, or at least at the end of the training so I can compare it with other models. Do you have any suggestions how I could do this?

razvanc92 avatar May 15 '20 10:05 razvanc92

Hello, firstly I would like to thank you for the implementation. I've been trying to use your implementation and I've noticed a big difference, during training when evaluating (fx every 10 steps) you're only reporting the mae (over all 12 time stamps), while DCRNN reports mae/mape/rmse for every time stamp. I would be interested to see those numbers during training, or at least at the end of the training so I can compare it with other models. Do you have any suggestions how I could do this?

you can rewrite evalute() in dcrnn_supervisor. I could provide the code which outputs this three metrics. ps: The distance between nodes (the .csv file) should be float dtype, or you will have dtype mismatch problem.

AprLie avatar May 16 '20 09:05 AprLie

@razvanc92 that is a reasonable request - @AprLie thanks for your help. Would @razvanc92 and @AprLie be willing to send in a PR?

chnsh avatar May 16 '20 22:05 chnsh

I would like to use that too if that is possible, @AprLie @chnsh could you forward that code? I'm not sure how though. Thanks in advance

Noahprog avatar May 24 '20 13:05 Noahprog

Hello, firstly I would like to thank you for the implementation. I've been trying to use your implementation and I've noticed a big difference, during training when evaluating (fx every 10 steps) you're only reporting the mae (over all 12 time stamps), while DCRNN reports mae/mape/rmse for every time stamp. I would be interested to see those numbers during training, or at least at the end of the training so I can compare it with other models. Do you have any suggestions how I could do this?

you can rewrite evalute() in dcrnn_supervisor. I could provide the code which outputs this three metrics. ps: The distance between nodes (the .csv file) should be float dtype, or you will have dtype mismatch problem.

I have met with the same problem, could you also provide me with the same code? thank you!

yandou904 avatar Nov 02 '21 11:11 yandou904

I would like to use that too if that is possible, @AprLie @chnsh could you forward that code? I'm not sure how though. Thanks in advance

Have you got the answer? Could you please provide me with one? Thank you!

yandou904 avatar Nov 02 '21 11:11 yandou904

I would like to use that too if that is possible, @AprLie @chnsh could you forward that code? I'm not sure how though. Thanks in advance

Have you got the answer? Could you please provide me with one? Thank you!

I'm running into this issue as well.Have you got the answer? Could you please provide me with one? Thank you!

Yangzelin99 avatar Jan 20 '24 05:01 Yangzelin99

I would like to use that too if that is possible, @AprLie @chnsh could you forward that code? I'm not sure how though. Thanks in advance

Have you got the answer? Could you please provide me with one? Thank you!

I'm running into this issue as well.Have you got the answer? Could you please provide me with one? Thank you!

Have you got the answer? Could you please provide me with one? Thank you!

User766843 avatar Mar 16 '24 08:03 User766843