caffe-jacinto-models icon indicating copy to clipboard operation
caffe-jacinto-models copied to clipboard

error occur while training

Open shiva13425 opened this issue 6 years ago • 3 comments

Hi, While am trying to train the initial training am getting the below error.

I0302 02:22:22.283617 5159 common.cpp:528] NVML initialized, thread 5159 I0302 02:22:22.285171 5132 net.cpp:1071] Ignoring source layer mbox_loss F0302 02:22:22.321794 5132 solver.cpp:668] Check failed: result[j]->width() == 5 (3 vs. 5) *** Check failure stack trace: *** @ 0x7f65e6a015cd google::LogMessage::Fail() @ 0x7f65e6a03433 google::LogMessage::SendToLog() @ 0x7f65e6a0115b google::LogMessage::Flush() @ 0x7f65e6a03e1e google::LogMessageFatal::~LogMessageFatal() @ 0x7f65e7a09a38 caffe::Solver::TestDetection() @ 0x7f65e7a0a857 caffe::Solver::TestAll() @ 0x7f65e7a0b3bc caffe::Solver::Step() @ 0x7f65e7a0d512 caffe::Solver::Solve() @ 0x410732 train() @ 0x40d310 main @ 0x7f65e5034830 __libc_start_main @ 0x40dfa9 _start @ (nil) (unknown)

Kindly share your comments.

shiva13425 avatar Mar 01 '19 21:03 shiva13425

I have the same error when I trying to train the SSD(with TYPE2); Have you solved this error?

nyg2017 avatar Jun 02 '19 09:06 nyg2017

You can visualize your net train.prototxt and test.prototxt with netscope tool. The error is saying that 5 outputs are expected, but only 3 are obtained.

mathmanu avatar Jun 13 '19 09:06 mathmanu

This issue is now fixed. You can pull the latest code. Basically, do not set chop_num_heads to 1. Instead comment out those lines that set it to 1 in train_image_object_detection.sh: #chop_num_heads=1

mathmanu avatar Dec 24 '19 10:12 mathmanu