Enzyme.jl icon indicating copy to clipboard operation
Enzyme.jl copied to clipboard

Understanding a huge crash report

Open dom-linkevicius opened this issue 3 years ago • 4 comments

Hello, I am running a custom model involving neural ODEs using Julia 1.7.1 and Enzyme v0.8.1 . My code crashes, I do not understand the reason why (apologies, I am quite new to Julia, I initially posted my query on Julia's discourse page and was directed here), I am getting a huge wall of text and am looking for any pointers to resolve the issue. My model is quite complex so it is difficult to provide a MWE, but hopefully the wall of text is at least somewhat informative. I can try to provide any additional information as requested if it seems like it would be helpful. The crash report can be found here.

dom-linkevicius avatar Jan 26 '22 18:01 dom-linkevicius

Your error looks quite similar to the one resolved here: https://github.com/wsmoses/Enzyme.jl/pull/184

Once that lands, mind trying it again?

wsmoses avatar Jan 27 '22 00:01 wsmoses

Tried again with Enzyme v0.8.3, still getting the error. It (at least superficially) seems similar, but the report is longer. Here is the full crash report after updating Enzyme.

dom-linkevicius avatar Jan 31 '22 12:01 dom-linkevicius

As a note the relevant bits are almost always towards the end of the dump. The huge wall is necessary to give some context to those messages.

It looks like you are differentiating a Flux model? We are working right now on better support for BLAS operators used in ML, so I would hold off a bit.

Even your complex model might make a decent MWE, but maybe you can narrow it down to which part of the code is giving you problems? We normally comment out bits and pieces. Without an MWE is going to be much harder for us to help

vchuravy avatar Jan 31 '22 13:01 vchuravy

@dom-linkevicius can you retry on current Enzyme

wsmoses avatar Aug 06 '22 17:08 wsmoses

@dom-linkevicius closing for now, reopen if the error persists.

wsmoses avatar Sep 04 '22 19:09 wsmoses