Corrupted RAW files cause DT to crash

[afeldwinn]

When there is a corrupted RAW file in a folder you open in darktable, it causes the program to crash. This is true with DNGs as well. I only discovered this after converting all my files to DNGs and the preview windows showed the corrupted file differently (example in screenshot - RAW on the left, DNG on the right). Once I was able to locate and delete all the corrupted RAW or DNG files, darktable no longer crashed.

I am happy to send along the files if you would like to look at them. But I can't upload then here as neither RAW nor DNG are allowed, and they are too big,

[ptilopteri]

does little good unless you take the time to provide the information requested in the text you deleted.

[afeldwinn]

I didn't delete anything. I'm not sure what you are talking about. What information do you need? I have copies of the corrupted files in folders that darktable does not have access to, if that is what you are referring to.

[ptilopteri]

revisit: https://github.com/darktable-org/darktable/issues/new?assignees=&labels=&template=bug_report.md&title=

and you can see

[jenshannoschwalm]

If your dng files have plain wrong header data dt will sometimes crash. You should likely modify the way you create those DNGs.

Have you checked if other raw developers behave safe here?

First step would be to provide exif data via exiv2...

[afeldwinn]

Both the DNGs and the RAW files cause DT to crash. I used Adobe DNG converter. I didn't have anyway of editing the RAW files before, so that is why I always converted them to DNGs. I was super happy to discover I could work with RAW files in DT, so I could skip the DNG step. But then DT kept crashing with my folder of RAW files so I converted them to DNGs to see if it would work any better. That's when I saw that the preview of the corrupted files looked different. Once I removed those from the folders (either RAW or DNG) I was able to import tat folder into DT and the crashing no longer occurred.

I'll try to get some more information for you after reading your bug submission page. Sorry I didn't see that when first submitting.

[jenshannoschwalm]

So your raw file is crippled Already. Chances are pretty bad to detect all errors while decoding. Please provide the raw file only, well see what can be done

[afeldwinn]

Yes, that is correct, but in looking at the preview in Windows Explorer there was no way to know that. Only after the conversion to the DNG was I able to see that something was wrong with the file. That's clued me in to deleting the bad RAW file and trying DT again. Before that process, I had no idea why DT was crashing. I just thought you all would like to know.

[jenshannoschwalm]

Probably the embedded jpeg is OK so you saw it in the explorer.

What camera?

You can share the raw after zipping so it has a different extension btw. Some problems can be fixed 😊

[afeldwinn]

Canon 80D. Same issue in Windows 10 and 11. I tried zipping the RAW file but it was too large and got rejected. What is your file size limit?

[jenshannoschwalm]

Or upload to somewhere safe and prove a link?

[afeldwinn]

Here you go: https://drive.google.com/file/d/1nVflQqteombt1a4Z_pGAYlbKmGFyYO6G/view?usp=sharing

[afeldwinn]

this is darktable 4.0.0 reporting an exception:

---

Error occurred on Tuesday, September 27, 2022 at 08:13:00.

darktable.exe caused an Access Violation at location 00007FFE8576728C in module libjpeg-8.dll Reading from location 000002382923D000.

AddrPC Params 00007FFE8576728C 00000087A73FE948 000002387EC917F8 FF1DFF1DFF1DFFB9 libjpeg-8.dll!jpeg_huff_decode 00007FFE8575C99D 000002381B3A37A0 000002387EC91950 00000087A73FE850 libjpeg-8.dll!jpeg_mem_src 00007FFE85768F48 00000087A73FF130 0000000000000000 00000087A73FE8E0 libjpeg-8.dll!jinit_input_controller 00007FFE8575B013 0000000000000000 00000087A73FEF60 0000023829721080 libjpeg-8.dll!jpeg_read_scanlines 00007FFE806C9B11 00000087A73FE8E0 000002387F97D080 00000087A73FE8E0 libdarktable.dll!dt_imageio_jpeg_decompress 00007FFE806C655E 00000087A73FF790 00000000000013A6 0000000000000002 libdarktable.dll!dt_imageio_large_thumbnail 00007FFE806F8CA1 00000000000003F0 000002381D702030 000002387A3C9350 libdarktable.dll!dt_mipmap_cache_get_with_caller 00007FFE8073BAA2 000002387A3C9378 00007FFEE1C92C56 000002387A3C93A8 libdarktable.dll!dt_pathlist_import_create 00007FFE80731E72 0000000000000000 00007FFEF22C0800 000002381D4FA4E8 libdarktable.dll!dt_control_crawler_show_image_list 00007FFE80732398 0000023868879768 0000000000000000 00000238687AA560 libdarktable.dll!dt_control_crawler_show_image_list 00007FFEE1C94B4B 0000023868879730 0000000000000000 00000238687AA560 libwinpthread-1.dll!pthread_create_wrapper 00007FFEF21BAF5A 00007FFEF22106D0 00000238687AA560 0000000000000000 msvcrt.dll!_beginthreadex 00007FFEF21BB02C 0000000000000000 0000000000000000 0000000000000000 msvcrt.dll!_endthreadex 00007FFEF02E7034 0000000000000000 0000000000000000 0000000000000000 KERNEL32.DLL!BaseThreadInitThunk 00007FFEF22C26A1 0000000000000000 0000000000000000 0000000000000000 ntdll.dll!RtlUserThreadStart

darktable.exe 4.0.0.0 ntdll.dll 10.0.19041.1949 KERNEL32.DLL 10.0.19041.1889 KERNELBASE.dll 10.0.19041.1949 msvcrt.dll 7.0.19041.546 libintl-8.dll 0.21.0.0 ADVAPI32.dll 10.0.19041.1682 sechost.dll 10.0.19041.1865 RPCRT4.dll 10.0.19041.1806 libiconv-2.dll 1.17.0.0 libglib-2.0-0.dll 2.72.2.0 ole32.dll 10.0.19041.1202 ucrtbase.dll 10.0.19041.789 combase.dll 10.0.19041.1949 GDI32.dll 10.0.19041.1620 win32u.dll 10.0.19041.2006 gdi32full.dll 10.0.19041.2006 msvcp_win.dll 10.0.19041.789 USER32.dll 10.0.19041.1503 SHELL32.dll 10.0.19041.1949 WS2_32.dll 10.0.19041.546 libpcre-1.dll libdarktable.dll libgcc_s_seh-1.dll exchndl.dll 0.9.3.0 PSAPI.DLL 10.0.19041.546 libcairo-2.dll libgdk-3-0.dll 3.24.34.0 IMM32.dll 10.0.19041.546 SETUPAPI.dll 10.0.19041.1741 cfgmgr32.dll 10.0.19041.1620 bcrypt.dll 10.0.19041.1023 libgdk_pixbuf-2.0-0.dll 2.42.8.0 libgio-2.0-0.dll 2.72.2.0 SHLWAPI.dll 10.0.19041.1706 libgobject-2.0-0.dll 2.72.2.0 libpango-1.0-0.dll 1.50.7.0 lua54.dll libpangocairo-1.0-0.dll 1.50.7.0 libgtk-3-0.dll 3.24.34.0 comdlg32.dll 10.0.19041.1806 shcore.dll 10.0.19041.1865 libwinpthread-1.dll 1.0.0.0 libavif.dll zlib1.dll libgmodule-2.0-0.dll 2.72.2.0 libcurl-4.dll CRYPT32.dll 10.0.19041.1889 WLDAP32.dll 10.0.19041.2006 libexiv2.dll libstdc++-6.dll libgphoto2-6.dll libgomp-1.dll libgphoto2_port-12.dll libGraphicsMagick-3.dll libheif.dll libIlmImf-2_5.dll libicuuc69.dll libjpeg-8.dll libjson-glib-1.0-0.dll liblcms2-2.dll libopenjp2-7.dll libpng16-16.dll libpugixml.dll 1.12.0.0 librsvg-2-2.dll libsecret-1-0.dll libsoup-2.4-1.dll libicuin69.dll VERSION.dll 10.0.19041.546 libtiff-5.dll MSIMG32.dll 10.0.19041.1466 libsqlite3-0.dll mgwhelp.dll 0.9.3.0 libxml2-2.dll dwmapi.dll 10.0.19041.746 libfontconfig-1.dll WINMM.dll 10.0.19041.546 libfreetype-6.dll 2.12.1.0 HID.DLL 10.0.19041.546 libpixman-1-0.dll libfribidi-0.dll libcairo-gobject-2.dll DNSAPI.dll 10.0.19041.1865 IPHLPAPI.DLL 10.0.19041.1865 libpangowin32-1.0-0.dll 1.50.7.0 gdiplus.dll 10.0.19041.2006 libepoxy-0.dll libffi-7.dll libharfbuzz-0.dll COMCTL32.dll 6.10.19041.1110 WINSPOOL.DRV 10.0.19041.1865 libthai-0.dll libpangoft2-1.0-0.dll 1.50.7.0 libaom.dll libatk-1.0-0.dll 2.38.0.0 libdav1d.dll 6.6.0.0 libbrotlidec.dll rav1e.dll libidn2-0.dll libpsl-5.dll libnghttp2-14.dll libcrypto-1_1-x64.dll 1.1.1.15 libssh2-1.dll libssl-1_1-x64.dll 1.1.1.15 libzstd.dll libexpat-1.dll libexif-12.dll libsystre-0.dll libltdl-7.dll libbz2-1.dll libHalf-2_5.dll libx265.dll 3.4.0.31 libde265-0.dll libIlmThread-2_5.dll USERENV.dll 10.0.19041.572 libImath-2_5.dll libIex-2_5.dll libicudt69.dll libdeflate.dll libgcrypt-20.dll 1.10.1.0 libjbig-0.dll dbghelp.dll 10.0.19041.867 libLerc.dll DWrite.dll 10.0.19041.1566 USP10.dll 10.0.19041.546 liblzma-5.dll 5.2.5.0 libwebp-7.dll libgraphite2.dll libdatrie-1.dll libunistring-2.dll 1.0.0.0 dbgcore.DLL 10.0.19041.789 libbrotlicommon.dll libtre-5.dll libgpg-error-0.dll 1.45.0.0 bcryptPrimitives.dll 10.0.19041.1415 CRYPTSP.dll 10.0.19041.546 rsaenh.dll 10.0.19041.1052 CRYPTBASE.dll 10.0.19041.546 NSI.dll 10.0.19041.610 windows.storage.dll 10.0.19041.1949 Wldp.dll 10.0.19041.1949 mswsock.dll 10.0.19041.546 winhttp.dll 10.0.19041.1682 KBDUS.DLL 10.0.19041.546 uxtheme.dll 10.0.19041.1620 MSCTF.dll 10.0.19041.1949 OLEAUT32.dll 10.0.19041.985 DEVOBJ.dll 10.0.19041.1620 WINTRUST.dll 10.0.19041.1949 MSASN1.dll 10.0.19041.546 kernel.appcore.dll 10.0.19041.546 clbcatq.dll 2001.12.10941.16384 OpenCL.dll 3.0.1.0 AppXDeploymentClient.dll 10.0.19041.1865 dxgi.dll 10.0.19041.1806 nvopencl64.dll 30.0.15.1215 cryptnet.dll 10.0.19041.906 drvstore.dll 10.0.19041.1949 nvapi64.dll 30.0.15.1215 igdrcl64.dll 23.20.101.1339 igdgmm64.dll 30.0.101.1339 dxcore.dll 10.0.19041.546 igdfcl64.dll 30.0.101.1339 igc64.dll 30.0.101.1339 nvcompiler64.dll 30.0.15.1215 Windows.ApplicationModel.dll 10.0.19041.1806 twinapi.appcore.dll 10.0.19041.1865 propsys.dll 7.0.19041.1741 profapi.dll 10.0.19041.844 Windows.FileExplorer.Common.dll 10.0.19041.1741 iertutil.dll 11.0.19041.1949 mssprxy.dll 7.0.19041.1865 IconCodecService.dll 10.0.19041.1 WindowsCodecs.dll 10.0.19041.1706 libpixbufloader-png.dll mscms.dll 10.0.19041.746 ColorAdapterClient.dll 10.0.19041.546 icm32.dll 10.0.19041.546 textinputframework.dll 10.0.19041.1806 CoreUIComponents.dll 10.0.19041.546 CoreMessaging.dll 10.0.19041.746 ntmarta.dll 10.0.19041.546 wintypes.dll 10.0.19041.1949 uiautomationcore.dll 7.2.19041.1741 OLEACC.dll 7.2.19041.746 libdarkroom.dll libknight.dll liblighttable.dll libmap.dll libosmgpsmap-1.0-1.dll libslideshow.dll libtethering.dll libavif.dll libcopy.dll libexr.dll libj2k.dll libjpeg.dll libpdf.dll libpfm.dll libpng.dll libppm.dll libtiff.dll libwebp.dll libxcf.dll libdisk.dll libemail.dll libgallery.dll liblatex.dll libpiwigo.dll libashift.dll libatrous.dll libbasecurve.dll libbasicadj.dll libbilat.dll libbilateral.dll libbloom.dll libblurs.dll libborders.dll libcacorrect.dll libcacorrectrgb.dll libcensorize.dll libchannelmixer.dll libchannelmixerrgb.dll libclahe.dll libclipping.dll libcolisa.dll libcolorbalance.dll libcolorbalancergb.dll libcolorchecker.dll libcolorcontrast.dll libcolorcorrection.dll libcolorin.dll libcolorize.dll libcolormapping.dll libcolorout.dll libcolorreconstruct.dll libcolortransfer.dll libcolorzones.dll libcrop.dll libdefringe.dll libdemosaic.dll libdenoiseprofile.dll libdiffuse.dll libdither.dll libequalizer.dll libexposure.dll libfilmic.dll libfilmicrgb.dll libfinalscale.dll libflip.dll libgamma.dll libglobaltonemap.dll libgraduatednd.dll libgrain.dll libhazeremoval.dll libhighlights.dll libhighpass.dll libhotpixels.dll libinvert.dll liblens.dll liblensfun.dll liblevels.dll libliquify.dll liblowlight.dll liblowpass.dll liblut3d.dll libgmic.dll libopencv_core455.dll 4.5.5.0 libfftw3-3.dll libGraphicsMagick++-12.dll OPENGL32.dll 10.0.19041.1806 tbb.dll GLU32.dll 10.0.19041.1806 libopencv_videoio455.dll 4.5.5.0 avformat-58.dll 58.76.100.0 avcodec-58.dll 58.134.100.0 swscale-5.dll 5.9.100.0 avutil-56.dll 56.70.100.0 libopencv_imgcodecs455.dll 4.5.5.0 libopencv_imgproc455.dll 4.5.5.0 libbluray-2.dll libgme.dll libopenblas.dll libgnutls-30.dll libmodplug-1.dll libssh.dll libsrt.dll MFPlat.DLL 10.0.19041.746 librtmp-1.dll libmfx-1.dll libgsm.dll libmp3lame-0.dll libopencore-amrwb-0.dll libopencore-amrnb-0.dll libopus-0.dll libspeex-1.dll libSvtAv1Enc.dll libtheoradec-1.dll libtheoraenc-1.dll libvorbis-0.dll libwebpmux-3.dll libvorbisenc-2.dll libvpx-1.dll xvidcore.dll libx264-164.dll 0.164.3094.0 swresample-3.dll 3.9.100.0 libgmp-10.dll libgfortran-5.dll ncrypt.dll 10.0.19041.662 libvulkan-1.dll 1.0.1111.2222 libnettle-8.dll libhogweed-6.dll WSOCK32.dll 10.0.19041.1 libp11-kit-0.dll libtasn1-6.dll libogg-0.dll libssp-0.dll libsoxr.dll libquadmath-0.dll RTWorkQ.DLL 10.0.19041.1741 NTASN1.dll 10.0.19041.546 libmask_manager.dll libmonochrome.dll libnegadoctor.dll libnlmeans.dll liboverexposed.dll libprofile_gamma.dll librawdenoise.dll librawoverexposed.dll librawprepare.dll librelight.dll libretouch.dll librgbcurve.dll librgblevels.dll librotatepixels.dll libscalepixels.dll libshadhi.dll libsharpen.dll libsoften.dll libsplittoning.dll libspots.dll libtemperature.dll libtonecurve.dll libtoneequal.dll libtonemap.dll libvelvia.dll libvibrance.dll libvignette.dll libwatermark.dll libzonesystem.dll libbackgroundjobs.dll libcamera.dll libcollect.dll libcolorlabels.dll libcolorpicker.dll libcopy_history.dll libdarktable_label.dll libduplicate.dll libexport.dll libfilmstrip.dll libfilter.dll libfiltering.dll libgamepad.dll SDL2.dll 2.0.22.0 dinput8.dll 10.0.19041.1 inputhost.dll 10.0.19041.1741 Windows.Gaming.Input.dll 10.0.19041.1566 OneCoreUAPCommonProxyStub.dll 10.0.19041.1806 libgeotagging.dll libglobal_toolbox.dll libhinter.dll libhistogram.dll libhistory.dll libimage.dll libimage_infos.dll libimport.dll libioporder.dll liblighttable_mode.dll liblive_view.dll liblocation.dll libmap_locations.dll libmap_settings.dll libmasks.dll libmetadata.dll libmetadata_view.dll libmidi.dll libportmidi.dll winmmbase.dll 10.0.19041.1 MMDevAPI.DLL 10.0.19041.1503 wdmaud.drv 10.0.19041.1 ksuser.dll 10.0.19041.1 AVRT.dll 10.0.19041.546 AUDIOSES.DLL 10.0.19041.1865 powrprof.dll 10.0.19041.546 UMPDC.dll msacm32.drv 10.0.19041.488 MSACM32.dll 10.0.19041.1 midimap.dll 10.0.19041.488 libmodulegroups.dll libmodule_toolbox.dll libnavigation.dll libratings.dll librecentcollect.dll libselect.dll libsession.dll libsnapshots.dll libstyles.dll libtagging.dll libtimeline.dll libviewswitcher.dll libview_toolbox.dll libpixbufloader-svg.dll TextShaping.dll

Windows 10.0.19044 DrMingw 0.9.3

[afeldwinn]

https://drive.google.com/file/d/1nVflQqteombt1a4Z_pGAYlbKmGFyYO6G/view?usp=sharing

[kmilos]

Possibly similar to https://github.com/darktable-org/darktable/issues/12428?

[github-actions[bot]]

This issue did not get any activity in the past 60 days and will be closed in 365 days if no update occurs. Please check if the master branch has fixed it and report again or close the issue.

[ralfbrown]

The crash is in libjpeg rather than in darktable code, so this needs to be reported to that project.