ConvertX icon indicating copy to clipboard operation
ConvertX copied to clipboard

Large files do not upload

Open EaiWez opened this issue 1 year ago • 8 comments

The upload doesn't happen or the code tries to convert the file before the upload finishes

I tested a few files of different sizes, files up to 30mb convert, sometimes it gives an error, i checked the logs and it says the file doesnt exists, files larger than 100mb always say the file doesnt exists

EaiWez avatar Jul 04 '24 04:07 EaiWez

Having same issue, in logs im seeing:

./data/uploads/1/70/A001_01271339_C070.mov: No such file or directory Failed to convert ./data/uploads/1/70/A001_01271339_C070.mov from mov to mp4 using ffmpeg. error: Error: Command failed: ffmpeg -i "./data/uploads/1/70/A001_01271339_C070.mov" "./data/output/1/70/A001_01271339_C070.mp4" ffmpeg version 6.0.1 Copyright (c) 2000-2023 the FFmpeg developers built with gcc 12.2.1 (Alpine 12.2.1_git20220924-r10) 20220924 configuration: --prefix=/usr --disable-librtmp --disable-lzma --disable-static --disable-stripping --enable-avfilter --enable-gnutls --enable-gpl --enable-libaom --enable-libass --enable-libbluray --enable-libdav1d --enable-libdrm --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libmp3lame --enable-libopenmpt --enable-libopus --enable-libplacebo --enable-libpulse --enable-librist --enable-libsoxr --enable-libsrt --enable-libssh --enable-libtheora --enable-libv4l2 --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxcb --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-lto --enable-pic --enable-postproc --enable-pthreads --enable-shared --enable-vaapi --enable-vdpau --enable-vulkan --optflags=-O3 --enable-libjxl --enable-libsvtav1 --enable-libvpl libavutil 58. 2.100 / 58. 2.100 libavcodec 60. 3.100 / 60. 3.100 libavformat 60. 3.100 / 60. 3.100 libavdevice 60. 1.100 / 60. 1.100 libavfilter 9. 3.100 / 9. 3.100 libswscale 7. 1.100 / 7. 1.100 libswresample 5. 0.100 / 5. 0.100 libpostproc 57. 1.100 / 57. 1.100 ./data/uploads/1/70/A001_01271339_C070.mov: No such file or directory 7 | throw err.code = "ERR_INVALID_ARG_TYPE", err; 8 | } 9 | } 10 | var setup = () => { 11 | const { FixedQueue } = @getInternalField(@internalModuleRegistry, 3) || @createInternalModuleById(3);

  • | function processTicksAndRejections() { ENOENT: No such file or directory errno: -2 syscall: "open" path: "./data/output/1/70/A001_01271339_C070.mp4" jobId set to: 71 jobId set to: 72

As you said it tries to convert before the upload finishes

timswhatever avatar Jul 04 '24 20:07 timswhatever

Having some issues with files above 1 GB but seems to be related to bun https://github.com/elysiajs/elysia/issues/266

Streaming uploads is probably the way to go for larger files but that is a bit out of the scope for now

C4illin avatar Jul 09 '24 18:07 C4illin

Heyo, thanks for keeping up the project. I saw that this is supposed to be fixed with v0.3.2 and I am running v0.12 still It seems like I cannot upload larger files. Doesn't seem to work with a 86MB file. The bar just doesn't load.

Image

rafaelsroman avatar Mar 11 '25 22:03 rafaelsroman

Also getting the same issue here could be after #233

Will have to look into this more

C4illin avatar Mar 12 '25 18:03 C4illin

It seems to be kind of working now, still no files above 1 GB but it works with 86MB on my end at least. Try the :main image if you find time

Tested up to 268 MB

C4illin avatar Jun 03 '25 17:06 C4illin

Ah that's unfortunate. I am in video production, thus sometimes there is some bigger video files. Will try, am just in exam season right now.

rafaelsroman avatar Jun 10 '25 14:06 rafaelsroman

Any chance of supporting big files (>1GB) ?

poznachowski avatar Oct 08 '25 16:10 poznachowski

chunked upload is needed for that which would be very nice to add but it isn't so simple

C4illin avatar Oct 08 '25 17:10 C4illin