AVideo-Encoder icon indicating copy to clipboard operation
AVideo-Encoder copied to clipboard

Error encoding large videos

Open gbrn opened this issue 11 months ago • 9 comments

@DanielnetoDotCom Danny, I'm having trouble encoding large videos using AVideo-Encoder. Since my videos are movies, some of them can be over 5GB in file size. But occasionally this problem can happen, and I'm facing it now... a movie that's 5 hours and 33 minutes long. I think this must be a restriction applied to the code.

I tried the public Encoder and the restriction is greater, it is not accepting large files, I think larger than 4GB. I also tried my private Encoder, it accepts large files, but it cannot finish the encoder correctly. My private encoder is 65% free and apparently it is not a problem of space on the server: image

After the encoder it enters the state: Broken or Missing Files. image image

I have done several tests and I cannot resolve this issue. What is the correct way to resolve this issue?

gbrn avatar Jan 11 '25 02:01 gbrn

Check if this is not your case

https://github.com/WWBN/AVideo/wiki/How-to-find-errors-on-AVideo-Platform#video-resolution-considerations

DanielnetoDotCom avatar Jan 13 '25 16:01 DanielnetoDotCom

@DanielnetoDotCom

Check if this is not your case https://github.com/WWBN/AVideo/wiki/How-to-find-errors-on-AVideo-Platform#video-resolution-considerations

The problem that occurs is not the one mentioned in the URL, as the resolution of the video I am testing is 1280x720 pixels, within the standard.

image

image

The difference in the test video is that it is 5 hours and 33 minutes long and the file is 4.90GB in size.

gbrn avatar Jan 14 '25 02:01 gbrn

The you should try this to track the errors

https://github.com/WWBN/AVideo/wiki/How-to-find-errors-on-AVideo-Platform#2-preventing-file-loss-during-transfer-errors

DanielnetoDotCom avatar Jan 14 '25 13:01 DanielnetoDotCom

Danny, I'm doing a lot of tests. I just uploaded the 5 hour and 33 minute file. But in low resolution 640px. With only 700MB. I uploaded it to the public encoder for a test. I bring the results.

image

gbrn avatar Jan 14 '25 20:01 gbrn

@DanielnetoDotCom Danny, the file with 750MB, 5 hours and 33 minutes, was successfully completed. So the problem is not in the resolution or the duration of the video. It is in the size in Gigabytes of the video file. Could you help me diagnose this limitation of the video file size?

image

image

gbrn avatar Jan 14 '25 21:01 gbrn

@DanielnetoDotCom Danny, I did another test, with a larger file. This one is now 4.90GB. The total HLS encoding was 11.95GB. But apparently the file was not transferred to the storage, through YPTStorage. Here it shows that it is still in LOCAL. (I couldn't tell if this has to do with the transfer time, since the servers are in different locations).

image

image

gbrn avatar Jan 15 '25 00:01 gbrn

Hold on

  1. 640p on public encoder will work, public encoder will handle resolutions from 480p
  2. the 11.95GB file transfered fine to your server and it is playable?
  3. the YPT storage compress the file to transfer it. you will probably need more ram then the filesize (11.95GB), but you may find some clues in the log file

DanielnetoDotCom avatar Jan 15 '25 13:01 DanielnetoDotCom

  1. the 11.95GB file transfered fine to your server and it is playable?

No, the file does not play in the player.

  1. the YPT storage compress the file to transfer it. you will probably need more ram then the filesize (11.95GB), but you may find some clues in the log file

Yes, the system can do the compression and apparently does the transfer. My encoder server has 23.4GB of RAM. image

As soon as I have more time I will run new tests.

gbrn avatar Jan 16 '25 03:01 gbrn

For me the best way to test is doing this

https://github.com/WWBN/AVideo-Encoder/issues/548#issuecomment-2589889008

DanielnetoDotCom avatar Jan 16 '25 12:01 DanielnetoDotCom