First, just a note about a message when start lives from a terminal, about an invalid effect:

# lives

LiVES 3.2.1-pre
Copyright 2002 - 2021 Gabriel Finch ([email protected]) and others.
LiVES comes with ABSOLUTELY NO WARRANTY
This is free software, and you are welcome to redistribute it
under certain conditions; see the file COPYING for details.

LiVES info: Invalid effect farneback_analyserfarneback_analysersalsaman1 found in compound effect image_stabilizer, line 4

LiVES info: Invalid effect farneback_analyserfarneback_analysersalsaman1 found in compound effect motion_analyser, line 4

flv_decoder: info - frame size=198 x 154, pixel size=192 x 154

That last line is after opening the small video. In the File Open dialog window, the video can be previewed, and plays both audio and video correctly. After opening, all the video frames look scrambled like this:

lives-broken-video

The video file is only 127KB, so I should be able to attach it. I don't know whether can attach a .flv file, so have appended a false ".gz" onto the filename:

20051210-w50s_56K.flv.gz

Jan 05 '22 23:01 bkauler

Note, I am still using the code from Jan 2, haven't tested your latest Jan 4 commits.

Jan 05 '22 23:01 bkauler

The effect message is just for info. farneback is only built if opencv-dev is found at build time. It's quite an interesting effect, - it divides the frame into a grid and produces a motion vector at the centre of each grid area, using an optical flow method. The output (x,y) vectors are delivered as two float alpha channels The first out channel holds the x values, the second, the y values, with dimensions of both equal to the grid size. These alpha channels can then be chained to other data effects, or used in a compound effect such as image_stabilizer or motion_analyser.

The info message is just informing that this component of the compound effects was not available, thus the compound will not be loaded.

Jan 06 '22 12:01 salsaman

For the flv issue, can you please confirm something - the values indicated suggest there is a 3 pixel vertical border on the left and a 3 pixel border on the right. Can you confirm whether or no that is the case, e.g. by playing the clip in another player.

Jan 06 '22 12:01 salsaman

It's possible the calculation is wrong and the 3 pixel border should be inside the 192 pixel frame width, rather than around it.

Jan 06 '22 13:01 salsaman

You may also try going into Preferences / Decoding and enabling "Ignore Blank Borders when Possible" to see if it makes any difference.

Jan 06 '22 13:01 salsaman

Yes, enabling "Ignore blank borders when possible" fixes the video.

From the video frames viewed in lives, it looks like vertical borders on both sides, inside the frame.

I also opened the video in Avidemux and it plays perfectly, doesn't show anything about there being vertical borders. This is the info Avidemux shows about the file:

===================================================== Video

Codec 4CC: VP6F Image Size: 192 x 154 Aspect Ratio: 1:1 (1:1) Frame Rate: 10.000 fps Average Bitrate: 41 kbps Total Duration: 00:00:17.000

===================================================== Video Codec Extradata

Size: 0

===================================================== Audio (1 active track)

Codec: MP3 Channels: Mono Bitrate: 8000 Bps / 64 kbps Frequency: 11025 Hz Total Duration: 00:00:16.822

Whereas, lives is showing the frames as 198x154.

Jan 06 '22 14:01 bkauler

Yes, it seems to be finding a wrong caclulation somewhere, adding offset to pixel size to get frame_size, instead of subtracting offset from frame_size to get the pixel size.

Jan 06 '22 21:01 salsaman

It would be useful if you can also upload this clip.

Jan 07 '22 12:01 salsaman

It would be useful if you can also upload this clip.

I did, see above, file 20051210-w50s_56K.flv.

Jan 07 '22 15:01 bkauler

OK, missed that too. Can confirm what you reported, in this case as with the bigbunny clip, the audio is speeding ahead of the video. In this case it is mono audio up mixed to stereo. Need to figure this one out too.

Jan 07 '22 17:01 salsaman

Fixed: a0909c5ecc92902d3b7e3682cb64ad0e138fe19e

Related audio issues fixed too: 0fa428e162f388f2b82ca03f2ace73f56191dcc0

Jan 08 '22 04:01 salsaman

Still needs a minor update, however. If "ignore blank borders" is switched on, then decoded frames will be saved without the borders, however if it is later enabled, they will be saved with the borders, leading to differences in the clip.

I need to figure out how to handle this.

Jan 08 '22 04:01 salsaman

Ah yes, I see what it is now. In this case for example, the original frame is 186 X 154, however the border is added during encoding to make the width a multiple of 16, (22 * 16 = 192), which seems to be a requirement for the vp6(a) format used by .flv.

Since that is not a general requirement for LiVES, what should actually happen is:

frame size should be set to 186 X 154 for the clip (i.e we should always use pixel_size, rather than frame_size)
when decoding a frame, the blank borders should be stripped (handled in the decoder plugin)
The option to NOT ignore blank borders should be disabled in Prefs.
the ffmpeg_encoder has an option to encode to flv format. The restriction hstep=16 for this format, which will trigger LiVES to prompt the user with the choice of resizing the frames or adding a blank border. I'll have to check ffmpeg encoding options to see if it's possible to pass a frame_width, which would remove the need to physically add a blank border in the letterbox option.

Jan 08 '22 10:01 salsaman

Done, except for the final point: faa9b2197c7fc9f8facfef506956a0d862a0c813

I think it maybe possible to set the frame size by passing -s option to ffmpeg, will need to test.

Jan 08 '22 11:01 salsaman

I have included the latest LiVES in EasyOS version 3.2:

https://bkhome.org/news/202201/easyos-version-32-released.html

When I untick "Automatic trimming/padding of audio when possible" and open that flv file, video shows as 17.00 seconds but audio is still shorter, 5.95 seconds. So when play, it only plays until the audio ends, doesn't play the entire video.

When that checkbox is ticked, only get silence. Using your latest source, Jan. 8.

I just tested again in Avidemux, it plays the entire video.

Jan 09 '22 02:01 bkauler

Are you still using mpv ? Is the audio playing at the correct rate, or does it seem speeded up ? Please try again with setting $DEBUG_OPEN in smogrify, and check the format of the commandline being passed.

Jan 09 '22 04:01 salsaman

Great that you added it to EasyOS. Just one small favour to ask...would you mind changing the menu description to "Video Editor / VJ tool" ?

Jan 09 '22 06:01 salsaman

Great that you added it to EasyOS. Just one small favour to ask...would you mind changing the menu description to "Video Editor / VJ tool" ?

OK, done.

Jan 09 '22 09:01 bkauler

Are you still using mpv ? Is the audio playing at the correct rate, or does it seem speeded up ? Please try again with setting $DEBUG_OPEN in smogrify, and check the format of the commandline being passed.

No, it is not speeded up, the audio is truncated to 5.96 seconds, and that's where it stops playing.

EasyOS tries to be the smallest possible download, currently 581MB, so cannot have both mpv and mplayer builtin, too much bloat. If I have to use lives with mplayer, then will not be able to include it builtin, it will have to be installable via the package manager.

I'm not sure if the source I downloaded has your very last commit yesterday. Perhaps that is important.

Jan 09 '22 09:01 bkauler

Here is the result opening that flv with $DEBUG_OPEN=1:

onMetaData:mixedarray
duration:16.900000
width:192.000000
height:154.000000
videodatarate:40.000000
framerate:10.000000
videocodecid:4.000000
audiodatarate:16.000000
audiodelay:0.000000
audiocodecid:2.000000
canSeekToEnd:1.000000
creationdate:Fri Feb 03 12:25:53 2006

:video type is vp6f 192 x 154 (0 x 0 +3 +0)
using palette 512, size 186 x 154
fps is 10.0000 170
flv_decoder: info - frame size=192 x 154, pixel size=186 x 154
vid open command for 685640289 is: 
aud open command for 685640289 is: LANGUAGE=en LANG=en /usr/bin/mpv --no-config --quiet --no-video --vd-lavc-threads=4   --frames=171   --ao=pcm --ao-pcm-waveheader=no --audio-format=s16 --audio-channels=1 "/mnt/sda1/temp8/20051210-w50s_56K.flv"

Have still got "Automatic trimming/padding of audio when possible" unchecked. Also "ignore blank borders when possible" is unchecked, but video looks ok now.

Jan 09 '22 10:01 bkauler

And attached is the audiodump.pcm, with false ".gz" appended: audiodump.pcm.gz

Jan 09 '22 10:01 bkauler

I would be quite interested to see what dependencies you have for the package. For reference:

Mandatory dependencies include at least: Build

GTK+ (>=3.0.0) + development libs [>= 3.24.0 preferred] gdk-pixbuf-loaders + development libs gettext + development libs

Runtime

*mplayer (preferred), mplayer2, or mpv with jpeg/png output support ffmpeg with jpeg/png input support (preferably with x264 support) imageMagick perl sox (with libsox-fmt-all if applicable !)

Highly Recommended build-dependencies include (devel versions of): libpulse, libjack, ffmpeg, mjpegtools, libogg, libtheora, libdv, libraw1394, libavc1394, libunicap, (libavcodec, libavformat, libavutils, libswscale) or (ffmpeg-libs), libpng, libasound2, libX11, libXrender, libGL, libfftwf3.

(For compiling you should have development versions of these libraries installed. Check the output of ./configure carefully for missing optional dependencies.)

Optional: openCV, LADSPA headers, frei0r-devel, projectM.

Highly Recommended runtime dependencies include: python, libtheora-bin, ffprobe, xwininfo, wmctrl, mkvtoolnix, vorbis-tools, libmatroska, ogmtools, dvgrab, frei0r-plugins, libdv2-apps/libdv-bin, cdda2wav/icedax, lame, ffmpeg, x264.

If you like I can add you to the packagers list, so you will receive an email whenever a new version is released. Just let me know what email address you prefer.It's also a good means to communicate critical packages following each release.

Jan 10 '22 00:01 salsaman

If you still have an option "Ignore blank borders..." in prefs, then you are not using the latest code. Please update and test again.

Jan 10 '22 00:01 salsaman

If you still have an option "Ignore blank borders..." in prefs, then you are not using the latest code. Please update and test again.

Oh, OK, will update tonight.

These are dependencies of ffmpeg, lives and mpv, from the package database. They are all there, with development libs at compile-time, and run-time component at run-time:

ffmpeg-4.3.1-r6
+alsa-lib,+bzip2,+faac,+faad2,+fontconfig,+freetype,+gcc-runtime,+glibc,+jack,
+lame,+liba52,+libbluray,+libcdio,+libcdio-paranoia,+libdc1394,+libdrm,
+libmad,+libmng,+libmodplug,+libogg,+libsdl,+libsdl-image,+libsdl-mixer,
+libsndfile1,+libtheora,+libva,+libvdpau,+libvorbis,+libvpx,+libwebp,
+libxcb,+libxv,+mesa,+mpeg2dec,+opencore-amr,+openjpeg,+openssl,+orc
,+schroedinger,+speex,+taglib,+unzip,+v4l-utils,+wavpack,+x264,+x265,
+xvidcore,+xz,+zip,+zlib

lives-20220108-r6
+alsa-lib,+bzip2,+cups,+cups-filters,+ffmpeg,+fftw,+gcc-runtime,+ghostscript,+glib-2,
+glibc,+gtk+3,+imagemagick,+libdv,+libebml,+libjpeg-turbo,+libmatroska,+libogg,
+libpng,+libsdl,+libsdl-gfx,+libsdl-mixer,+libsdl-ttf,+libtheora,+libtirpc,+libx11,
+libxrender,+mesa,+mjpegtools,+mpv,+orc,+pulseaudio,+schroedinger,+sox,
+unicap,+v4l-utils,+zlib

mpv-0.34.1-r6
+alsa-lib,+desktop-file-utils,+faac,+faad2,+ffmpeg,+flac,+fontconfig,+freetype,+gcc-runtime,
+gdk-pixbuf,+glibc,+jack,+lame,+lcms,+liba52,+libarchive,+libass,+libavc1394,
+libbluray,+libcddb,+libcdio,+libcdio-paranoia,+libdc1394,+libdrm,+libdvdcss,
+libdvdnav,+libdvdread,+libglu,+libjpeg-turbo,+libmad,+libmng,+libmodplug,
+libogg,+libpng,+libraw1394,+librsvg,+libsamplerate0,+libsdl,+libsdl-image,
+libsdl-mixer,+libsdl-ttf,+libtheora,+libva,+libvdpau,+libvorbis,+libvpx,+libwebp
,+libx11,+libxcb,+libxext,+libxinerama,+libxscrnsaver,+libxv,+libxvmc,+lua,
+luajit,+mesa,+mpeg2dec,+mpg123,+openssl,+pulseaudio,+schroedinger,
+speex,+taglib,+v4l-utils,+vcdimager,+wavpack,+x264,+x265,+xvidcore,+zlib

Jan 10 '22 10:01 bkauler

Here is a list of every run-time package in latest EasyOS:

Jan 10 '22 10:01 bkauler

And sox:

sox-14.4.2-r6
+ffmpeg,+flac,+gcc-runtime,+glibc,+lame,+libao,+libid3tag,+libmad,+libpng,
+libsndfile1,+libvorbis,+opencore-amr,+wavpack

Jan 10 '22 10:01 bkauler

Now using the latest lives.

With "Automatic trimming/padding of audio when possible" checked, that 2005*.flv file now shows video 17.00sec and audio 11.04sec, and only plays the first 11.04 sec of the video, so truncated, completely silent.

With that setting unchecked, it behaves as before, 17.00 sec video, 5.96sec audio, and only plays 5.96sec of the video, so truncated, this time with sound. Sound is not compressed, it is truncated.

Jan 11 '22 23:01 bkauler

Must be an mpv issue. With mplayer it works as expected. I just installed mpv to test and it is hanging, not producing any audio output at all. I'll have to dig a bit further and figure out what is going wrong. Last time I tested with mpv, probably about 1 year ago, it worked with no issues, so something must have changed since then.

Jan 12 '22 02:01 salsaman

Yep, seems to be a bug in mpv. If I try the following: /usr/bin/mpv --no-video --ao=pcm "/home/salsaman/Downloads/20051210-w50s_56K.flv"

I get the following error: mpv: ../ta/ta.c:335: ta_dbg_check_header: Assertion `h->canary == CANARY' failed. Aborted (core dumped)

Closing the issue as it is an mpv problem, nothing to do with LiVES.

Jan 12 '22 02:01 salsaman

Earlier on in one of these issues, I reported that same "canary" fail, which was solved by updating mpv to the latest version, 0.34.1. Trying same test as you did above:

# mpv --no-video --ao=pcm 20051210-w50s_56K.flv 
     Video --vid=1 (vp6f 192x154 10.000fps)
 (+) Audio --aid=1 (mp3 1ch 11025Hz)
[ao/pcm] File: audiodump.wav (WAVE)
[ao/pcm] PCM: Samplerate: 11025 Hz Channels: 1 Format: float
AO: [pcm] 11025Hz mono 1ch float

Exiting... (End of file)
#

I played the file 'audiodump.wav' in mhwaveedit, it is 16.8 sec long.

Well, if you really want to chase down what is going on, why not bootup EasyOS?

Download the image file easy-3.2-amd64.img.gz from: https://distro.ibiblio.org/easyos/amd64/releases/dunfell/3.2/easy-3.2-amd64.img.gz
Expand and write it to a usb-stick. Need a usb stick at least 8GB, good quality (for example Sandisk Ultra or Sandisk Extreme), say it is /dev/sdb, do as root:

# gunzip easy-3.2-amd64.img.gz
# dd if=easy-3.2-amd64.img of=/dev/sdb bs=1M
# sync

Boot from the usb-stick
Install dev pkgs: Click "sfsget' on the desktop, choose file 'devx_3.2_amd64.sfs' Install it to main desktop, not in a container. Reboot.
You are now ready to compile. Absolutely every dev pkg is installed and all tools such as autotools, git, etc. There is even nemiver gui debugger.

Jan 12 '22 09:01 bkauler

LiVES
LiVES copied to clipboard

Small video sound works but video scrambled

===================================================== Video

===================================================== Video Codec Extradata

===================================================== Audio (1 active track)

Runtime

LiVES LiVES copied to clipboard

Small video sound works but video scrambled

===================================================== Video

===================================================== Video Codec Extradata

===================================================== Audio (1 active track)

Runtime

LiVES
LiVES copied to clipboard