LiveStreamDVR icon indicating copy to clipboard operation
LiveStreamDVR copied to clipboard

[Improvement] Auto Exporter

Open Serph91P opened this issue 2 years ago • 36 comments

Would be great to have something that automatically exports to specified export destination so all the vods are getting send over ftp or something.

Serph91P avatar Oct 25 '22 16:10 Serph91P

that should be a thing in settings

MrBrax avatar Oct 25 '22 16:10 MrBrax

that should be a thing in settings

you are absolutely right, but its no implemented yet I guess? grafik

Serph91P avatar Oct 25 '22 16:10 Serph91P

haven't tested it myself really but it should be using the same exporter as the other ones

MrBrax avatar Oct 25 '22 17:10 MrBrax

haven't tested it myself really but it should be using the same exporter as the other ones

ok have enabled it on my testing instance, will see what happens.

Serph91P avatar Oct 25 '22 17:10 Serph91P

Would it be possible to export all existing vods with a single click?

Also when using the export button it opens a pop-up where you can set de name etc, when clicking exporting again nothing seems to happen to confirm you are starting the export. This resulted in multiple clicks, so now I uploaded the same vod multiple times without knowing :p

It does give a message in the log tho.

(Using mobile and it gives an error when adding pictures to show log etc)

CappiSteijns avatar Oct 26 '22 14:10 CappiSteijns

exporting all could create some considerable issues with at least youtube, but i can probably implement it without a gui

MrBrax avatar Oct 26 '22 15:10 MrBrax

export worked from lsdvr part, progress and process was also shown. Only thing is youtube beeing funny again: grafik grafik

Serph91P avatar Oct 26 '22 16:10 Serph91P

yeah that is quite odd considering i check for the upload status now

MrBrax avatar Oct 26 '22 16:10 MrBrax

i've improved the auto exporter by using the mass exporter, it should work properly now i think

mass exporting works at least with rclone, uses default exporter config

MrBrax avatar Oct 26 '22 17:10 MrBrax

export worked from lsdvr part, progress and process was also shown. Only thing is youtube beeing funny again:

i've improved the auto exporter by using the mass exporter, it should work properly now i think

mass exporting works at least with rclone, uses default exporter config

not working for youtube mass export, since you cannot set a category which is mandatory it seems:

2022-10-27 11:06:49.532 | route.channel.ExportAllVods <ERROR> Auto exporter error for 'thiseguy (2022) - s202210e15': Exporter creation error: No category set

Serph91P avatar Oct 27 '22 09:10 Serph91P

oh yeah that makes sense, fixing

MrBrax avatar Oct 27 '22 10:10 MrBrax

should be properly pushed now

MrBrax avatar Oct 27 '22 10:10 MrBrax

should be properly pushed now

2022-10-27 14:52:34 route.channel.ExportAllVods ERROR Auto exporter error for 'thiseguy (2022) - s202210e15': Exporter creation error: No privacy level set

Serph91P avatar Oct 27 '22 12:10 Serph91P

i wonder if i should force that to private or if people are actually auditing channels allowing public to be set

MrBrax avatar Oct 27 '22 12:10 MrBrax

i wonder if i should force that to private or if people are actually auditing channels allowing public to be set

enforcing private would make the most sense.

Serph91P avatar Oct 27 '22 12:10 Serph91P

eh maybe it's changed some day, i'll make default as private though

MrBrax avatar Oct 27 '22 13:10 MrBrax

Regarding the Export button, it shows now it is exporting at the bottom of the screen! Very nice :)

However, if you don't pay atention to that you are still able to click the export button multiple times, so it will export muliple times. image image

Looking at current jobs it only shows 1 job: image But the ETA of the job very quicly jumps back and forth with time 6-11-6-11...etc (so 2 exactly the same jobs show as one?)

image

But the notification at the bottom is good enough for me, thanks! :D

CappiSteijns avatar Oct 27 '22 13:10 CappiSteijns

@CappiSteijns is that on develop? the export button thing isn't on master yet, although i never tested it so it might be broken

MrBrax avatar Oct 27 '22 16:10 MrBrax

eh maybe it's changed some day, i'll make default as private though

could you add title back to the name? grafik

Serph91P avatar Oct 27 '22 16:10 Serph91P

@CappiSteijns is that on develop? the export button thing isn't on master yet, although i never tested it so it might be broken

export button was working for me.

Serph91P avatar Oct 27 '22 16:10 Serph91P

another great adition would be to delete the files after the uploaded finishes to save space.

Serph91P avatar Oct 27 '22 16:10 Serph91P

uhh with how youtube uploads don't finish, would that be a good idea?

MrBrax avatar Oct 27 '22 16:10 MrBrax

uhh with how youtube uploads don't finish, would that be a good idea?

I get what you mean then have to delete myself.

Serph91P avatar Oct 27 '22 16:10 Serph91P

at least it saves some export metadata so it can be verified after the fact

MrBrax avatar Oct 27 '22 17:10 MrBrax

eh maybe it's changed some day, i'll make default as private though

could you add title back to the name? grafik

not possible to add?

Serph91P avatar Oct 28 '22 07:10 Serph91P

it should have been added, forgot to mention in commit

MrBrax avatar Oct 28 '22 07:10 MrBrax

it should have been added, forgot to mention in commit

thanks found it.

add to playlist is not working anymore though:

2022-10-28 09:38:11 YouTube SUCCESS Video uploaded: ch4crYO-Cn0
2022-10-28 09:38:11 YouTube SUCCESS Video uploaded, no playlist: ch4crYO-Cn0
2022-10-28 09:38:11 YouTubeExporter INFO Verifying /usr/local/share/twitchautomator/data/storage/vods/maxim/Season 202210/maxim (2022) (40002130488) - s202210e35.mp4 on YouTube...
2022-10-28 09:38:12 YouTube SUCCESS Video verified: ch4crYO-Cn0
2022-10-28 09:38:12 automator.onEndDownload SUCCESS Exporter finished for vodBasenameTemplate() { const date = (0, import_date_fns13.parseJSON)(this.getStartDate()); if (!date || !(0, import_date_fns13.isValid)(date)) { Log.logAdvanced(Log.Level.ERROR, "automator.vodBasenameTemplate", Invalid start date: ${this.getStartDate()}); } if (!this.channel) { throw new Error("No channel for template"); } const variables = { login: this.getLogin(), internalName: this.channel.internalName, displayName: this.channel.displayName, date: this.getStartDate().replaceAll(":", "_"), year: (0, import_date_fns13.isValid)(date) ? (0, import_date_fns13.format)(date, "yyyy") : "", year_short: (0, import_date_fns13.isValid)(date) ? (0, import_date_fns13.format)(date, "yy") : "", month: (0, import_date_fns13.isValid)(date) ? (0, import_date_fns13.format)(date, "MM") : "", day: (0, import_date_fns13.isValid)(date) ? (0, import_date_fns13.format)(date, "dd") : "", hour: (0, import_date_fns13.isValid)(date) ? (0, import_date_fns13.format)(date, "HH") : "", minute: (0, import_date_fns13.isValid)(date) ? (0, import_date_fns13.format)(date, "mm") : "", second: (0, import_date_fns13.isValid)(date) ? (0, import_date_fns13.format)(date, "ss") : "", id: this.getVodID().toString(), season: this.vod_season || "", absolute_season: this.vod_absolute_season ? this.vod_absolute_season.toString().padStart(2, "0") : "", episode: this.vod_episode ? this.vod_episode.toString().padStart(2, "0") : "" }; return (0, import_sanitize_filename8.default)(formatString(Config.getInstance().cfg("filename_vod"), variables)); }
2022-10-28 09:38:12 vod.saveJSON SUCCESS Saving JSON of maxim (2022) (40002130488) - s202210e35 (export successful)
2022-10-28 09:38:55 config SUCCESS Saved config from settings form saved

playlist setup cohhcarnage=redacted;maxim=redacted;gronkh=redacted;...

Serph91P avatar Oct 28 '22 09:10 Serph91P

did it actually put the source code in the log file or what happened there??

MrBrax avatar Oct 28 '22 09:10 MrBrax

oh somehow js can print entire function sources, wack

it did say no playlist though, did it warn about having none?

MrBrax avatar Oct 28 '22 10:10 MrBrax

oh somehow js can print entire function sources, wack

it did say no playlist though, did it warn about having none?

It did not warn about playlist. Just did not add them.

Serph91P avatar Oct 28 '22 10:10 Serph91P