intro-skipper icon indicating copy to clipboard operation
intro-skipper copied to clipboard

[Feature] How long should a scan take?

Open jgeorge1983 opened this issue 2 years ago • 21 comments

I have around 7.5k episodes on my NAS and after 16 hours scanning I was at 20%. I'm running a rasberry pi4, and run Jellyfin in docker.

I dont mind leaving it running, but I also have HomeAssistant in docker and find that when I run the Alayze Episodes, it seems to interfere with my HomeAssistant instance, I think just a resource issue.

So just wondering if there are any benchmarks for how long I should expect it to run?

Server: raspberrypi Version: 10.8.0 Operating System: Linux Architecture: Arm

jgeorge1983 avatar Jun 22 '22 13:06 jgeorge1983

I found raspberry pi4 not good enough for Jellyfin. My last scan took 10 hours.

sourpatched avatar Jun 23 '22 07:06 sourpatched

I'm slowly thinking the same, thanks for the update

jgeorge1983 avatar Jun 23 '22 07:06 jgeorge1983

10 hours on Intel Core I so your scan may take days.

sourpatched avatar Jun 23 '22 09:06 sourpatched

Could take a week!

jgeorge1983 avatar Jun 23 '22 09:06 jgeorge1983

My scan took about 2 full days on a beefy machine, so theres no limit

Pfuenzle avatar Jun 23 '22 10:06 Pfuenzle

For me it took about 2 hours for 9k episodes with my setup:

  • OMV 6.0.29-1 (Shaitan) (on SSD) - Linux 5.16.0-0.bpo.4-amd64
  • AsRock B550M-ITX/ac
  • AMD Ryzen 3 3100 4-Core Processor
  • 32 GB DDR4
  • 2x18TB Western Digital Ultrastar DC HC550 (Stripe)
  • 1x 4TB Toshiba HDWE140, 1x 3TB Toshiba HDWE130
  • 1x 240GB ​Intenso High Performance SSD 240GB (M.2) )(for configs and metadata)
  • Nvidia Quadro P2000
  • Jellyfin 10.8.0 (Official Docker image)

conkydong avatar Jun 23 '22 11:06 conkydong

@jgeorge1983 @conkydong How are you finding out how many episodes?

sourpatched avatar Jun 23 '22 11:06 sourpatched

I have another app, medusa, that handles all my downloading, and that has a running total.

Other than that, right click >>> properties, would give you total of files, that would be a rough guess but may include subtitles, images and other files.

jgeorge1983 avatar Jun 23 '22 11:06 jgeorge1983

@sourpatched I ran the following in a terminal on my server:

ls -LR /folder_to_my_tv_shows | egrep '\.mp4$|\.mkv$|\.avi$' | wc -l

conkydong avatar Jun 23 '22 11:06 conkydong

@jgeorge1983 I have meta data stored with the shows so that won't work.

@conkydong Thanks, I'll give that a try when I access the server.

sourpatched avatar Jun 23 '22 11:06 sourpatched

"Switch to single precision fftw, enable neon for arm" in jellyin-ffmpeg 5.0.1-7.

This should help the performance on Arm platforms.

nyanmisaka avatar Jun 23 '22 11:06 nyanmisaka

"Switch to single precision fftw, enable neon for arm" in jellyin-ffmpeg 5.0.1-7.

This should help the performance on Arm platforms.

Awesome, thanks!

jgeorge1983 avatar Jun 23 '22 11:06 jgeorge1983

Are you running 32bit or 64bit Pi OS?

nyanmisaka avatar Jun 23 '22 12:06 nyanmisaka

I presume 64bit, as its a Pi 4b

Linux version 5.10.103-v7l+ (dom@buildbot) (arm-linux-gnueabihf-gcc-8 (Ubuntu/Linaro 8.4.0-3ubuntu1) 8.4.0, GNU ld (GNU Binutils for Ubuntu) 2.34) #1529 SMP Tue Mar 8 12:24:00 GMT 2022

jgeorge1983 avatar Jun 23 '22 13:06 jgeorge1983

v7l, arm-linux-gnueabihf-gcc-8

Nope. It's armv7 armhf 32bit. You can switch to 64bit Pi OS for better performance.

nyanmisaka avatar Jun 23 '22 13:06 nyanmisaka

do you know of an easy way to switch or is it a rebuild?

jgeorge1983 avatar Jun 23 '22 13:06 jgeorge1983

You have to reinstall it if you want, the dependencies are totally different.

nyanmisaka avatar Jun 23 '22 13:06 nyanmisaka

looks like thats a few hours of my weekend sorted, the wife will be pleased ha :)

jgeorge1983 avatar Jun 23 '22 15:06 jgeorge1983

It took me around 2 weeks for 150,000 episodes, this was using an iGPU which was the 7700. This wasn't constant however, as sometimes the scan would fail and it would require me to restart it.

JamsRepos avatar Jun 27 '22 17:06 JamsRepos

About 3 weeks on an Intel Xeon E-2186G with around 50TB in Episodes from an rclone mount.

NightHammer1000 avatar Sep 05 '22 21:09 NightHammer1000

@jgeorge1983 @conkydong How are you finding out how many episodes?

You can just go to your local API : https://your-domain/Items/Counts?api_key=api_key

To generate an API_KEY you can go to your Dashboard > Api Key > Generate

(to know more information you can check your local swagger : https://your-domain/api-docs/swagger/index.html

EL-R1 avatar Jun 27 '23 12:06 EL-R1