Runtime: program exceeds 10000-thread limit

[zeinlol]

I decided to scan large amount of files and directories in one scan and received this error:

runtime: program exceeds 10000-thread limit kics/pkg/analyzer/analyzer.go:241<very long trace with end in> kics/pkg/analyzer/analyzer.go:247

Scanned path is like 250+ gb so program just tried to create too much workers, jumped into go default max value (10000) and then crashed

I understand that the best way is to divide data for different scans, but what about adding ability to increase this number in arguments?

[kaplanlior]

Thank @zeinlol for reporting this issue.

Can you help me understand your use case that got you to scan 250 GB for files? As most of the files are text file (yaml, json...) reaching to 250 GB is very unusual, and I would like to learn more.

[zeinlol]

I have folder with a lot of different sources of various projects and I decide to scan them all in one time

[gabriel-cx]

Hi @zeinlol ,

Do you still get the same issue when you use the latest KICS version (v1.7.11)?

[gabriel-cx]

Hi @zeinlol ,

Are you getting the same problem when you use the latest version (v1.7.12)?

[gabriel-cx]

Hi @zeinlol ,

We are closing this issue due to inactivity. Feel free to open a new issue if you are still facing the same problem or any other issue.