rpmlint icon indicating copy to clipboard operation
rpmlint copied to clipboard

Process packages parallelly

Open marxin opened this issue 5 years ago • 6 comments

The following loop can be processed in a parallel way: https://github.com/rpm-software-management/rpmlint/blob/3fb9d6ce2a1538103aba946931db0adc147eb4a5/rpmlint/lint.py#L146-L148

marxin avatar Nov 02 '20 10:11 marxin

It can't until the pkg.py is redone as it stores some of the data in the same location unfortunately.

scarabeusiv avatar Nov 02 '20 10:11 scarabeusiv

I see, please assign it to me then.

marxin avatar Nov 02 '20 17:11 marxin

It can't until the pkg.py is redone as it stores some of the data in the same location unfortunately.

No, apparently it's not the problem. Each rpm is extra to its own directory. The problem seems to be a shared resource: self.checks that likely have an internal state..

marxin avatar Nov 04 '20 10:11 marxin

And the crucial shared resource is rpm (RPM binding). Apart from that also _magic is not thread safe.

marxin avatar Nov 04 '20 13:11 marxin

please assign it to me

marxin avatar Nov 04 '20 14:11 marxin

One another option is to run parallelly all checks for each package. Let me try it...

marxin avatar Nov 05 '20 09:11 marxin