cppcheck icon indicating copy to clipboard operation
cppcheck copied to clipboard

donate-cpu: collect and avoid packages with no files to process

Open firewave opened this issue 3 years ago • 1 comments

firewave avatar Sep 23 '22 11:09 firewave

This currently only implements the client and server calls to send this information to the server. It does not use the data yet.

The idea is the following:

  • store the packages without files to process in a separate file e.g. packages_nodata.txt
  • no-op the entry in the in-memory packages and skip those entries in the get calls
  • on start-up remove the packages_nodata.txt entries from the list generated from packages.txt
  • remove all non-matching entries from packages_nodata.txt and store that cleaned up file so the list won't grow indefinitely

firewave avatar Sep 23 '22 11:09 firewave

[2022-11-20 15:33:03.543381] work path: /home/sshuser/daca@home
[2022-11-20 15:33:03.588505] packages: 38683
[2022-11-20 15:33:03.590235] packages_nodata: 348
[2022-11-20 15:33:03.591534] removing packages with no files to process
[2022-11-20 15:33:03.605872] packages: 38335
[2022-11-20 15:33:03.608985] version 1.3.32

firewave avatar Nov 20 '22 18:11 firewave

FYI after an almost complete run with only some of the clients providing this info we have already filtered out almost 11,000 packages!

firewave avatar Nov 29 '22 13:11 firewave