yarr icon indicating copy to clipboard operation
yarr copied to clipboard

Limit stored articles

Open lamescholar opened this issue 3 months ago • 1 comments

When you have a lot of feeds, the storage database grows fast in size and the program starts to work slower, so you need to delete the storage database, and start with a clean slate.

The solution may be adding an option to choose the amount of feed articles stored in memory. 100 or 200. So old ones are automatically deleted after refreshing.

lamescholar avatar Mar 18 '24 18:03 lamescholar

Most likely never going to happen (#57) but I wish there was a way to achieve this too.

xfzv avatar Mar 19 '24 09:03 xfzv

@lamescholar what's the scale of your feed? I've initially tested it against a subscription with 1000 feeds, which it handled fine, though I didn't run long-term test and how it'd affect it performance-wise.

Currently it does delete old feeds to cleanup space and prevent performance decrease (see here).

nkanaev avatar Apr 09 '24 10:04 nkanaev

I have about 600 feeds. After a month, when the storage database grows past 1 GB, the program starts to work slower.

lamescholar avatar Apr 10 '24 02:04 lamescholar

I have a feeling that SQLite is perfectly capable of handling dbs larger than 1GB. This may be the app issue that needs fine-tuning.

I can do some profiling to find out the root cause, but I need sample db (causing slowness) for that. If you'd be comfortable sharing your local db, drop me a messages at nkanaev [at] live [dot] dom.

nkanaev avatar Apr 10 '24 09:04 nkanaev

I deleted .db recently. At the moment it's 300 MB. I will send it when lags will pop up.

lamescholar avatar Apr 11 '24 00:04 lamescholar

Most likely never going to happen (#57) but I wish there was a way to achieve this too.

I wish for the same thing.

This is one of the greatest tasks in managing database for feed reader. Everything must be stored in order to compare it with currently pulled items.

Did you think of removing all data* and keep only identifying information like ID, Link and Dates** until they are no longer valid***?


* Items older than X days. ** By Date I refer to the property "Updated" which is subjected to updates, unlike property "Published" which should be fixed. *** Until an item is no longer exist on the server.

sjehuda avatar Apr 25 '24 06:04 sjehuda