FreeTube [Bug]: Refreshing videos (with forced RSS due to number of subscriptions) misses a lot of new videos.

Guidelines

[x] I have encountered this bug in the latest release of FreeTube.
[x] I have encountered this bug in the official downloads of FreeTube.
[x] I have searched the issue tracker for open and closed issues that are similar to the bug report I want to file, without success.
[x] I have searched the documentation for information that matches the description of the bug I want to file, without success.
[x] This issue contains only one bug.

Describe the bug

Have a large amount of subscriptions (>1000).
Click on refresh button (forced RSS).
Select profile with a few subscriptions (<50).
Click on refresh button.
New videos appear.

Expected Behavior

Same amount of videos when refreshing large amount of subs.

Issue Labels

API issue, inconsistent behavior, data loss

FreeTube Version

v0.23.2 Beta

Operating System Version

Linux 6.13.6

Installation Method

.AppImage

Primary API used

Invidious API

Last Known Working FreeTube Version (If Any)

No response

Additional Information

No response

Nightly Build

[ ] I have encountered this bug in the latest nightly build.

Mar 14 '25 11:03 Giger22

Can you please provide a screen recording, a screen shot of the devtools console (CTRL+SHIFT+I -> Console tab, take a screenshot of red messages, ignore yellow ones) and a more detailed explanation e.g. you don't say what is to be expected between step 2 and 3, it's unclear what "misses a lot of new videos" means (specific videos missing or entire channels or something else).

After doing all those steps I would highly advise that you drastically reduce the number of subscriptions you have, as the problem is likely just that you have way too many channels and are getting ratelimited by YouTube.

Mar 17 '25 09:03 absidue

It usually misses random videos, not entire channels.

Mar 18 '25 09:03 Giger22

I would recommend using the Local API as the Invidious API/instances are having allot of issues nowadays. If you still want to try an instance see https://api.invidious.io/ and use an instance that have green checkmark in the API and CORS sections.

Let me know if this worked and if not what errors you received

Mar 18 '25 18:03 efb4f5ff-1298-471a-8973-3d47447115dc

Not so much better either way (local API vs working ivd API). I guess I have too many subscriptions for the API. What about a new feature that splits all subscriptions in a few profiles so that this problem can be circumvented?

Mar 18 '25 20:03 Giger22

What about a new feature that splits all subscriptions in a few profiles so that this problem can be circumvented?

It's user responsibility to categorize/split their subscriptions into separate profiles. We cant decide what subscriptions an user wants in a certain profile.

Mar 19 '25 08:03 efb4f5ff-1298-471a-8973-3d47447115dc

OK, so it is the API issue.

Mar 19 '25 12:03 Giger22

It's not an API issue, the problem is that you have way too many subscriptions.

Unless you split them up and refresh infrequently, it is entirely expected that you will hit ratelimits on YouTube's end. The other option is of course to reduce your subscriptions to a sensible amount. The reason you are seeing older videos instead of nothing at all is because of the cache.

Mar 19 '25 13:03 absidue