Piped Why Piped doesn't fetch feed correctly?

Official Instance

[X] The bug is reproducible on the official hosted instance, or is API-related.

Describe the bug

It doesn't fetch feeds correctly specially latest ones, also some older feeds too. When I goto channels then it fetched correctly but not in feed page. For Example- Test feed page - feed Channel page- channel

I have almost 80 subscription on Newpipe and it give 16 + video for today feed whereas Piped gives 4 (it includes big channels like mkbhd) with same subscriptions. Problem happens with small channels. I don't know how to fix it ?

To Reproduce

Open Piped URL
Goto channel (like John Hammond)
Subscribe
Go and refresh feed

Expected behavior

It should fetch every video like Newpipe

Logs/Errors

No response

Browser, and OS with Version.

Firefox 129.0.2 LibreTube

Additional context

I tried to change instances but problem still persist. I used fresh piped page with default settings also not logged in for test example.

Aug 24 '24 03:08 FrozenVertx

I have the same issue, using the LibreTube app.

Aug 26 '24 09:08 elliotfontaine

Can confirm on both external frontend (piped.video), instance frontend, and LibreTube app.

Aug 28 '24 12:08 milenakos

Same here

Sep 01 '24 19:09 Tamarindo94

same, also on Libretube on every instance

Sep 05 '24 15:09 PricacyPro0

I've noticed the same, It appears to be different for each instance, An Invidious instance issue? I've also noticed none of which show live streams anymore on my end.

Sep 08 '24 05:09 ACR-Jeff

Piped also doesn't show shorts anymore.

Sep 09 '24 15:09 PricacyPro0

Same here. I'm using LibreTube with Kavin's official instances but I confirmed that it's the same on the instance website.

Piped also doesn't show shorts anymore.

It seems to be working only sometimes with Kavin's official instances.

Sep 10 '24 15:09 PhilC813

Related? https://github.com/iv-org/invidious/issues/4906

Sep 12 '24 23:09 ACR-Jeff

Invidious has had a pull request for some time now. I am not much of a coder otherwise I would be contributing. Maybe others are willing to help solve this issue. https://github.com/iv-org/invidious/issues/4906#issuecomment-2356916307 https://github.com/iv-org/invidious/pull/2469

Sep 19 '24 00:09 ACR-Jeff

Just started having this issue

Oct 04 '24 11:10 lividhen

I am facing the same issue on my instance, which is not throttled. It looks like that, for some channels, unsubscribing and subscribing again fixes the issue. Is there a way to trigger a re-fetch of all the subscribed channels?

Nov 12 '24 12:11 jim3692

This happens to me on Libretube. I thought it was libretube for a long time but just thought to try piped on a PC browser and see the same. Some subscriptions load, but most don't.

Nov 12 '24 16:11 ryboto

I am facing the same issue on my instance, which is not throttled. It looks like that, for some channels, unsubscribing and subscribing again fixes the issue. Is there a way to trigger a re-fetch of all the subscribed channels?

It fixed itself somehow

Nov 12 '24 16:11 jim3692

I wrote this script to refresh all subscription content. You can paste it in the Dev-Console to run it; just make sure to insert the right API-URL in line 10 (const apiUrl = ...).

await (async function() {
    function sleep(ms) {
        return new Promise((resolve) => {
            setTimeout(resolve, ms);
        });
    }
    
    const authTokenKey = Object.keys(localStorage).find(itm => itm.startsWith("authToken"));
    const authToken = localStorage.getItem(authTokenKey);
    const apiUrl = "URL";
    
    const subs = await (await fetch(`${apiUrl}/subscriptions`, {
        headers: {
            "Authorization": authToken
        }
    })).json();
    for(let sub of subs) {
        await sleep(200);
    
        const chan = await (await fetch(`${apiUrl}${sub.url}`)).json();
        console.log(chan.name);
        
        const shortsTab = chan.tabs.find(itm => itm.name == "shorts");
        if(shortsTab == null) continue;
        const shorts = await (await fetch(`${apiUrl}/channels/tabs?data=${encodeURIComponent(shortsTab.data)}`)).json();
    }
    
    console.log("done");
})();