[Feature Request] Handle changes to old episode urls in Patreon private podcast feeds

[oblivierblop]

Before creating a bug report please make sure you are using the latest docker image / code base.

Please complete the following information

• Installation Type: Docker
• Have you tried using the latest docker image / code base: Yes

Describe the bug Patreon private RSS feeds have episode URLs that change periodically preventing downloads from working for older episodes in a podcast

To Reproduce Steps to reproduce the behavior:

1. Add a Patreon private RSS feed
2. Wait a period of time (not clear how often the tokens expire)
3. Try to download old episodes to server
4. Episodes fail to download
5. Manually downloading the episode from the URL fails with with "Expired URL"

Podgrab stores the URL for each episode in its database when first added. This is fine at first. However patreon private RSS feeds have episode urls with token time and token hash parameters that change periodically. When these change, the URL stored for the episode will no longer work, returning 403 (Forbidden) and the content "Expired URL". Removing and readding the podcast gets things working until your token expires again. This is a problem when going through the back catalogue of episodes for a podcast but won't happen if you're just following the latest episodes of a show.

A work around is to use the download all the episodes of a private podcast but not desirable for shows with an extremely high number of episodes.

Expected behavior Podgrab gets the correct URL from the RSS feed if the database episode url returns "Expired URL"

[akhilrex]

This is actually tricky. Podgrab actually uses urls to identify podcast episodes using the url as the unique identifier.

This means everytime podgrab checks for new episodes it should ideally consider the updated urls as new episodes and make new duplicate entries but should download it.

1. Are you seeing episode duplication for this podcast?
2. What have you set as the frequency for checking?
3. How short lived are these access tokens that they are expiring so soon? This problem could occur for older episodes but for new ones this should not come.
4. Have you enabled autodownload?

On Fri, Nov 12, 2021 at 5:04 AM olivialiban @.***> wrote:

Before creating a bug report please make sure you are using the latest docker image / code base.

Please complete the following information

• Installation Type: Docker
• Have you tried using the latest docker image / code base: Yes

Describe the bug Patreon private RSS feeds have episode URLs that change periodically preventing downloads from working

To Reproduce Steps to reproduce the behavior:

1. Add a Patreon private RSS feed
2. Wait a period of time (not clear how often the tokens expire)
3. Episodes fail to download with "Expired URL"

Podgrab stores the URL for each episode in its database when first added. This is fine at first. However patreon private RSS feeds have episode urls with token time and token hash parameters that change periodically. When these change, the URL stored for the episode will no longer work, returning 403 (Forbidden) and the content "Expired URL". Removing and readding the podcast gets things working until your token expires again.

Expected behavior Podgrab gets the correct URL from the RSS feed if the database episode url returns "Expired URL"

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/akhilrex/podgrab/issues/169, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAEMVPVJXQ6A6FQYE2R2MWLULRHHBANCNFSM5H3SNQ6A . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

-- Thanks and Regards, Akhil Gupta

[oblivierblop]

Thanks for your response. I can see how rechecking the URL for the failed old episodes is tricky. Thinking about it, this is more of a feature request than a bug as this seems to be patreon specific behaviour. What is a bug and not patreon specific is that podgrab saves the 11 byte "Expired URL" text as .mp3 and marks the download as successful despite the HTTP 403 response. Should I open a separate issue for that?

1. Not seeing episode duplication.
2. Is the frequency of checking an option within podgrab? I have not change it from the default
3. This is not a problem with new episodes, only old episodes. It happened while making my way through old episodes, listening to one or two a day, clicking "download to server" individually as I went. At the moment I can't put an exact time on token expiry but it seems to be happening in the 10-14 days range. (I assume this mechanism is meant to limit access to old episodes after a patreon user has stopped subscribing by ensuring stored file URLs stop working after a certain period)
4. Yes, autodownload is enabled.