podgrab icon indicating copy to clipboard operation
podgrab copied to clipboard

Can't add podcasts (EOF - forbidden)

Open kyrawertho opened this issue 2 years ago • 25 comments

Hi, I am just setting up Podgrab for the first time and I can't seem to add several podcasts. When I add them, an error message shows only "EOF" and Docker shows this:

/api/db/dbfunctions.go:17 record not found
[0.433ms] [rows:0] SELECT * FROM `podcasts` WHERE `podcasts`.`url` = "https://feeds.buzzsprout.com/1403161.rss" ORDER BY `podcasts`.`id` LIMIT 1
Response status: 403 Forbidden
{"level":"dpanic","ts":1658264273.0248008,"caller":"[email protected]/sugar.go:191","msg":"Ignored key without a value.","ignored":"EOF","stacktrace":"go.uber.org/zap.(*SugaredLogger).Errorw\n\t/go/pkg/mod/go.uber.org/[email protected]/sugar.go:191\ngithub.com/akhilrex/podgrab/service.AddPodcast\n\t/api/service/podcastService.go:217\ngithub.com/akhilrex/podgrab/controllers.AddPodcast\n\t/api/controllers/podcast.go:406\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:165\ngithub.com/gin-gonic/gin.CustomRecoveryWithWriter.func1\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/recovery.go:99\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:165\nmain.setupSettings.func1\n\t/api/main.go:216\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:165\ngithub.com/gin-gonic/gin.CustomRecoveryWithWriter.func1\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/recovery.go:99\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:165\ngithub.com/gin-gonic/gin.LoggerWithConfig.func1\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/logger.go:241\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:165\ngithub.com/gin-gonic/gin.(*Engine).handleHTTPRequest\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/gin.go:489\ngithub.com/gin-gonic/gin.(*Engine).ServeHTTP\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/gin.go:445\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2843\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:1925"

Also, I tried adding a random podcast from the search results and it worked, but I found no way to delete it again. Is there a way to delete a podcast apart from deleting podgrab.db?

Thanks

kyrawertho avatar Jul 19 '22 20:07 kyrawertho

Let me see what I can do.

On Wed, 20 Jul 2022, 2:27 am kyrawertho, @.***> wrote:

Hi, I am just setting up Podgrab for the first time and I can't seem to add several podcasts. When I add them, an error message shows only "EOF" and Docker shows this:

/api/db/dbfunctions.go:17 record not found [0.433ms] [rows:0] SELECT * FROM podcasts WHERE podcasts.url = " https://feeds.buzzsprout.com/1403161.rss" ORDER BY podcasts.id LIMIT 1

— Reply to this email directly, view it on GitHub https://github.com/akhilrex/podgrab/issues/225, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAEMVPSX7PFDOS7SQUJEVQLVU4JDFANCNFSM54BJ5TKA . You are receiving this because you are subscribed to this thread.Message ID: @.***>

akhilrex avatar Jul 20 '22 00:07 akhilrex

I'm chiming in because I also face this issue and noticed that it's only happening when the feed URL points to feeds.buzzsprout.com, just like in @kyrawertho log. Podcasts hosted elsewhere are working fine for me.

jazzsnobeatcake avatar Aug 01 '22 09:08 jazzsnobeatcake

Getting the same error with buzzsprout feeds.

Trying to curl with the user agent podgrab provides (Go-http-client/2.0) returns "error code: 1020" which is a cloudflare thing. Same with using the UA in a browser. server responds with a much more detailed cloudflare error page with the same error code.

Workaround could be to set a custom useragent.

I never worked with cloudflare before but since other cloudflare protected sites work just fine with this user agent it is most likely on buzzsprouts side to fix this.

Screenshot_20220801-140218

shellyeah avatar Aug 01 '22 12:08 shellyeah

I've tried adding a podcast which also seems to come from buzzsprout and had the same EOF issue.

https://podcastaddict.com/podcast/4040551

t3rminalx avatar Aug 01 '22 18:08 t3rminalx

Hey guys! This is Tom from Buzzsprout. Are you able to set the user agent to something that reflects podgrab?

tomrossi7 avatar Aug 01 '22 21:08 tomrossi7

+1 I have the same issue with Buzzsprout podcasts: e.g.: https://podcastaddict.com/podcast/3386743

wiseindy avatar Sep 13 '22 13:09 wiseindy

Has the user agent been updated?

tomrossi7 avatar Sep 13 '22 13:09 tomrossi7

There's an open PR that fixes this issue: https://github.com/akhilrex/podgrab/pull/214

wiseindy avatar Sep 13 '22 13:09 wiseindy

There's an open PR that fixes this issue: #214

Thats awesome, thank you. I've noticed you've approved the changes too. How long until we see the changes in the code?

t3rminalx avatar Sep 13 '22 14:09 t3rminalx

Not sure, since I don't have the access to merge. Pinging @akhilrex

wiseindy avatar Sep 13 '22 14:09 wiseindy

@t3rminalx In the meantime, I created a fork here with the user agent fix: https://github.com/wiseindy/podgrab

If you use docker and want to use it, you can swap out the image akhilrex/podgrab with wiseindy/podgrab until we wait for the PR to be merged in this repo.

wiseindy avatar Sep 13 '22 17:09 wiseindy

@tomrossi7 In the meantime, I created a fork here with the user agent fix: https://github.com/wiseindy/podgrab

If you use docker and want to use it, you can swap out the image akhilrex/podgrab with wiseindy/podgrab until we wait for the PR to be merged in this repo.

It's working like a charm :-)

t3rminalx avatar Sep 20 '22 10:09 t3rminalx

Just commenting to follow along, having some issues here as well.

Gorship avatar Oct 01 '22 05:10 Gorship

So the docker image from @wiseindy and the updated image from @akhilrex both now enable me to add the podcast I was having trouble with however it’s not grabbing the episode artwork or anything newer than when the podcast was initially added.

t3rminalx avatar Oct 01 '22 06:10 t3rminalx

Having the same issue with buzzsprout, what should be setting the user agent to here? Something to mimic a browser or something specific to identify podgrab?

ghenry22 avatar Oct 08 '22 08:10 ghenry22

So the docker image from @wiseindy and the updated image from @akhilrex both now enable me to add the podcast I was having trouble with however it’s not grabbing the episode artwork or anything newer than when the podcast was initially added.

what did you use for the user-agent setting? I've tried leaving it blank or setting it the same as chrome on my mac and in either case still get the EOF error with a 403 denied in the container logs. using latest akhilrex docker container from docker hub

ghenry22 avatar Oct 09 '22 15:10 ghenry22

You should set the user-agent to something to identify yourself or your app -- do not spoof Chrome or any other app since you would then get blocked.

tomrossi7 avatar Oct 09 '22 21:10 tomrossi7

@tomrossi7 yep no problem, the issue I was seeing was that the user agent was still not being applied at one point in the code so it wasn't working regardless of what I put in there, have submitted a PR to resolve.

Once that gets merged I'll put together something to ensure that a default user-agent that identifies podgrab and the version is used instead of the library default or people putting in random spoofing unnecessarily.

ghenry22 avatar Oct 10 '22 10:10 ghenry22

Perfect! Thanks!

tomrossi7 avatar Oct 10 '22 12:10 tomrossi7

I'm still seeing this issue even when using @wiseindy 's version 2022.07.07

chiefy avatar Jan 22 '23 15:01 chiefy

Is there any update to this? I see PR #243 hasn't been touched in a few months. I'm still seeing the issue.

zanish avatar Feb 21 '23 19:02 zanish

I'm unfortunately also experiencing this issue. Just tried setting it up for the first time and the 4 that failed were all buzzsprout.

thrillhouse2342 avatar Mar 23 '23 22:03 thrillhouse2342

I had trouble with this and a buzzsprouts podcast. setting the docker image to wiseindy/podgrab and setting the user-agent to something Podgrab - docker worked

2600box avatar Apr 05 '23 19:04 2600box

I'm also having this issue +1

Patriot2407 avatar Apr 12 '23 23:04 Patriot2407