awesome-podcasts icon indicating copy to clipboard operation
awesome-podcasts copied to clipboard

Golang Script to Validate Podcasts

Open rShetty opened this issue 5 years ago • 5 comments

Script should do the following

  • Validate the links of the podcasts (whether they are broken)
  • Validate the order of the podcasts in each category (and also categories)

Break the build when either of the above validations fail

rShetty avatar Feb 03 '19 12:02 rShetty

Hey @rShetty , I don't mind taking this issue on.

I already implemented something similar on my repo, so I have some experience.

I have some ideas about how I may go about solving these 2 problems that I want to run by you:

  • Validating links:

    1. parse the URL
    2. make a GET request
    3. anything other than a 200/302 consider it bad.
    4. follow re-directs and repeat.
  • Validating order of the podcasts:

    1. using blackfriday to parse markdown
    2. walk 1st-level bullets and sort alphabetically (ignoring The)

Let me know if you prefer another way you prefer.

Questions:

  • Are you planning on doing the same for non-ASCII languages (I think Russian Cyrillic is the only one at the moment)?
  • Do you feel that storing the data in a YAML/JSON format may be easier for (un)marshalling/processing the data and outputting into various formats (e.g. markdown)?

pbnj avatar May 06 '19 02:05 pbnj

@petermbenjamin Your ideas on implementation makes sense, Lets go ahead with it. Are you planning on doing the same for non-ASCII languages (I think Russian Cyrillic is the only one at the moment)? Was thinking to start with English and then expand to others.

Do you feel that storing the data in a YAML/JSON format may be easier for (un)marshalling/processing the data and outputting into various formats (e.g. markdown)?

We can do this as Version 2 of this implementation

Let me know if you have any questions. Thanks

rShetty avatar May 10 '19 06:05 rShetty

@petermbenjamin Let me know if you are still planning to work on this issue. Someone else can pick up.

rShetty avatar Sep 12 '19 11:09 rShetty

@rShetty - Sorry for the delay. I have a bit of a busy schedule for the foreseeable future. Someone else can pick this up.

pbnj avatar Sep 16 '19 15:09 pbnj

If it's not yet done maybe I can help. I will make a github action to do this.

Akshay-Kumar-Sharma7807 avatar May 26 '22 02:05 Akshay-Kumar-Sharma7807