awesome icon indicating copy to clipboard operation
awesome copied to clipboard

Removing broken links from lists

Open basharovV opened this issue 4 years ago • 3 comments

I've got a list of every dead or broken link in every awesome list, along with the error, which is probably useful to the list maintainers.

Here is the output from my cleanup script, which checks every URL in every awesome list:

Total urls: 47941  Valid urls: 41299 Invalid urls: 6642  HTTP errors: 2044  Other errors: 2406

That's 14% of all links being unavailable...

If you maintain an awesome list, feel free to find the file for your list and check if it has any dead links.

basharovV avatar Jun 23 '20 11:06 basharovV

Here's a tool that could help check if your lists links are alive: https://github.com/dkhamsing/awesome_bot

I use it on my awesome-version-managers list .travis.yml config for CI automation.

bernardoduarte avatar May 14 '21 19:05 bernardoduarte

in my repo i use this github action who check link and lint

name: Check Lint

on:
  workflow_dispatch:
  push:
    branches:
    - main
  schedule:
  # Run every first day at 00:00 AM every month.
    - cron: "0 0 * * *"
  pull_request:
    branches: [main]
    paths:
      - 'readme.md'

jobs:
  main:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v3
        with:
          fetch-depth: 0
      - name: Check links
        uses: gaurav-nelson/github-action-markdown-link-check@v1
        with:
          retry-after: 10
          use-quiet-mode: 'yes'
          use-verbose-mode: 'yes'
          config-file: '.github/workflows/markdown.links.config.json'
      - name: Awesome linter
        run: npx awesome-lint

riderx avatar Nov 21 '22 07:11 riderx

This was really helpful @riderx. The only change I made was I run the awesome linter first, then the check links.

d-wasserman avatar Nov 23 '22 05:11 d-wasserman