Johannes Müller

Hm, that's too bad 😢 I guess we'll have to remove the entire pattern background then. Or figure out how to fix this for real 🤷 > I assumed it...

Ref: https://github.com/crystal-lang/crystal-website/pull/472#issuecomment-1642019936 > Sources that are not owned by us are distribution package repositories like BSD ports and packages, apk (Alpine), portage (Gentoo), pacman (Arch Linux). >And most repos for...

There is essentially discussed crystal-lang/crystal#5952 The idea was to use `canonical` references to the latest url. But that also has some issues. And most importantly, it currently doesn't cover doc...

This should be fairly simple to automate. Essentially you only need to extract all local links from each version's `index.html` in the API docs. That's already the URLs for the...

@RX14 The problem with canonical links is that docs for older versions vanish from the search results because the search algorithm treats them as duplicate content. But in fact, they're...

I've put together a simple program to automatically generate sitemaps for https://crystal-lang.org/api It's available at https://github.com/straight-shoota/crystal_docs_sitemap Generated output: [output.tar.gz](https://github.com/crystal-lang/crystal-website/files/3579252/output.tar.gz) The output contents should be published at https://crystal-lang.org/api/ and search engines...

@bcardiff WDYT?

> I don't think having the sitemap checked in the repo is the right thing. Agreed. It just needs to be generated and put into an S3 bucket. Ideally, a...

> Wouldn't that prevent indexing other pages? No, sitemaps are not used as an exclusive source. Search engines still employ their regular crawling. They just augment the results or help...

> I thought we didn't want sitemap for master. Is mostly used for preview I guess it's not strictly necessary, but when the doc generator puts out the sitemap anyway,...