Ensure `go mod tidy` is not broken up till minimum version

[shahzadlone]

Previously this commit broke mod tidy command c42e7ee6 feat: Update corelog to 0.0.7 (#2547)

It was a bit pain to find after rebasing a PR with conflicts but a version bump was necessary.

Introduce a CI job to always ensure it's not broken.