Add OCI Conformance validation with ORAS

[SteveLasker]

Add several steps to validate if a registry supports OCI Artifact types using oras push|pull

Signed-off-by: Steve Lasker [email protected]

[jdolitsky]

Can also wrap this in robot framework to get some better output. See this example in Helm: https://github.com/helm/acceptance-testing/blob/main/testsuites/repos.robot

[SteveLasker]

:eyes: Thanks, folks. I'll get this incorporated next week.

[sajayantony]

Should we decide if this is the roadmap or not and close the PR?

[SteveLasker]

Yes, it's something I'd like to see incorporated. I'm probably not the right person to write that code. As it stands, this PR has helped others validate their registries support the OCI Artifacts requirements. So, it's useful even if just open. Better if it was merged as Josh suggested.

[sajayantony]

This was a good starting point for the discussions that lead OCI artifacts. Given that we now have - https://github.com/opencontainers/distribution-spec/tree/main/conformance and ORAS repo has all the E2E tests planned do we need this PR or can we close it @SteveLasker ref : https://github.com/oras-project/oras/pull/639

[SteveLasker]

This was initially created to help docker enable oci artifacts. Now that they’re done, every other registry now enables OcI Artifacts, and there’s better codified solution, happy to close this one.