typeid icon indicating copy to clipboard operation
typeid copied to clipboard

Let's consider the ways of automation of the spec validation

Open akhundMurad opened this issue 1 year ago • 4 comments

TypeID now has a lot of implementations in different programming languages. Therefore, there should be a way of tracking their validation statuses (against spec). I am wondering about a badge, that can show in the README a validation status (failed, succeed) of the particular library. Nevertheless, there should be better solutions.

akhundMurad avatar Jul 06 '23 13:07 akhundMurad

If every implementation had a CLI, a universal test could be done. I personally would like a test like that. I wouldn't miss any changes in the specification.

TenCoKaciStromy avatar Jul 07 '23 19:07 TenCoKaciStromy

Also we can implement an GitHub action. However, it's hard to imagine the way of running tests upon the diversity of languages and testing tools

akhundMurad avatar Jul 07 '23 21:07 akhundMurad

I actually created a workflow that does this! https://github.com/broothie/typeid-ruby/blob/main/.github/workflows/monitor_spec_updates.yml.

It runs on a nightly basis, and it basically just downloads the spec files and creates a PR if there's a diff. The next step would be to make the necessary changes to the implementation to make the specs green again, and merge the PR.

broothie avatar Jul 13 '23 17:07 broothie

@broothie Nice work! Maybe it is worth adding the reference to this workflow in the README.

akhundMurad avatar Jul 15 '23 07:07 akhundMurad