OWL-RL
OWL-RL copied to clipboard
Make the official OWL RL tests part of the project
The readme file states this version passes the full batch of official OWL Full/RL tests. It would be good to make the tests part of the project to make collaboration easier and more constructive.
Artur, I believe that's this: ~~https://www.w3.org/2007/OWL/wiki/Full (namely, https://www.w3.org/2007/OWL/wiki/Test_Suite_Status). However the overall state is quite sad (404 pages, not maintained etc.)~~
UPDATE found it:
https://arxiv.org/abs/1108.0155
The link to the original cade2011-schneidsut-owlfullatp.zip with the tests, mentioned in the article, is now dead, but luckily I downloaded it several years ago to my archives: https://yadi.sk/d/rwQwxMuYrJMMaQ
It seems like cade2011-schneidsut-owlfullatp/testdata/coverage/testsuite-owl2-rdfbased.zip contained in the above file is our starting point?
I do not see any license associated with the file, so I wonder if we can include it as part of the project?
Also http://owl.semanticweb.org/exports/approved/index.html
I agree (as I said in your PR now approved) that we really do need the official test to actually know how the tool is performing in a comprehensive manner. I hope we can all start to outline the full set of tests first and then start chipping away at implementing them all soon. I may have more time to contribute over summer (Dec - Feb, here in Australia!),
A series of the OWL Reasoner Evaluation workshops should be probably also mentioned here, namely:
- OWL Reasoner Evaluation 2014 (all results)
- OWL Reasoner Evaluation 2015 (report and code)
- OWL Reasoner Evaluation 2016 (report)
- 2017 ... 2019 (?)