deeptype
deeptype copied to clipboard
Unable to replicate oracle accuracies for evolved type systems
Hi, I'm not able to replicate the results of Table 1(a). The oracle accuracy of the type system evolved via CEM that I obtain is ~92.5% whereas the human designed type system obtains an oracle accuracy of ~98%.
Could you please share the JSONs for the evolved type systems if possible? Congrats, btw on the amazing work and the really well written code-base.
-Shikhar