deeptype icon indicating copy to clipboard operation
deeptype copied to clipboard

Unable to replicate oracle accuracies for evolved type systems

Open MurtyShikhar opened this issue 6 years ago • 0 comments

Hi, I'm not able to replicate the results of Table 1(a). The oracle accuracy of the type system evolved via CEM that I obtain is ~92.5% whereas the human designed type system obtains an oracle accuracy of ~98%.

Could you please share the JSONs for the evolved type systems if possible? Congrats, btw on the amazing work and the really well written code-base.

-Shikhar

MurtyShikhar avatar Mar 30 '18 03:03 MurtyShikhar