Add some automated tests

[Sytten]

Hi all! The current main branch is broken for a lot of folks. I don't want to put blame on anyone but its not great. I will push a fix to restore it to a good state but ideally we would need automated testing on windows/mac/linux with async-std/tokio variants. That would ensure we dont merge broken code.