Guard changes and run Linux tests in CI

[lazka]

It would also be nice to run Linux CI here, so we can be more confident that our changes didn't break things.

It would be nice if our changes would not be active on Linux when built from the same source. At least those changes which break Linux CI for starters.

Using -Werror in CI would also be nice