Add CI for 32-bit and big endian

[oyvindln]

As there is a little bit of endinaness and word-size dependent code, there should be CI tests for this to avoid any breakage.