Adjust CI to handle build executables for supported platforms

[elken]

Marked as draft as this has conflicts with a recent change, and I am offering these changes as a proposal. Aware I also have to re-enable tests as well. Figured I'd get your input early 😄

If you want me to drop certain bits I can, and I think there's probably a cleaner way we can handle the various on/off states we have across runs.

Once this is merged, I have changes needed ready to go for homebrew-jank to pick this up.