Fix compiler slowdown introduced by #3920

[aykevl]

https://github.com/tinygo-org/tinygo/pull/3920 resulted in a big slowdown in compile speed because 1) it does more work than needed (some Go SSA is built that doesn't need to be built), and 2) none of it is parallelized. This really should be fixed.