fix lots of bad cases from radius fix

[rcoreilly]

Describe the bug

dialog buttons, file picker rows are a couple of obvious ones. generally dialogs not doing well.

will add limits on going up stack, along with other constraints on size probably.

How to reproduce

demo ,etc

Example code

No response

Relevant output

No response

Platform

macOS

[kkoreilly]

(This resulted from #660).

[rcoreilly]

Fixed with 7dea1c36c and e82cf36ca