Only capture actual tree growth

[Machine-Maker]

Fixes #6458

I figured that instead of trying to find all the places where this needed to be changed, I'd only attempt to "revert" the change where it mattered, in the tree growers.