Add upgrade tests to ensure resources are not getting replaced

[flostadler]

We should add upgrade tests to ensure we're not shipping changes that cause replacements in user infrastructure. This will help us guard against unintentionally shipping breaking changes.