Handling of removed files is incorrect

[compnerd]

The current implementation just iterates over the changed files, which results in problems when files are removed.

Example run: https://github.com/compnerd/swift-win32/pull/548/checks?check_run_id=2616414119