[State Sync] Add metrics and logs for pipeline backpressure.

[JoshLind]

Description

This PR adds metrics and logs to better track pipeline channel backpressure in the storage synchronizer. Specifically, when a channel gets full, we log the backpressure and track the backpressure in a gauge. This should help us better identify blockages in the pipeline 😄

Testing Plan

New and existing test infrastructure.