Krishna Chaitanya Reddy Burri

Closing the PR as per the comments: https://github.com/elastic/beats/pull/37657#pullrequestreview-2001340301. This PR aims at creating multiple pubsub clients and not the beat pipeline clients. Although there is performance benefits observed, it is...

@andrewkroh, are we going to enable AWS S3 in agentless (whenever `lexicographical_ordering: true`) since we can now have simpler state management?