[Optimization engine] Improves ingestion resiliency in face of 0 bytes chunks

[helderpinto]

🛠️ Description

Improves ingestion resiliency in face of 0 bytes chunks

Fixes #998

📋 Checklist

🔬 How did you test this change?

• [ ] 🤏 Lint tests
• [ ] 🤞 PS -WhatIf / az validate
• [X] 👍 Manually deployed + verified
• [ ] 💪 Unit tests
• [ ] 🙌 Integration tests

🙋‍♀️ Do any of the following that apply?

• [ ] 🚨 This is a breaking change.
• [X] 🤏 The change is less than 20 lines of code.

📑 Did you update docs/changelog.md?

• [X] ✅ Updated changelog (required for dev PRs)
• [ ] ➡️ Will add log in a future PR (feature branch PRs only)
• [ ] ❎ Log not needed (small/internal change)

📖 Did you update documentation?

• [ ] ✅ Public docs in docs (required for dev)
• [ ] ✅ Internal dev docs in src (required for dev)
• [ ] ➡️ Will add docs in a future PR (feature branch PRs only)
• [X] ❎ Docs not needed (small/internal change)