parseable icon indicating copy to clipboard operation
parseable copied to clipboard
Published 2 weeks ago • verified publisher icon parseablehq

Kafka improvements

Open de-sh opened this issue 10 months ago • 1 comments

  1. Integration Tests:
    • [ ] Add tests using test containers to simulate Kafka.
  2. Documentation:
    • [ ] Getting started with kafka ingestor on parseable
    • [ ] System design and decisions made
    • [ ] Configuration guide
  3. Script Migration: Move the Kafka log stream generator script to the Quest repository for better maintainability and integration with existing test suites.
  4. Test Cases: Add test cases to Quest to validate Kafka message ingestion and ensure the consistency of message counts etc.

Includes recommendations made by @hippalus in #1047

de-sh avatar Feb 03 '25 08:02 de-sh