Ben Pfaff
Ben Pfaff
We should run the benchmarks on our public cloud deployment regularly and add a report to the benchmarks repo. We could run the benchmarks whenever the cloud deployment is updated,...
In a terminal running the pipeline manager while a storage-intensive pipeline was running, I hit Ctrl+Z and then typed `bg` and it broke the pipeline with messages like this: ```...
The [`samsa` crate](https://docs.rs/samsa/latest/samsa/) is a pure Rust implementation of the Kafka protocol with support for consumers and producers. Questions: - Is it faster than `rdkafka`? - Is `samsa` complete enough...
I ran Nexmark q9 with 10 million events and 16 cores in both SQL and Rust and dumped a profile afterward in each case. Storage was not enabled. I'm attaching...
`ZSetHandle` and `IndexedZSetHandle` use `CollectionHandle::dyn_append()` to add data as input to a circuit. That function in turn breaks a vector of data into one chunk per worker. It adds each...
The storage reader/writer code, when it emits errors, emits the underlying I/O error but it does not annotate it with the path, which can make it hard for higher-level code...
This occurred for a CI run with logs at https://github.com/feldera/feldera/actions/runs/9353411601/job/25743842583. The important output is: ``` +test-adapters | 2024-06-03 16:01:25.904183 INFO proptest_kafka_input: Test: Specify invalid Kafka broker address +test-adapters | 2024-06-03...
When the pipeline manager triggers a suspend, it would prefer to shut down the process itself, rather than to have the process exit on its own.
The SQL compiler accepts an empty program, but it rejects a program that just contains a space, with: ``` Error parsing SQL: Encountered "" at line 1, column 2. Was...
Checkpoints and fault tolerance do not track the "paused" state of input connectors, but they should.