NServiceBus icon indicating copy to clipboard operation
NServiceBus copied to clipboard

Stream-based data bus implementation

Open DavidBoike opened this issue 1 year ago • 1 comments

Describe the feature.

The data bus is implemented using byte arrays and memory streams, which would not be efficient for large payloads. An alternate API should start to take over that allows streams to be used so that all of the performance advantages of those streams can be used, but with the complexity abstracted away from the end-user developer.

This was previously implemented as a pipeline sample, but that sample was removed due to its inherent complexity, but for the end user to impelment as well as to maintain the sample over time.

The code can still be found in the linked PR for anyone interested enough to give it a shot. If you use it, like it, and want it, please leave a comment here to gather evidence that this feature should be included in NServiceBus.

Additional Context

No response

DavidBoike avatar Jan 19 '24 20:01 DavidBoike

I like the idea. Teams I've been on have always manually stored to Blob, sent a message, and then read the blob on the other end rather than using DataBus because streaming of large payloads was important to them.

bbrandt avatar Mar 06 '24 19:03 bbrandt