datayoga icon indicating copy to clipboard operation
datayoga copied to clipboard

Published 20 hours ago • verified publisher icon datayoga-io
→

Metadata

streaming data pipeline platform

Results 75 datayoga issues
Sort by recently updated
recently updated
newest added

Clone the data before passing it to be processed in the blocks

spicy-sauce avatar spicy-sauce

ability to call another pipeline

using with "@namespace/pipeline" or "@pipeline

zalmane avatar zalmane

add 'min-max' ML transformation

how can we produce submodules / namespaces?

zalmane avatar zalmane

`relational.write` - When a batch fails, insert the records one by one

So only the problematic record will be rejected and not the entire batch it's part of as result.

spicy-sauce avatar spicy-sauce

bug
block

`redis.read_stream` producer sends messages one by one, should be in batches based on batch_size arg

Should be changed to: ```python async def produce(self) -> AsyncGenerator[List[Message], None]: logger.debug(f"Running {self.get_block_name()}") read_pending = True while True: # Read pending messages (fetched by us before but not acknowledged) in...

spicy-sauce avatar spicy-sauce

bug
block

← Metadata

28
Stars
3
Forks
Watchers

Owner

verified publisher icon datayoga-io

Metadata

streaming data pipeline platform

Back