numaflow-python
numaflow-python copied to clipboard
chore: streaming source
PR to make source streaming in nature. We have removed the sync source from the implementation Refer: https://grpc.io/docs/guides/performance/#python
Streaming RPCs create extra threads for receiving and possibly sending the messages, which makes streaming RPCs much slower than unary RPCs in gRPC Python, unlike the other languages supported by gRPC.
Using asyncio could improve performance.