Streaming does not stop

[tanroopdhillon]

This is my configuration: StreamingContext streamingContext = new StreamingContext(sparkcontext, Durations.seconds(60000));

But the streaming doesn't seem to be stopping. I keep getting messages and is never able to move ahead

[jniebuhr]

What you specify there is your window duration. A window duration of 60000 seconds means it will gather messages for 60000 seconds (so, 41 days) and then start processing them. Then it'll gather messages for another 60000 messages. I would recommend using a lower time window that's suitable for your application and processing flow.

[compae]

I'm agree with @jniebuhr , but it's possible that we have one bug in the streamingContext stop function.

Could you add more info or logs??