Envelope stuck waiting for dependencies that do not exists

[siddharthniruban]

I was running Spark Streaming job in 'yarn client mode'. Job was running fine for sometime and after that job got failed because of Envelope pipeline stuck due to steps waiting for dependencies that do not exists.

[jeremybeard]

First thing is to make sure you are using the latest release 0.7.2 which solves some bugs with that error. If you are getting the error on 0.7.2 then likely you have a step that specifies one or more dependencies that are not in the pipeline.