[draft][Spark streaming] fix spark streaming
Purpose of this pull request
Check list
- [ ] Code changed are covered with tests, or it does not need tests for reason:
- [ ] If any new Jar binary package adding in your PR, please add License Notice according New License Guide
- [ ] If necessary, please update the documentation to describe the new feature. https://github.com/apache/incubator-seatunnel/tree/dev/docs
- [ ] If you are contributing the connector code, please check that the following files are updated:
- Update change log that in connector document. For more details you can refer to connector-v2
- Update plugin-mapping.properties and add new connector information in it
- Update the pom file of seatunnel-dist
- [ ] Update the
release-note.
great job
these days,I'm busy with a poc.
I have not fully tested the state recovery on Yarn, as there is no Yarn environment at home.
please resolve the conflict
please check code style
I can't submit it success it on yarn.I don't know why
The state has not been recovered, no commit log has been generated, the offset log is not well connected, and the source state is fully generated. There are some differences from the mechanism of Spark Structured Streaming. There may be some adaptations needed for the state in some places.
hello any progress?