abhishekd0907
abhishekd0907
This should work with Spark 3 because DataSourceV1 works with Spark 3. I haven't tried it myself though.
@DipeshV Thanks for the update. It will help in saving time for other folks
Can you attach full driver logs?
Streaminglens was build and tested with Spark 2.4 Application is using Spark 2.2 There has been change in some internal APIs between Spark 2.2 and Spark 2.4 which Streaminglens uses,...
In the new logs2.txt without checkpoint location, new batches are not even being created. I can see only ``` 21/10/03 12:44:24 INFO HoodieStreamingSink: Micro batch id=0 succeeded ``` but no...
Have you made the changes I suggested you?
@mjose007 Sorry for the delayed response. Are you able to see any streaming lens related logs (even errors or failures) in your spark driver logs? Also, you don't need need...