Praveen
Praveen
Here is the summary of this issue - Hadoop 2.7/2.6 by default uses AWS SDK 1.7.4. This version of AWS SDK has a thread leak issue(s3-transfer-manager-worker-1 is the thread name)....
I tried more to get this working. - I had added `aws-java-sdk-s3` version 1.1.86 (latest version) as maven dependency and been testing that. I just found that the dependency` hadoop-aws`...
@thomaska yes, the tests need to be fixed. I will get it fixed this week. Other than that, StreamX works fine. Can you skipTests now and follow the README to...
Hi @lewisdawson thanks for your work on this. Will love to discuss how we can test this and get it merged. Are you open for a chat ? (My email...
Hi @alunarbeach This is in our roadmap and will be worked on soon. Meanwhile, its not hard to get it working. You will need these steps. Try it out if...
@alunarbeach I have added GCS support, tested and pushed the changes. Look at this commit https://github.com/qubole/streamx/commit/de065fee48ff1a9cabd8e268318c8f4d99d47718. Please try it out and let us know if you see any issues. Provide...
Hi @ariepratama this is straight forward. Since we use JDBC, we will need to add postgres jars and that will work. I see that you have created a PR, will...
Hi @airbots Do you have your own deployment of Swift ? if hadoop file system for swift is stable, it will be easy to make it work with StreamX -...