datahub icon indicating copy to clipboard operation
datahub copied to clipboard

UI ingestion for kafka-connect lacks of java

Open KulykDmytro opened this issue 2 years ago • 5 comments

Describe the bug There is no correctly set up Java in Action container (UI ingestion) to process kafka-connect source

To Reproduce Steps to reproduce the behavior:

  1. Open UI ingestion
  2. create source config for kafka-connect
  3. execute ingestion
  4. observe error

Expected behavior A clear and concise description of what you expected to happen.

Screenshots

source:
  type: kafka-connect
  config:
    connect_uri: 'http://kafka-connect.confluent.svc.cluster.local:8083'
    cluster_name: dwh-connect
    connector_patterns:
      allow:
        - '^dwh-.*'
sink:
  type: datahub-rest
  config:
    server: 'http://datahub-datahub-gms:8080'
    token: xxxxx

Error

JVMNotFoundException: No JVM shared library file (libjvm.so) found. Try setting up the JAVA_HOME environment variable properly.

Environment:

  • EKS 1.22
  • official chart
  • core version: 0.8.33
  • chart version: 0.2.69

KulykDmytro avatar Apr 25 '22 08:04 KulykDmytro

I just encountered this problem too

esselius avatar Apr 27 '22 15:04 esselius

When I upgraded to v0.8.40, I got this problem again!

yuanly avatar Jul 14 '22 03:07 yuanly

@yuanly Can you please share where you are running DataHub and the image and tag that you are using for actions?

anshbansal avatar Jul 14 '22 04:07 anshbansal

When I using acryldata/datahub-actions v0.0.4, this problem again.

datahub gms, frontend image : 0.8.41

https://hub.docker.com/layers/datahub-actions/acryldata/datahub-actions/v0.0.4/images/sha256-60cbf0081ef0f6db3854a3a8bbbd500480ea69b54863ac6ad819974303191584?context=explore

sabper avatar Aug 08 '22 00:08 sabper

[root@localhost]# docker exec -it datahub_datahub-actions_1 /bin/bash
datahub@actions:/$ echo $JAVA_HOME
/home/datahub/.sdkman/candidates/java/current
[root@localhost]# docker exec -it -u root datahub_datahub-actions_1 /bin/bash
root@actions:/# echo $JAVA_HOME

root@actions:/#

EcoleKeine avatar Sep 21 '22 09:09 EcoleKeine

I believe this was fixed by #6365 or https://github.com/acryldata/datahub-actions/pull/15 - the latest datahub-actions image v0.0.9 should work.

Please let me know if you still have issues @KulykDmytro and we can reopen if necessary.

hsheth2 avatar Dec 06 '22 23:12 hsheth2