Krish Narukulla

Dockerize kafka connector

1

Hi Team, we are looking for dockerfile for kafka connector. Has anyone deployed into docker?

rule '@maven//:xml_apis_xml_apis' does not exist

2

Workspace: RULES_JVM_EXTERNAL_TAG = "3.3" RULES_JVM_EXTERNAL_SHA = "d85951a92c0908c80bd8551002d66cb23c3434409c814179c0ff026b53544dab" http_archive( name = "rules_jvm_external", strip_prefix = "rules_jvm_external-%s" % RULES_JVM_EXTERNAL_TAG, sha256 = RULES_JVM_EXTERNAL_SHA, url = "https://github.com/bazelbuild/rules_jvm_external/archive/%s.zip" % RULES_JVM_EXTERNAL_TAG, ) ERROR: /private/var/tmp/_bazel_knarukulla/8ee12e7af1de74d96e04eaf42164d19d/external/maven/BUILD:14217:11: in deps attribute...

Extra maven artifacts support for java_export rule

7

Issue: Java_export needs to upload multiple artifacts as part of single rule. Artifacts could be war/tar files and it needs to support classifier. Example: BUILD: java_export( name = "example-export", extra_artifacts...

Using spark 3.5.1 on GKE, using connector https://mvnrepository.com/artifact/com.google.cloud.bigdataoss/gcs-connector/hadoop3-2.2.14, ran into below errors. ` 24/07/29 23:25:14 INFO c.go.cloud.hadoop.repackaged.gcs.com.google.cloud.hadoop.util.RetryHttpInitializer: Encountered status code 429 when sending DELETE request to URL 'https://storage.googleapis.com/storage/v1/b/xxx/o/granular%2Frams_video_ad_requests%2F.spark-staging-431ff8ba-d71b-431d-81f4-a4e13178636e%2F_temporary%2F0%2F_temporary%2Fattempt_202407292251203861221280246034281_0004_m_000538_3024%2Fdate_key=2024-06-23%2Fhour=19%2F00242_0_part-00538-431ff8ba-d71b-431d-81f4-a4e13178636e_00242.c000.snappy.parquet?ifGenerationMatch=1722294586557203'. Delegating to...