initialization-actions icon indicating copy to clipboard operation
initialization-actions copied to clipboard

[bigtable] bigtable.sh references deprecated Hortonworks Nexus resources

Open cjac opened this issue 1 year ago • 2 comments

To resolve this dependency on deprecated infrastructure, we need to make copies of all jars we depend on and store them in GCS, then we need to update bigtable.sh to fetch from the GCS location instead of hortonworks nexus server.

cjac avatar Jul 19 '24 17:07 cjac

Will be using the gs://dataproc-initialization-actions bucket to store the jars. It has the basic repo structure of our init repo. Inside of bigtable folder, I will make the same structure for storing the jars so as to ensure that minimal code changes are required in the bigtable init script.

prince-cs avatar Jul 24 '24 11:07 prince-cs

Might as well copy the tar.gz packages from archive.apache.org as well. They're flakey to download.

cjac avatar Aug 06 '24 01:08 cjac