docker-images icon indicating copy to clipboard operation
docker-images copied to clipboard

Add hive4.0-hive, hdp3.1-hive and hdp3.1-hive-kerberized

Open unidevel opened this issue 11 months ago • 2 comments

This PR added the following images:

cherry-picked a commit from trino to get hdp3.1-hive files

https://github.com/trinodb/docker-images/tree/master/archived/hdp3.1-hive

Mac with M chips

Please setup the environment before building the images

# bash/zsh
export DOCKER_DEFAULT_PLATFORM=linux/amd64

# fish
set -gx DOCKER_DEFAULT_PLATFORM linux/amd64

brew install docker-credential-helper
docker login

hive4.0-hive

With HADOOP_VERSION=3.4.1 & HIVE_VERSION=4.0.1

To build the image

make prestodb/centos7-oj8@build
make prestodb/hive4.0-hive

hdp3.1-hive

To build the image

make prestodb/centos7-oj8@build
make prestodb/hdp3.1-hive

hdp3.1-hive-kerberized

make prestodb/centos7-oj8@build
make prestodb/hdp3.1-hive-kerberized

unidevel avatar Mar 27 '25 17:03 unidevel

CLA Signed

The committers listed above are authorized under a signed CLA.

  • :white_check_mark: login: unidevel / name: Li Zhou (7e4f3aa4336ba1525aae774eadc88263124db7c4)

@wanglinsong Most of the files are copied from old version, I'll make it work first, then refactor the files.

unidevel avatar Apr 03 '25 10:04 unidevel

You still need the CLA Authorization.

wanglinsong avatar Apr 04 '25 18:04 wanglinsong

You still need the CLA Authorization.

Fixed by adding the co-author

unidevel avatar Apr 23 '25 20:04 unidevel

@imjalpreet I'll investigate.

unidevel avatar Apr 30 '25 12:04 unidevel

@imjalpreet Added prestodb/centos7-oj8-openldap

unidevel avatar May 01 '25 10:05 unidevel

Error message:

presto-master-1  | 1 error
presto-master-1  | 
presto-master-1  | ======================
presto-master-1  | Full classname legend:
presto-master-1  | ======================
presto-master-1  | AuthenticationNotSupportedException: "javax.naming.AuthenticationNotSupportedException"
presto-master-1  | LdapAuthenticator:                   "com.facebook.presto.password.ldap.LdapAuthenticator"
presto-master-1  | LdapAuthenticatorFactory:            "com.facebook.presto.password.ldap.LdapAuthenticatorFactory"
presto-master-1  | ========================
presto-master-1  | End of classname legend:
presto-master-1  | ========================
presto-master-1  | 
presto-master-1  | 	at com.google.inject.internal.Errors.throwCreationExceptionIfErrorsExist(Errors.java:576)
presto-master-1  | 	at com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:190)
presto-master-1  | 	at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:113)
presto-master-1  | 	at com.google.inject.Guice.createInjector(Guice.java:87)
presto-master-1  | 	at com.facebook.airlift.bootstrap.Bootstrap.initialize(Bootstrap.java:263)
presto-master-1  | 	at com.facebook.presto.password.ldap.LdapAuthenticatorFactory.create(LdapAuthenticatorFactory.java:49)
presto-master-1  | 	at com.facebook.presto.server.security.PasswordAuthenticatorManager.loadPasswordAuthenticator(PasswordAuthenticatorManager.java:75)
presto-master-1  | 	at com.facebook.presto.server.PrestoServer.run(PrestoServer.java:183)
presto-master-1  | 	at com.facebook.presto.server.PrestoServer.main(PrestoServer.java:96)
presto-master-1  | Caused by: java.lang.RuntimeException: javax.naming.AuthenticationNotSupportedException: [LDAP: error code 48 - anonymous bind disallowed]
presto-master-1  | 	at com.facebook.presto.password.ldap.LdapAuthenticator.checkEnvironment(LdapAuthenticator.java:184)
presto-master-1  | 	at com.facebook.presto.password.ldap.LdapAuthenticator.<init>(LdapAuthenticator.java:79)
presto-master-1  | 	at com.facebook.presto.password.ldap.LdapAuthenticator$$FastClassByGuice$$1807621.GUICE$TRAMPOLINE(<generated>)
presto-master-1  | 	at com.facebook.presto.password.ldap.LdapAuthenticator$$FastClassByGuice$$1807621.apply(<generated>)
presto-master-1  | 	at com.google.inject.internal.DefaultConstructionProxyFactory$FastClassProxy.newInstance(DefaultConstructionProxyFactory.java:82)
presto-master-1  | 	at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:114)
presto-master-1  | 	at com.google.inject.internal.ConstructorInjector.access$000(ConstructorInjector.java:33)
presto-master-1  | 	at com.google.inject.internal.ConstructorInjector$1.call(ConstructorInjector.java:98)
presto-master-1  | 	at com.google.inject.internal.ProvisionListenerStackCallback$Provision.provision(ProvisionListenerStackCallback.java:109)
presto-master-1  | 	at com.facebook.airlift.bootstrap.LifeCycleModule.provision(LifeCycleModule.java:54)
presto-master-1  | 	at com.google.inject.internal.ProvisionListenerStackCallback$Provision.provision(ProvisionListenerStackCallback.java:117)
presto-master-1  | 	at com.google.inject.internal.ProvisionListenerStackCallback.provision(ProvisionListenerStackCallback.java:66)
presto-master-1  | 	at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:93)
presto-master-1  | 	at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:300)
presto-master-1  | 	at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
presto-master-1  | 	at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:169)
presto-master-1  | 	at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:45)
presto-master-1  | 	at com.google.inject.internal.InternalInjectorCreator.loadEagerSingletons(InternalInjectorCreator.java:213)
presto-master-1  | 	at com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:186)
presto-master-1  | 	... 7 more
presto-master-1  | Caused by: javax.naming.AuthenticationNotSupportedException: [LDAP: error code 48 - anonymous bind disallowed]
presto-master-1  | 	at com.sun.jndi.ldap.LdapCtx.mapErrorCode(LdapCtx.java:3252)
presto-master-1  | 	at com.sun.jndi.ldap.LdapCtx.processReturnCode(LdapCtx.java:3207)
presto-master-1  | 	at com.sun.jndi.ldap.LdapCtx.processReturnCode(LdapCtx.java:2993)
presto-master-1  | 	at com.sun.jndi.ldap.LdapCtx.connect(LdapCtx.java:2907)
presto-master-1  | 	at com.sun.jndi.ldap.LdapCtx.<init>(LdapCtx.java:347)
presto-master-1  | 	at com.sun.jndi.ldap.LdapCtxFactory.getLdapCtxFromUrl(LdapCtxFactory.java:229)
presto-master-1  | 	at com.sun.jndi.ldap.LdapCtxFactory.getUsingURL(LdapCtxFactory.java:189)
presto-master-1  | 	at com.sun.jndi.ldap.LdapCtxFactory.getUsingURLs(LdapCtxFactory.java:247)
presto-master-1  | 	at com.sun.jndi.ldap.LdapCtxFactory.getLdapCtxInstance(LdapCtxFactory.java:154)
presto-master-1  | 	at com.sun.jndi.ldap.LdapCtxFactory.getInitialContext(LdapCtxFactory.java:84)
presto-master-1  | 	at javax.naming.spi.NamingManager.getInitialContext(NamingManager.java:695)
presto-master-1  | 	at javax.naming.InitialContext.getDefaultInitCtx(InitialContext.java:313)
presto-master-1  | 	at javax.naming.InitialContext.init(InitialContext.java:244)
presto-master-1  | 	at javax.naming.InitialContext.<init>(InitialContext.java:216)
presto-master-1  | 	at javax.naming.directory.InitialDirContext.<init>(InitialDirContext.java:101)
presto-master-1  | 	at com.facebook.presto.password.jndi.JndiUtils.createDirContext(JndiUtils.java:30)
presto-master-1  | 	at com.facebook.presto.password.ldap.LdapAuthenticator.checkEnvironment(LdapAuthenticator.java:181)
presto-master-1  | 	... 25 more

imjalpreet avatar May 19 '25 19:05 imjalpreet

@imjalpreet the openldap seems removed the anonymous bind after upgrade, I have to remove the bind_anon to make it work, but I think this may need to be addressed in the presto code.

#dn: cn=config
#changetype: modify
#add: olcDisallows
#olcDisallows: bind_anon

unidevel avatar May 20 '25 21:05 unidevel

Also, could we squash the commits into fewer commits, perhaps one per image, or in any way that you think makes the most sense?

imjalpreet avatar Jul 04 '25 14:07 imjalpreet

Also, could we squash the commits into fewer commits, perhaps one per image, or in any way that you think makes the most sense?

Sure, will update later

unidevel avatar Jul 04 '25 17:07 unidevel

squashed into one commit.

unidevel avatar Jul 07 '25 20:07 unidevel

Removed hive4.0-hive

unidevel avatar Jul 08 '25 09:07 unidevel

@tdcmeehan, could you please help merge this, too? thanks!

imjalpreet avatar Jul 15 '25 15:07 imjalpreet