Can not build docker image

[yamrzou]

Hi,

I'm trying to build the docker image locally, slightly modified to test the following hdfs-site.xml configuration (for https://github.com/intake/filesystem_spec/pull/236) :

<property>
    <name>dfs.http.policy</name>
    <value>HTTPS_ONLY</value>
</property>

However the build fails at the "namenode format" step, with the following error :

STEP 10: RUN /root/setup-hadoop.sh
++ ln -s /etc/hadoop/conf.empty/log4j.properties /etc/hadoop/conf.simple/log4j.properties
++ ln -s /etc/hadoop/conf.empty/log4j.properties /etc/hadoop/conf.kerberos/log4j.properties
++ alternatives --install /etc/hadoop/conf hadoop-conf /etc/hadoop/conf.simple 50
++ alternatives --set hadoop-conf /etc/hadoop/conf.simple
++ mkdir -p /var/tmp/hadoop-yarn/local /var/tmp/hadoop-yarn/logs
++ chown -R yarn:yarn /var/tmp/hadoop-yarn/local /var/tmp/hadoop-yarn/logs
++ dd if=/dev/urandom bs=64 count=1
1+0 records in
1+0 records out
64 bytes (64 B) copied, 0.000339063 s, 189 kB/s
++ chown hdfs:hadoop /etc/hadoop/conf/http-secret-file
++ chmod 440 /etc/hadoop/conf/http-secret-file
++ sudo -E -u hdfs bash -c 'hdfs namenode -format -force'
sudo: pam_open_session: Permission denied
sudo: policy plugin failed session initialization
Error: error building at STEP "RUN /root/setup-hadoop.sh": error while running runtime: exit status 1

I started a container from the preceding layer, and executed the following :

[root@a1aca04b2ee6 /]# sudo -E -u alice bash
[alice@a1aca04b2ee6 /]$ exit
exit
[root@a1aca04b2ee6 /]# sudo -E -u hdfs bash
sudo: pam_open_session: Permission denied
sudo: policy plugin failed session initialization
[root@a1aca04b2ee6 /]#

It seems the error occurs with hdfs, yarn and mapred, and not with (zookeeper, testuser, alice, bob).

Any Idea what's going on? How were the current images built successfully?