hadoop-docker icon indicating copy to clipboard operation
hadoop-docker copied to clipboard

M1芯片的Mac启动ResourceManager失败

Open PengfeiMiao opened this issue 2 years ago • 9 comments

请问有可能的解决思路吗,日志没有看到报错,尝试手动安装hadoop启动也同样失败,应该不是脚本之类的问题

PengfeiMiao avatar Sep 16 '22 08:09 PengfeiMiao

Screen Shot 2022-09-16 at 16 15 48 这是启动后的集群节点情况

PengfeiMiao avatar Sep 16 '22 08:09 PengfeiMiao

已经修复了,是配置文件yarn-site.xml出了问题,你再试试看

Weihong-Liu avatar Oct 04 '22 15:10 Weihong-Liu

./run-wordcount.sh 3.3.1 运行测试脚本一直报错

m1芯片 按照标准的方式安装的

http://localhost:8088/ web也连接不上 大佬有解决方案吗

2022-10-10 13:49:26,978 INFO client.DefaultNoHARMFailoverProxyProvider: Connecting to ResourceManager at hadoop-slave2/172.18.0.4:8032 2022-10-10 13:49:28,136 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:29,138 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:30,143 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:31,146 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:32,153 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:33,158 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:34,160 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:35,166 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:36,169 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:37,173 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:38,190 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:39,194 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:40,199 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:41,201 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:42,205 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:43,207 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:44,208 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:45,210 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:46,215 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:47,216 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:47,219 INFO retry.RetryInvocationHandler: java.net.ConnectException: Call From hadoop-master/172.18.0.2 to hadoop-slave2:8032 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ApplicationClientProtocolPBClientImpl.getNewApplication over null after 1 failover attempts. Trying to failover after sleeping for 24469ms. ^C input file1.txt: Hello Hadoop

input file2.txt: Hello Docker

wordcount output:

psyljz avatar Oct 10 '22 14:10 psyljz

已经修复了,是配置文件yarn-site.xml出了问题,你再试试看

感谢~调试通过了。问题原因确实是出在内存不够,将reourcemanager、namenode、secondarynamenode放在不同节点要好一些。另外还有一个原因是我本地docker的安装环境是用colima代替docker for desktop,colima划分内存默认是2G,不足以支持hadoop集群,使用 colima --memory 4g start 命令重新启动后就没问题了

PengfeiMiao avatar Oct 15 '22 07:10 PengfeiMiao

./run-wordcount.sh 3.3.1 运行测试脚本一直报错

m1芯片 按照标准的方式安装的

http://localhost:8088/ web也连接不上 大佬有解决方案吗

2022-10-10 13:49:26,978 INFO client.DefaultNoHARMFailoverProxyProvider: Connecting to ResourceManager at hadoop-slave2/172.18.0.4:8032 2022-10-10 13:49:28,136 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:29,138 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:30,143 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:31,146 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:32,153 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:33,158 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:34,160 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:35,166 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:36,169 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:37,173 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:38,190 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:39,194 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:40,199 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:41,201 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:42,205 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:43,207 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:44,208 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:45,210 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:46,215 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:47,216 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:47,219 INFO retry.RetryInvocationHandler: java.net.ConnectException: Call From hadoop-master/172.18.0.2 to hadoop-slave2:8032 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ApplicationClientProtocolPBClientImpl.getNewApplication over null after 1 failover attempts. Trying to failover after sleeping for 24469ms. ^C input file1.txt: Hello Hadoop

input file2.txt: Hello Docker

wordcount output:

你好,如果集群运行正常的话不妨看一下是不是因为 mac 本身限制与docker桥接模式访问的原因,这个问题的解决方法我在我填坑博客的 #bug3 也有记录,有兴趣可以看下

PengfeiMiao avatar Oct 15 '22 08:10 PengfeiMiao

./run-wordcount.sh 3.3.1 运行测试脚本一直报错 m1芯片 按照标准的方式安装的 http://localhost:8088/ web也连接不上 大佬有解决方案吗 2022-10-10 13:49:26,978 INFO client.DefaultNoHARMFailoverProxyProvider: Connecting to ResourceManager at hadoop-slave2/172.18.0.4:8032 2022-10-10 13:49:28,136 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:29,138 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:30,143 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:31,146 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:32,153 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:33,158 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:34,160 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:35,166 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:36,169 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:37,173 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:38,190 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:39,194 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:40,199 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:41,201 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:42,205 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:43,207 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:44,208 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:45,210 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:46,215 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:47,216 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 2022-10-10 13:49:47,219 INFO retry.RetryInvocationHandler: java.net.ConnectException: Call From hadoop-master/172.18.0.2 to hadoop-slave2:8032 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ApplicationClientProtocolPBClientImpl.getNewApplication over null after 1 failover attempts. Trying to failover after sleeping for 24469ms. ^C input file1.txt: Hello Hadoop input file2.txt: Hello Docker wordcount output:

你好,如果集群运行正常的话不妨看一下是不是因为 mac 本身限制与docker桥接模式访问的原因,这个问题的解决方法我在我填坑博客的 #bug3 也有记录,有兴趣可以看下

您好,我的报错也是类似,已经根据您说的正确配置了,也能ping通172.18.0.4,但是还是不行,我看了下jps服务,请问您是如何解决的?我看了下我用的也是最新的xml

ifconfig

eth0 Link encap:Ethernet HWaddr 02:42:ac:12:00:04
inet addr:172.18.0.4 Bcast:172.18.255.255 Mask:255.255.0.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:52 errors:0 dropped:0 overruns:0 frame:0 TX packets:39 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:7733 (7.7 KB) TX bytes:6899 (6.8 KB)

lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0 UP LOOPBACK RUNNING MTU:65536 Metric:1 RX packets:20 errors:0 dropped:0 overruns:0 frame:0 TX packets:20 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:1650 (1.6 KB) TX bytes:1650 (1.6 KB)

jps

96 DataNode 321 Jps 223 NodeManager

2023-03-21 04:24:43,689 INFO client.DefaultNoHARMFailoverProxyProvider: Connecting to ResourceManager at hadoop-slave2/172.18.0.4:8032 2023-03-21 04:24:44,839 INFO ipc.Client: Retrying connect to server: hadoop-slave2/172.18.0.4:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)

PeterZaipinai avatar Mar 21 '23 04:03 PeterZaipinai

到slave2再运行一次start把没开的服务打开就好了,但是不知道为什么启动的时候没有一起开呢?

root@hadoop-slave2:~# ./start-hadoop.sh Starting namenodes on [hadoop-master] hadoop-master: namenode is running as process 255. Stop it first and ensure /tmp/hadoop-root-namenode.pid file is empty before retry. Starting datanodes hadoop-master: datanode is running as process 423. Stop it first and ensure /tmp/hadoop-root-datanode.pid file is empty before retry. hadoop-slave1: datanode is running as process 96. Stop it first and ensure /tmp/hadoop-root-datanode.pid file is empty before retry. hadoop-slave2: datanode is running as process 95. Stop it first and ensure /tmp/hadoop-root-datanode.pid file is empty before retry. Starting secondary namenodes [hadoop-slave2] Starting resourcemanager Starting nodemanagers hadoop-master: nodemanager is running as process 1019. Stop it first and ensure /tmp/hadoop-root-nodemanager.pid file is empty before retry. hadoop-slave1: nodemanager is running as process 215. Stop it first and ensure /tmp/hadoop-root-nodemanager.pid file is empty before retry. hadoop-slave2: nodemanager is running as process 214. Stop it first and ensure /tmp/hadoop-root-nodemanager.pid file is empty before retry.

PeterZaipinai avatar Mar 21 '23 06:03 PeterZaipinai

可以看一下机器的内存情况,可能内存不够,导致节点进程关闭,建议使用 16G 内存的设备

------------------ 原始邮件 ------------------ 发件人: PeterZaipinai @.> 发送时间: 2023年3月21日 14:58 收件人: Weihong-Liu/hadoop-docker @.> 抄送: Puppet @.>, Comment @.> 主题: Re: [Weihong-Liu/hadoop-docker] M1芯片的Mac启动ResourceManager失败 (Issue #3)

到slave2再运行一次start把没开的服务打开就好了,但是不知道为什么启动的时候没有一起开呢?

@.***:~# ./start-hadoop.sh Starting namenodes on [hadoop-master] hadoop-master: namenode is running as process 255. Stop it first and ensure /tmp/hadoop-root-namenode.pid file is empty before retry. Starting datanodes hadoop-master: datanode is running as process 423. Stop it first and ensure /tmp/hadoop-root-datanode.pid file is empty before retry. hadoop-slave1: datanode is running as process 96. Stop it first and ensure /tmp/hadoop-root-datanode.pid file is empty before retry. hadoop-slave2: datanode is running as process 95. Stop it first and ensure /tmp/hadoop-root-datanode.pid file is empty before retry. Starting secondary namenodes [hadoop-slave2] Starting resourcemanager Starting nodemanagers hadoop-master: nodemanager is running as process 1019. Stop it first and ensure /tmp/hadoop-root-nodemanager.pid file is empty before retry. hadoop-slave1: nodemanager is running as process 215. Stop it first and ensure /tmp/hadoop-root-nodemanager.pid file is empty before retry. hadoop-slave2: nodemanager is running as process 214. Stop it first and ensure /tmp/hadoop-root-nodemanager.pid file is empty before retry.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>

Weihong-Liu avatar Mar 22 '23 13:03 Weihong-Liu

可以看一下机器的内存情况,可能内存不够,导致节点进程关闭,建议使用 16G 内存的设备

M1pro 16GB,也没有开其他高负荷的程序,我再看看是不是有其他问题,感谢

PeterZaipinai avatar Mar 23 '23 01:03 PeterZaipinai