error creating fabric published endpoint list

[zouyonghao]

I got a CRITICAL log several times with same configuration while most of runs are correct.

Jun 07 2021 16:48:02 GMT: WARNING (fabric): (fabric.c:747) no IPv4 addresses configured for fabric
Jun 07 2021 16:48:02 GMT: CRITICAL (fabric): (fabric.c:373) error creating fabric published endpoint list
Jun 07 2021 16:48:02 GMT: WARNING (as): (signal.c:218) SIGUSR1 received, aborting Aerospike Community Edition build 5.6.0.4 os ubuntu18.04
Jun 07 2021 16:48:02 GMT: WARNING (as): (log.c:630) stacktrace: registers: rax 0000000000000000 rbx 000000000000000a rcx 00007f81356a4817 rdx 0000000000000000 rsi 00007ffd1fe467a0 rdi 0000000000000002 rbp 0000000000000003 rsp 00007ffd1fe467a0 r8 0000000000000000 r9 00007ffd1fe467a0 r10 0000000000000008 r11 0000000000000246 r12 0000000000000004 r13 0000000000000004 r14 0000000000000a00 r15 000055af36b8c9e8 rip 00007f81356a4817
Jun 07 2021 16:48:02 GMT: WARNING (as): (log.c:643) stacktrace: found 10 frames: 0x18cd64 0xd1f1b 0x7f81356a4980 0x7f81356a4817 0x18c76f 0x11d517 0x55275 0x53cf3 0x7f813435abf7 0x5445a offset 0x55af365ec000
Jun 07 2021 16:48:02 GMT: WARNING (as): (log.c:653) stacktrace: frame 0: /home/zyh/aerospike-server/target/Linux-x86_64/bin/asd(cf_log_stack_trace+0x115) [0x55af36778d64]
Jun 07 2021 16:48:02 GMT: WARNING (as): (log.c:653) stacktrace: frame 1: /home/zyh/aerospike-server/target/Linux-x86_64/bin/asd(as_sig_handle_usr1+0x72) [0x55af366bdf1b]
Jun 07 2021 16:48:02 GMT: WARNING (as): (log.c:653) stacktrace: frame 2: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980) [0x7f81356a4980]
Jun 07 2021 16:48:02 GMT: WARNING (as): (log.c:653) stacktrace: frame 3: /lib/x86_64-linux-gnu/libpthread.so.0(raise+0xc7) [0x7f81356a4817]
Jun 07 2021 16:48:02 GMT: WARNING (as): (log.c:653) stacktrace: frame 4: /home/zyh/aerospike-server/target/Linux-x86_64/bin/asd(cf_log_write_no_return+0x93) [0x55af3677876f]
Jun 07 2021 16:48:02 GMT: WARNING (as): (log.c:653) stacktrace: frame 5: /home/zyh/aerospike-server/target/Linux-x86_64/bin/asd(as_fabric_init+0x223) [0x55af36709517]
Jun 07 2021 16:48:02 GMT: WARNING (as): (log.c:653) stacktrace: frame 6: /home/zyh/aerospike-server/target/Linux-x86_64/bin/asd(as_run+0x444) [0x55af36641275]
Jun 07 2021 16:48:02 GMT: WARNING (as): (log.c:653) stacktrace: frame 7: /home/zyh/aerospike-server/target/Linux-x86_64/bin/asd(main+0x9) [0x55af3663fcf3]
Jun 07 2021 16:48:02 GMT: WARNING (as): (log.c:653) stacktrace: frame 8: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7f813435abf7]
Jun 07 2021 16:48:02 GMT: WARNING (as): (log.c:653) stacktrace: frame 9: /home/zyh/aerospike-server/target/Linux-x86_64/bin/asd(_start+0x2a) [0x55af3664045a]

Configuration is

# Aerospike database configuration file for deployments using mesh heartbeats.

service {
	user zyh
	group zyh
	paxos-single-replica-limit 0 # Number of nodes where the replica count is automatically reduced to 1.
	pidfile /home/zyh/distributed-system-test/aerospike_test/bin/run/asd3.pid
	proto-fd-max 15000
	work-directory run/work3
	run-as-daemon false
}

mod-lua {
	user-path run/work3/usr/udf/lua
}

logging {
	# Log file must be an absolute path.
	file /home/zyh/distributed-system-test/aerospike_test/bin/run/aerospike3.log {
		context any info
	}
}

network {
	service {
		address 127.0.0.1
		port 2002
	}

	heartbeat {
		mode mesh
		port 5004 # Heartbeat port for this node.

		# List one or more other nodes, one ip-address & port per line:
		# mesh-seed-address-port 127.0.0.1 3000
		mesh-seed-address-port 127.0.0.1 5005
		mesh-seed-address-port 127.0.0.1 5006

		interval 250
		timeout 10
	}

	fabric {
		port 4002
	}

	info {
		port 3002
	}
}

namespace test {
	replication-factor 2
	memory-size 4G

	storage-engine memory
}

Environment:

Ubuntu 18.04.5 Version: Aerospike Community Edition build 5.6.0.4

[xorphox]

Since there is no address specified in the fabric stanza, it defaults to "any". The behavior for "any" is it will look at all available network interfaces. This will ignore localhost. This message is saying fabric does not have any network interfaces configured.

This means aerospike was not able to find any network interface on your system, for whatever reason. Find out those reasons and resolve them.

[zouyonghao]

It seems this is a bug in vmware.

Is there a way to set a default IP for all components?

[zouyonghao]

Since there is no address specified in the fabric stanza, it defaults to "any". The behavior for "any" is it will look at all available network interfaces. This will ignore localhost. This message is saying fabric does not have any network interfaces configured.

This means aerospike was not able to find any network interface on your system, for whatever reason. Find out those reasons and resolve them.

But this only happens to fabric component, and the document says the default is address value in 'service', is this a mistake?

[xorphox]

I can't find anywhere in the code where it uses address value in 'service', but I might have missed it since I'm not that familiar with it. Possibly a mistake. Will have to ask around.

On Wed, Oct 27, 2021 at 6:34 AM Yong-Hao Zou @.***> wrote:

Since there is no address specified in the fabric stanza, it defaults to "any". The behavior for "any" is it will look at all available network interfaces. This will ignore localhost. This message is saying fabric does not have any network interfaces configured.

This means aerospike was not able to find any network interface on your system, for whatever reason. Find out those reasons and resolve them.

But this only happens to fabric component, and the document says the default is address value in 'service' https://docs.aerospike.com/docs/reference/configuration/index.html#address, is this a mistake?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/aerospike/aerospike-server/issues/27#issuecomment-952935572, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAAVAQPE7DEKPBESPOOQRPTUI75UXANCNFSM46I5NQSQ .