WARN REPL - Expected string type for field notEligibleForMBSBackups. Found STRING

[samuelralak]

I am trying to migrate data from an a remote m-lab mongo database. The connection authenticates fine but I am still unable to get any tables or data pulled; instead I keep on getting the following warning WARN REPL - Expected string type for field notEligibleForMBSBackups. Found STRING. Any leads on what might be causing this?

[teoincontatto]

Hi @samuelralak,

It seems you hit a bug. For some reason a deserialization of a BSON from mongo failed with this weird message. Since it is hard to reproduce for us and spot the exact point where this is happening would you mind paste here the logs around the error message using this configuration file for logging:

https://github.com/torodb/stampede/raw/master/main/src/main/profiles/dev/log4j2.xml

This can be achieved by adding to ToroDB Stampede's configuration the log4j2File parameter in the logging section as follow:

...
logging:
  log4j2File: '<path to downloaded log4j2.xml>'
...

[samuelralak]

Hi @teoincontatto

I have attached a screenshot of the error message I keep on getting.

12:24:43.051 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:44.558 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:44.559 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:44.559 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:45.801 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:45.801 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:45.801 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:47.034 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:47.034 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:47.034 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:48.273 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:48.273 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:48.273 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:49.512 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:49.512 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:49.512 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:51.244 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:51.244 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:51.244 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:52.784 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:52.784 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:52.785 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:54.071 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:54.071 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:54.071 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:55.338 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:55.338 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:55.338 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:56.569 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:56.569 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:56.569 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:57.797 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:57.797 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING
12:24:57.798 DEBUG REPL       'Heartbeat-handler-STARTING'   m.r.t.TopologyHeartbeatHandler - Retrying to start heartbeats in 1 second
12:24:59.452 DEBUG REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Heartbeat start failed: {errCode :TYPE_MISMATCH, errorMsg:Expected string type for field notEligibleForMBSBackups. Found STRING}
12:24:59.452 WARN  REPL       'topology-executor-0'          m.r.t.TopologyHeartbeatHandler - Expected string type for field notEligibleForMBSBackups. Found STRING

[samuelralak]

Hey @teoincontatto, quick update:

we contacted mlab support and found out that one of our replicaSet member has a config tag of:

"tags": {
	"notEligibleForMBSBackups": "yes"
}

How does the above affect stampede and how do I get around it? Are there any special replicaSet tags required by stampede?

[teoincontatto]

Hi @samuelralak,

We have added a ticket to investigate if it is a bug and if so resolve it.

You could try to remove the tag to see if ToroDB Stampede is able to replicate?

[samuelralak]

Hey @teoincontatto I don't think that removing the tag config is an option for us at the moment. Its purpose is to prevent m-lab's own backup system from using our own hidden analytics node for backup; however, I'll discuss it with my team and see the best way forward.

[justinr1234]

@teoincontatto Having this same issue