tiflow icon indicating copy to clipboard operation
tiflow copied to clipboard

DM dashborad edit task use [Open task as plaintext config],set syncers safe-mode: true,not work

Open RenlySir opened this issue 1 year ago • 0 comments

What did you do?

my task config: name: test1-20210 task-mode: incremental is-sharding: true shard-mode: pessimistic ignore-checking-items:

  • table_schema meta-schema: dm_meta122 enable-heartbeat: false heartbeat-update-interval: 0 heartbeat-report-interval: 0 timezone: "" case-sensitive: false collation_compatible: loose target-database: host: 172.16.11.43 port: 4001 user: lgr password: lgr max-allowed-packet: null session: {} security: null mysql-instances:
  • source-id: mysql1-1 meta: binlog-name: mysql-bin.000007 binlog-pos: 840 binlog-gtid: '484abf96-3657-11ed-8043-164bf906d505:1-3 ' filter-rules: [] column-mapping-rules: [] route-rules: [] expression-filters: [] black-white-list: "" block-allow-list: balist-01 mydumper-config-name: dump-01 mydumper: mydumper-path: ./bin/mydumper threads: 4 chunk-filesize: "64" statement-size: 0 rows: 0 where: "" skip-tz-utc: true extra-args: "" mydumper-thread: 0 loader-config-name: load-01 loader: pool-size: 16 dir: ./dumped_data import-mode: sql on-duplicate: replace loader-thread: 0 syncer-config-name: sync-01 syncer: meta-file: "" worker-count: 16 batch: 100 queue-size: 1024 checkpoint-flush-interval: 30 compact: false multiple-rows: false max-retry: 0 auto-fix-gtid: false enable-gtid: false disable-detect: false safe-mode: false enable-ansi-quotes: false syncer-thread: 0 validator-config-name: validator-01 online-ddl: true shadow-table-rules: [] trash-table-rules: [] online-ddl-scheme: "" routes: {} filters: {} column-mappings: {} expression-filter: {} black-white-list: {} block-allow-list: balist-01: do-tables:
    • db-name: lan tbl-name: ~^* do-dbs: [] ignore-tables: [] ignore-dbs: [] mydumpers: dump-01: mydumper-path: ./bin/mydumper threads: 4 chunk-filesize: "64" statement-size: 0 rows: 0 where: "" skip-tz-utc: true extra-args: "" loaders: load-01: pool-size: 16 dir: ./dumped_data import-mode: sql on-duplicate: replace syncers: sync-01: meta-file: "" worker-count: 16 batch: 100 queue-size: 1024 checkpoint-flush-interval: 30 compact: false multiple-rows: false max-retry: 0 auto-fix-gtid: false enable-gtid: false disable-detect: false safe-mode: true enable-ansi-quotes: false validators: validator-01: mode: none worker-count: 4 validate-interval: 10s check-interval: 5s row-error-delay: 30m0s meta-flush-interval: 5m0s batch-query-size: 100 max-pending-row-size: 500m max-pending-row-count: 2147483647 clean-dump-file: false ansi-quotes: false remove-meta: false experimental: async-checkpoint-flush: false

when create task,safe-mode still false,not work.

What did you expect to see?

syncers: sync-01: meta-file: "" worker-count: 16 batch: 100 queue-size: 1024 checkpoint-flush-interval: 30 compact: false multiple-rows: false max-retry: 0 auto-fix-gtid: false enable-gtid: false disable-detect: false safe-mode: true

task's conf safe-mode should be true.

What did you see instead?

safe-mode still false.

Versions of the cluster

[lan@ogg dm-master]$ tiup dm display dm-test tiup is checking updates for component dm ... Starting component dm: /home/lan/.tiup/components/dm/v1.10.3/tiup-dm display dm-test Cluster type: dm Cluster name: dm-test Cluster version: v6.2.0 Deploy user: lan SSH type: builtin Grafana URL: http://172.16.11.70:3000 ID Role Host Ports OS/Arch Status Data Dir Deploy Dir


172.16.11.70:9093 alertmanager 172.16.11.70 9093/9094 linux/x86_64 Up /home/lan/dm/data/alertmanager-9093 /home/lan/dm/deploy/alertmanager-9093 172.16.11.70:8261 dm-master 172.16.11.70 8261/8291 linux/x86_64 Healthy|L /home/lan/dm/data/dm-master-8261 /home/lan/dm/deploy/dm-master-8261 172.16.11.70:8262 dm-worker 172.16.11.70 8262 linux/x86_64 Bound /home/lan/dm/data/dm-worker-8262 /home/lan/dm/deploy/dm-worker-8262 172.16.11.70:3000 grafana 172.16.11.70 3000 linux/x86_64 Up - /home/lan/dm/deploy/grafana-3000 172.16.11.70:9090 prometheus 172.16.11.70 9090 linux/x86_64 Up /home/lan/dm/data/prometheus-9090 /home/lan/dm/deploy/prometheus-9090 Total nodes: 5

current status of DM cluster (execute query-status <task-name> in dmctl)

[lan@ogg ~]$ tiup dm display dm-test tiup is checking updates for component dm ... Starting component dm: /home/lan/.tiup/components/dm/v1.10.3/tiup-dm display dm-test Cluster type: dm Cluster name: dm-test Cluster version: v6.2.0 Deploy user: lan SSH type: builtin Grafana URL: http://172.16.11.70:3000 ID Role Host Ports OS/Arch Status Data Dir Deploy Dir


172.16.11.70:9093 alertmanager 172.16.11.70 9093/9094 linux/x86_64 Up /home/lan/dm/data/alertmanager-9093 /home/lan/dm/deploy/alertmanager-9093 172.16.11.70:8261 dm-master 172.16.11.70 8261/8291 linux/x86_64 Healthy|L /home/lan/dm/data/dm-master-8261 /home/lan/dm/deploy/dm-master-8261 172.16.11.70:8262 dm-worker 172.16.11.70 8262 linux/x86_64 Bound /home/lan/dm/data/dm-worker-8262 /home/lan/dm/deploy/dm-worker-8262 172.16.11.70:3000 grafana 172.16.11.70 3000 linux/x86_64 Up - /home/lan/dm/deploy/grafana-3000 172.16.11.70:9090 prometheus 172.16.11.70 9090 linux/x86_64 Up /home/lan/dm/data/prometheus-9090 /home/lan/dm/deploy/prometheus-9090 Total nodes: 5 [lan@ogg ~]$

[lan@ogg dmctl]$ ./dmctl --version Release Version: v6.2.0 Git Commit Hash: c0eaa0075d46e3011225796c7f060e2a5d903a77 Git Branch: heads/refs/tags/v6.2.0 UTC Build Time: 2022-08-08 10:05:54 Go Version: go version go1.18.5 linux/amd64

[lan@ogg dm-master]$ ./dm-master -V Release Version: v6.2.0 Git Commit Hash: c0eaa0075d46e3011225796c7f060e2a5d903a77 Git Branch: heads/refs/tags/v6.2.0 UTC Build Time: 2022-08-08 10:05:54 Go Version: go version go1.18.5 linux/amd64

[lan@ogg dm-master]$

RenlySir avatar Sep 20 '22 06:09 RenlySir