tiflow
tiflow copied to clipboard
DM dashborad edit task use [Open task as plaintext config],set syncers safe-mode: true,not work
What did you do?
my task config: name: test1-20210 task-mode: incremental is-sharding: true shard-mode: pessimistic ignore-checking-items:
- table_schema meta-schema: dm_meta122 enable-heartbeat: false heartbeat-update-interval: 0 heartbeat-report-interval: 0 timezone: "" case-sensitive: false collation_compatible: loose target-database: host: 172.16.11.43 port: 4001 user: lgr password: lgr max-allowed-packet: null session: {} security: null mysql-instances:
- source-id: mysql1-1
meta:
binlog-name: mysql-bin.000007
binlog-pos: 840
binlog-gtid: '484abf96-3657-11ed-8043-164bf906d505:1-3 '
filter-rules: []
column-mapping-rules: []
route-rules: []
expression-filters: []
black-white-list: ""
block-allow-list: balist-01
mydumper-config-name: dump-01
mydumper:
mydumper-path: ./bin/mydumper
threads: 4
chunk-filesize: "64"
statement-size: 0
rows: 0
where: ""
skip-tz-utc: true
extra-args: ""
mydumper-thread: 0
loader-config-name: load-01
loader:
pool-size: 16
dir: ./dumped_data
import-mode: sql
on-duplicate: replace
loader-thread: 0
syncer-config-name: sync-01
syncer:
meta-file: ""
worker-count: 16
batch: 100
queue-size: 1024
checkpoint-flush-interval: 30
compact: false
multiple-rows: false
max-retry: 0
auto-fix-gtid: false
enable-gtid: false
disable-detect: false
safe-mode: false
enable-ansi-quotes: false
syncer-thread: 0
validator-config-name: validator-01
online-ddl: true
shadow-table-rules: []
trash-table-rules: []
online-ddl-scheme: ""
routes: {}
filters: {}
column-mappings: {}
expression-filter: {}
black-white-list: {}
block-allow-list:
balist-01:
do-tables:
- db-name: lan tbl-name: ~^* do-dbs: [] ignore-tables: [] ignore-dbs: [] mydumpers: dump-01: mydumper-path: ./bin/mydumper threads: 4 chunk-filesize: "64" statement-size: 0 rows: 0 where: "" skip-tz-utc: true extra-args: "" loaders: load-01: pool-size: 16 dir: ./dumped_data import-mode: sql on-duplicate: replace syncers: sync-01: meta-file: "" worker-count: 16 batch: 100 queue-size: 1024 checkpoint-flush-interval: 30 compact: false multiple-rows: false max-retry: 0 auto-fix-gtid: false enable-gtid: false disable-detect: false safe-mode: true enable-ansi-quotes: false validators: validator-01: mode: none worker-count: 4 validate-interval: 10s check-interval: 5s row-error-delay: 30m0s meta-flush-interval: 5m0s batch-query-size: 100 max-pending-row-size: 500m max-pending-row-count: 2147483647 clean-dump-file: false ansi-quotes: false remove-meta: false experimental: async-checkpoint-flush: false
when create task,safe-mode still false,not work.
What did you expect to see?
syncers: sync-01: meta-file: "" worker-count: 16 batch: 100 queue-size: 1024 checkpoint-flush-interval: 30 compact: false multiple-rows: false max-retry: 0 auto-fix-gtid: false enable-gtid: false disable-detect: false safe-mode: true
task's conf safe-mode should be true.
What did you see instead?
safe-mode still false.
Versions of the cluster
[lan@ogg dm-master]$ tiup dm display dm-test
tiup is checking updates for component dm ...
Starting component dm
: /home/lan/.tiup/components/dm/v1.10.3/tiup-dm display dm-test
Cluster type: dm
Cluster name: dm-test
Cluster version: v6.2.0
Deploy user: lan
SSH type: builtin
Grafana URL: http://172.16.11.70:3000
ID Role Host Ports OS/Arch Status Data Dir Deploy Dir
172.16.11.70:9093 alertmanager 172.16.11.70 9093/9094 linux/x86_64 Up /home/lan/dm/data/alertmanager-9093 /home/lan/dm/deploy/alertmanager-9093 172.16.11.70:8261 dm-master 172.16.11.70 8261/8291 linux/x86_64 Healthy|L /home/lan/dm/data/dm-master-8261 /home/lan/dm/deploy/dm-master-8261 172.16.11.70:8262 dm-worker 172.16.11.70 8262 linux/x86_64 Bound /home/lan/dm/data/dm-worker-8262 /home/lan/dm/deploy/dm-worker-8262 172.16.11.70:3000 grafana 172.16.11.70 3000 linux/x86_64 Up - /home/lan/dm/deploy/grafana-3000 172.16.11.70:9090 prometheus 172.16.11.70 9090 linux/x86_64 Up /home/lan/dm/data/prometheus-9090 /home/lan/dm/deploy/prometheus-9090 Total nodes: 5
current status of DM cluster (execute query-status <task-name>
in dmctl)
[lan@ogg ~]$ tiup dm display dm-test
tiup is checking updates for component dm ...
Starting component dm
: /home/lan/.tiup/components/dm/v1.10.3/tiup-dm display dm-test
Cluster type: dm
Cluster name: dm-test
Cluster version: v6.2.0
Deploy user: lan
SSH type: builtin
Grafana URL: http://172.16.11.70:3000
ID Role Host Ports OS/Arch Status Data Dir Deploy Dir
172.16.11.70:9093 alertmanager 172.16.11.70 9093/9094 linux/x86_64 Up /home/lan/dm/data/alertmanager-9093 /home/lan/dm/deploy/alertmanager-9093 172.16.11.70:8261 dm-master 172.16.11.70 8261/8291 linux/x86_64 Healthy|L /home/lan/dm/data/dm-master-8261 /home/lan/dm/deploy/dm-master-8261 172.16.11.70:8262 dm-worker 172.16.11.70 8262 linux/x86_64 Bound /home/lan/dm/data/dm-worker-8262 /home/lan/dm/deploy/dm-worker-8262 172.16.11.70:3000 grafana 172.16.11.70 3000 linux/x86_64 Up - /home/lan/dm/deploy/grafana-3000 172.16.11.70:9090 prometheus 172.16.11.70 9090 linux/x86_64 Up /home/lan/dm/data/prometheus-9090 /home/lan/dm/deploy/prometheus-9090 Total nodes: 5 [lan@ogg ~]$
[lan@ogg dmctl]$ ./dmctl --version Release Version: v6.2.0 Git Commit Hash: c0eaa0075d46e3011225796c7f060e2a5d903a77 Git Branch: heads/refs/tags/v6.2.0 UTC Build Time: 2022-08-08 10:05:54 Go Version: go version go1.18.5 linux/amd64
[lan@ogg dm-master]$ ./dm-master -V Release Version: v6.2.0 Git Commit Hash: c0eaa0075d46e3011225796c7f060e2a5d903a77 Git Branch: heads/refs/tags/v6.2.0 UTC Build Time: 2022-08-08 10:05:54 Go Version: go version go1.18.5 linux/amd64
[lan@ogg dm-master]$