dtle icon indicating copy to clipboard operation
dtle copied to clipboard

database character set & collation is inconsistent from src,when they are using non default character set

Open Dinosauria opened this issue 6 years ago • 1 comments

Description

database character set & collation is inconsistent from src,when they are using non default character set & collations

Steps to reproduce the issue: 1.do as the case

Describe the results you received: All the tables in dest all in the same character set and collations

Describe the results you expected: Support full copy including character set and collations

Output of ./dtle version:

Dtle 9.9.9.9 (git: master c5126693689180c0950969432e4f939232f2dda8)

Additional information you deem important (e.g. issue happens only occasionally):

always

Additional details (log, config, job config etc):

  1. job.conf:
{
    "Name":"task1",
    "Failover":false,
    "Orders":[],
    "Type":"synchronous",
    "Tasks":[
        {
            "Type":"Src",
            "NodeId":"53c0746e-beda-b193-ddbd-2744696b54a0",
            "Config":{
                "Gtid":"",
                "SkipCreateDbTable":false,
                "ExpandSyntaxSupport":false,
                "DropTableIfExists":false,
                "ReplChanBufferSize":"600",
                "ChunkSize":"2000",
                "ApproveHeterogeneous":true,
                "ReplicateDoDb":[],
                "ConnectionConfig":{
                    "Host":"172.17.5.1",
                    "Port":"1111",
                    "User":"test",
                    "Password":"test"
                }
            }
        },
        {
            "Type":"Dest",
            "NodeId":"53c0746e-beda-b193-ddbd-2744696b54a0",
            "Config":{
                "SkipCreateDbTable":false,
                "DropTableIfExists":false,
                "ExpandSyntaxSupport":false,
                "ReplChanBufferSize":"600",
                "ApproveHeterogeneous":true,
                "ConnectionConfig":{
                    "Host":"172.17.5.2",
                    "Port":"2222",
                    "User":"test",
                    "Password":"test"
                }
            }
        }
    ]
}
  1. dtle.log:dtle_log.txt
2018/11/07 17:52:07.313546 [INFO] [36f88395-2ad1-3b3b-8130-eb14be3b9246] mysql.extractor: Step 2: - generating DROP and CREATE statements to reflect current database s
chemas:[db10 db5 db6 db7 db8 db9 universe] 
2018/11/07 17:52:07.313765 [DEBUG] [36f88395-2ad1-3b3b-8130-eb14be3b9246] mysql.extractor: publish. gtid: , msg_len: 903 
2018/11/07 17:52:07.314028 [DEBUG] [36f88395-2ad1-3b3b-8130-eb14be3b9246] mysql.applier: recv a msg 
2018/11/07 17:52:07.314290 [DEBUG] [36f88395-2ad1-3b3b-8130-eb14be3b9246] mysql.applier: copyRowsQueue: 0 
2018/11/07 17:52:07.314308 [DEBUG] [36f88395-2ad1-3b3b-8130-eb14be3b9246] mysql.applier: after publish nats reply 
2018/11/07 17:52:07.314551 [DEBUG] [36f88395-2ad1-3b3b-8130-eb14be3b9246] mysql.extractor: publish. gtid: , msg_len: 902 
2018/11/07 17:52:07.314752 [DEBUG] [36f88395-2ad1-3b3b-8130-eb14be3b9246] mysql.applier: Exec [SET character_set_server = utf8, collation_server = utf8_general_ci] 
2018/11/07 17:52:07.314779 [DEBUG] [36f88395-2ad1-3b3b-8130-eb14be3b9246] mysql.applier: recv a msg 
2018/11/07 17:52:07.314988 [DEBUG] [36f88395-2ad1-3b3b-8130-eb14be3b9246] mysql.applier: Exec [SET @@session.sql_mode = 'ONLY_FULL_GROUP_BY,STRICT_TRANS_TABLES,NO_ZERO
_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION'] 

  1. diff image

Dinosauria avatar Nov 07 '18 10:11 Dinosauria

Still exists in Dtle 9.9.9.9 (git: master 203100a4b7f72fe636c3461c97a4fe13ac7c7cdf)

yaqigithub avatar May 13 '19 08:05 yaqigithub