DataX icon indicating copy to clipboard operation
DataX copied to clipboard

[bug][v202209][obv10w]an error message is reported: java.lang.NumberFormatException: multiple points when using oceanbasev10writer write data to oceanbase3.2.3.0

Open wistwill opened this issue 3 years ago • 6 comments

has a error:multiple points when inert into Ocean Base3.2.3 mmexport1666166175108 @wenshao

wistwill avatar Oct 19 '22 08:10 wistwill

These are job.json and debug.log . Who has encountered it and how to solve it? debug.log tm_job.json.txt

wistwill avatar Oct 20 '22 13:10 wistwill

D:\Java\zulu8\jre\bin\java.exe -agentlib:jdwp=transport=dt_socket,address=127.0.0.1:63287,suspend=y,server=n -Ddatax.home=F:\Code\DataX-datax_v202209\DataX-datax_v202209\target\datax\datax -javaagent:D:\Idea\ideaIC-2021.2.2.win\plugins\java\lib\rt\debugger-agent.jar -Dfile.encoding=UTF-8 -classpath D:\Java\zulu8\jre\lib\charsets.jar;D:\Java\zulu8\jre\lib\crs-agent.jar;D:\Java\zulu8\jre\lib\ext\access-bridge-64.jar;D:\Java\zulu8\jre\lib\ext\cldrdata.jar;D:\Java\zulu8\jre\lib\ext\dnsns.jar;D:\Java\zulu8\jre\lib\ext\jaccess.jar;D:\Java\zulu8\jre\lib\ext\legacy8ujsse.jar;D:\Java\zulu8\jre\lib\ext\localedata.jar;D:\Java\zulu8\jre\lib\ext\nashorn.jar;D:\Java\zulu8\jre\lib\ext\openjsse.jar;D:\Java\zulu8\jre\lib\ext\sunec.jar;D:\Java\zulu8\jre\lib\ext\sunjce_provider.jar;D:\Java\zulu8\jre\lib\ext\sunmscapi.jar;D:\Java\zulu8\jre\lib\ext\sunpkcs11.jar;D:\Java\zulu8\jre\lib\ext\zipfs.jar;D:\Java\zulu8\jre\lib\jce.jar;D:\Java\zulu8\jre\lib\jfr.jar;D:\Java\zulu8\jre\lib\jsse.jar;D:\Java\zulu8\jre\lib\management-agent.jar;D:\Java\zulu8\jre\lib\resources.jar;D:\Java\zulu8\jre\lib\rt.jar;F:\Code\DataX-datax_v202209\DataX-datax_v202209\core\target\classes;F:\Code\DataX-datax_v202209\DataX-datax_v202209\transformer\target\classes;F:\Code\DataX-datax_v202209\DataX-datax_v202209\common\target\classes;D:\Maven\MavenRep\com\alibaba\fastjson\1.1.46.sec10\fastjson-1.1.46.sec10.jar;D:\Maven\MavenRep\commons-io\commons-io\2.4\commons-io-2.4.jar;D:\Maven\MavenRep\org\apache\commons\commons-math3\3.1.1\commons-math3-3.1.1.jar;D:\Maven\MavenRep\commons-configuration\commons-configuration\1.10\commons-configuration-1.10.jar;D:\Maven\MavenRep\commons-lang\commons-lang\2.6\commons-lang-2.6.jar;D:\Maven\MavenRep\commons-logging\commons-logging\1.1.1\commons-logging-1.1.1.jar;D:\Maven\MavenRep\commons-cli\commons-cli\1.2\commons-cli-1.2.jar;D:\Maven\MavenRep\commons-beanutils\commons-beanutils\1.9.2\commons-beanutils-1.9.2.jar;D:\Maven\MavenRep\commons-collections\commons-collections\3.2.1\commons-collections-3.2.1.jar;D:\Maven\MavenRep\org\apache\httpcomponents\httpclient\4.5\httpclient-4.5.jar;D:\Maven\MavenRep\org\apache\httpcomponents\httpcore\4.4.1\httpcore-4.4.1.jar;D:\Maven\MavenRep\commons-codec\commons-codec\1.9\commons-codec-1.9.jar;D:\Maven\MavenRep\org\apache\httpcomponents\fluent-hc\4.5\fluent-hc-4.5.jar;D:\Maven\MavenRep\org\slf4j\slf4j-api\1.7.10\slf4j-api-1.7.10.jar;D:\Maven\MavenRep\ch\qos\logback\logback-classic\1.0.13\logback-classic-1.0.13.jar;D:\Maven\MavenRep\ch\qos\logback\logback-core\1.0.13\logback-core-1.0.13.jar;D:\Maven\MavenRep\org\codehaus\janino\janino\2.5.16\janino-2.5.16.jar;D:\Maven\MavenRep\org\apache\commons\commons-lang3\3.3.2\commons-lang3-3.3.2.jar;D:\Maven\MavenRep\org\codehaus\groovy\groovy-all\2.1.9\groovy-all-2.1.9.jar;D:\Maven\MavenRep\org\hamcrest\hamcrest-core\1.3\hamcrest-core-1.3.jar;D:\Idea\ideaIC-2021.2.2.win\lib\idea_rt.jar com.alibaba.datax.core.Engine -mode standalone -jobid -1 -job F:\datax2209\job.json Connected to the target VM, address: '127.0.0.1:63287', transport: 'socket' 16:47:58.654 [main] INFO c.a.datax.common.util.MessageSource - JVM TimeZone: GMT+08:00, Locale: zh_CN 16:47:58.659 [main] INFO c.a.datax.common.util.MessageSource - use Locale: zh_CN timeZone: sun.util.calendar.ZoneInfo[id="GMT+08:00",offset=28800000,dstSavings=0,useDaylight=false,transitions=0,lastRule=null] 16:47:59.017 [main] DEBUG c.a.datax.common.util.MessageSource - initEnvironment MessageSource.locale[zh_CN], MessageSource.timeZone[sun.util.calendar.ZoneInfo[id="GMT+08:00",offset=28800000,dstSavings=0,useDaylight=false,transitions=0,lastRule=null]] 16:47:59.017 [main] DEBUG c.a.datax.common.util.MessageSource - loadResourceBundle with locale[zh_CN], timeZone[sun.util.calendar.ZoneInfo[id="GMT+08:00",offset=28800000,dstSavings=0,useDaylight=false,transitions=0,lastRule=null]], baseName[com.alibaba.datax.common.util.LocalStrings] 16:47:59.017 [main] DEBUG c.a.datax.common.util.MessageSource - loadResourceBundle classLoader:sun.misc.Launcher$AppClassLoader@18b4aac2 16:47:59.031 [main] INFO c.a.datax.common.statistics.VMInfo - VMInfo# operatingSystem class => sun.management.OperatingSystemImpl 16:47:59.036 [main] INFO com.alibaba.datax.core.Engine - the machine info =>

osInfo:	Azul Systems, Inc. 1.8 25.282-b08
jvmInfo:	Windows 10 amd64 10.0
cpu num:	12

totalPhysicalMemory:	-0.00G
freePhysicalMemory:	-0.00G
maxFileDescriptorCount:	-1
currentOpenFileDescriptorCount:	-1

GC Names	[PS MarkSweep, PS Scavenge]

MEMORY_NAME                    | allocation_size                | init_size                      
PS Eden Space                  | 1,336.00MB                     | 64.00MB                        
Code Cache                     | 240.00MB                       | 2.44MB                         
Compressed Class Space         | 1,024.00MB                     | 0.00MB                         
PS Survivor Space              | 10.50MB                        | 10.50MB                        
PS Old Gen                     | 2,715.00MB                     | 171.00MB                       
Metaspace                      | -0.00MB                        | 0.00MB                         

16:47:59.039 [main] INFO com.alibaba.datax.core.Engine - { "content":[ { "reader":{ "name":"streamreader", "parameter":{ "column":[ { "type":"string", "value":"DataX" }, { "type":"long", "value":19890604 }, { "type":"date", "value":"1989-06-04 00:00:00" }, { "type":"bool", "value":true }, { "type":"bytes", "value":"test" } ], "sliceRecordCount":100000 } }, "writer":{ "name":"oceanbasev10writer", "parameter":{ "batchSize":1000, "column":[ "*" ], "connection":[ { "jdbcUrl":"||dsc_ob10_dsc||obcluster:test_tenant||dsc_ob10_dsc||jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true", "table":[ "test" ] } ], "memstoreThreshold":"0.9", "obWriteMode":"insert", "password":"**************", "preSql":[ "truncate table test" ], "username":"test", "writerThreadCount":10 } } } ], "setting":{ "errorLimit":{ "percentage":0.02, "record":0 }, "speed":{ "byte":10485760 } } }

16:47:59.040 [main] DEBUG com.alibaba.datax.core.Engine - {"common":{"column":{"dateFormat":"yyyy-MM-dd","datetimeFormat":"yyyy-MM-dd HH:mm:ss","encoding":"utf-8","extraFormats":["yyyyMMdd"],"timeFormat":"HH:mm:ss","timeZone":"GMT+8"}},"core":{"container":{"job":{"id":-1,"reportInterval":10000},"taskGroup":{"channel":5},"trace":{"enable":"false"}},"dataXServer":{"address":"http://localhost:7001/api","reportDataxLog":false,"reportPerfLog":false,"timeout":10000},"statistics":{"collector":{"plugin":{"maxDirtyNumber":10,"taskClass":"com.alibaba.datax.core.statistics.plugin.task.StdoutPluginCollector"}}},"transport":{"channel":{"byteCapacity":67108864,"capacity":512,"class":"com.alibaba.datax.core.transport.channel.memory.MemoryChannel","flowControlInterval":20,"speed":{"byte":2000000,"record":-1}},"exchanger":{"bufferSize":32,"class":"com.alibaba.datax.core.plugin.BufferedRecordExchanger"}}},"entry":{"jvm":"-Xms1G -Xmx1G"},"job":{"content":[{"reader":{"name":"streamreader","parameter":{"column":[{"type":"string","value":"DataX"},{"type":"long","value":19890604},{"type":"date","value":"1989-06-04 00:00:00"},{"type":"bool","value":true},{"type":"bytes","value":"test"}],"sliceRecordCount":100000}},"writer":{"name":"oceanbasev10writer","parameter":{"batchSize":1000,"column":[""],"connection":[{"jdbcUrl":"||dsc_ob10_dsc||obcluster:test_tenant||dsc_ob10_dsc||jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true","table":["test"]}],"memstoreThreshold":"0.9","obWriteMode":"insert","password":"test##","preSql":["truncate table test"],"username":"test","writerThreadCount":10}}}],"setting":{"errorLimit":{"percentage":0.02,"record":0},"speed":{"byte":10485760}}},"plugin":{"reader":{"streamreader":{"class":"com.alibaba.datax.plugin.reader.streamreader.StreamReader","description":{"mechanism":"use datax framework to transport data from stream.","useScene":"only for developer test.","warn":"Never use it in your real job."},"developer":"alibaba","name":"streamreader","path":"F:\\Code\\DataX-datax_v202209\\DataX-datax_v202209\\target\\datax\\datax\plugin\reader\streamreader"}},"writer":{"oceanbasev10writer":{"class":"com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer","description":"write data into oceanbase with sql interface","developer":"oceanbase","name":"oceanbasev10writer","path":"F:\\Code\\DataX-datax_v202209\\DataX-datax_v202209\\target\\datax\\datax\plugin\writer\oceanbasev10writer"}}}} 16:48:00.278 [main] WARN com.alibaba.datax.core.Engine - prioriy set to 0, because NumberFormatException, the value is: null 16:48:00.280 [main] INFO c.a.d.common.statistics.PerfTrace - PerfTrace traceId=job_-1, isEnable=false, priority=0 16:48:00.280 [main] INFO c.a.datax.core.job.JobContainer - DataX jobContainer starts job. 16:48:00.281 [main] DEBUG c.a.datax.core.job.JobContainer - jobContainer starts to do preHandle ... 16:48:00.282 [main] DEBUG c.a.datax.core.job.JobContainer - jobContainer starts to do init ... 16:48:00.282 [main] INFO c.a.datax.core.job.JobContainer - Set jobId = 0 16:48:04.067 [job-0] INFO c.a.datax.plugin.rdbms.util.DBUtil - this is ob1_0 jdbc url. 16:48:04.068 [job-0] INFO c.a.datax.plugin.rdbms.util.DBUtil - this is ob1_0 jdbc url. user=obcluster:test_tenant:test :url=jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true obproxy Druid LogFactory, userDefinedLogType=null, logInfo=public com.alipay.oceanbase.obproxy.util.log.CommonLoggerComponent(java.lang.String) 16:48:07.016 [job-0] INFO c.a.d.p.w.o.util.DbUtils - value for query [SHOW VARIABLES LIKE 'ob_compatibility_mode'] is [ORACLE] 16:48:30.917 [job-0] INFO c.a.datax.plugin.rdbms.util.DBUtil - this is ob1_0 jdbc url. 16:48:30.917 [job-0] INFO c.a.datax.plugin.rdbms.util.DBUtil - this is ob1_0 jdbc url. user=obcluster:test_tenant:test :url=jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true 16:48:31.492 [job-0] INFO c.a.d.p.r.w.u.OriginalConfPretreatmentUtil - table:[test] all columns:[ toolname,appid,OPERATEDATE,isfinished ]. 16:48:31.492 [job-0] WARN c.a.d.p.r.w.u.OriginalConfPretreatmentUtil - 您的配置文件中的列配置信息存在风险. 因为您配置的写入数据库表的列为,当您的表字段个数、类型有变动时,可能影响任务正确性甚至会运行出错。请检查您的配置并作出修改. 16:48:32.826 [job-0] INFO c.a.d.p.r.w.u.OriginalConfPretreatmentUtil - Write data [ INSERT INTO %s (toolname,appid,OPERATEDATE,isfinished) VALUES(?,?,?,?) ], which jdbcUrl like:[||dsc_ob10_dsc||obcluster:test_tenant||dsc_ob10_dsc||jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true] 16:48:32.826 [job-0] DEBUG c.a.d.p.r.w.CommonRdbmsWriter$Job - After job init(), originalConfig now is:[ {"batchSize":1000,"column":["toolname","appid","OPERATEDATE","isfinished"],"connection":[{"jdbcUrl":"||dsc_ob10_dsc||obcluster:test_tenant||dsc_ob10_dsc||jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","table":["test"]}],"insertOrReplaceTemplate":"INSERT INTO %s (toolname,appid,OPERATEDATE,isfinished) VALUES(?,?,?,?)","memstoreThreshold":"0.9","obCompatibilityMode":"ORACLE","obWriteMode":"insert","password":"test##","preSql":["truncate table test"],"tableNumber":1,"username":"test","writerThreadCount":10} ] 16:48:32.826 [job-0] INFO c.a.datax.core.job.JobContainer - jobContainer starts to do prepare ... 16:48:34.183 [job-0] INFO c.a.datax.core.job.JobContainer - DataX Reader.Job [streamreader] do prepare work . 16:48:34.744 [job-0] INFO c.a.datax.core.job.JobContainer - DataX Writer.Job [oceanbasev10writer] do prepare work . 16:48:36.711 [job-0] INFO c.a.datax.plugin.rdbms.util.DBUtil - this is ob1_0 jdbc url. 16:48:36.711 [job-0] INFO c.a.datax.plugin.rdbms.util.DBUtil - this is ob1_0 jdbc url. user=obcluster:test_tenant:test :url=jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true 16:48:37.162 [job-0] INFO c.a.d.p.r.w.CommonRdbmsWriter$Job - Begin to execute preSqls:[truncate table test]. context info:||dsc_ob10_dsc||obcluster:test_tenant||dsc_ob10_dsc||jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true. 16:48:37.342 [job-0] DEBUG c.a.d.p.r.w.CommonRdbmsWriter$Job - After job prepare(), originalConfig now is:[ {"batchSize":1000,"column":["toolname","appid","OPERATEDATE","isfinished"],"insertOrReplaceTemplate":"INSERT INTO %s (toolname,appid,OPERATEDATE,isfinished) VALUES(?,?,?,?)","jdbcUrl":"||dsc_ob10_dsc||obcluster:test_tenant||dsc_ob10_dsc||jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","memstoreThreshold":"0.9","obCompatibilityMode":"ORACLE","obWriteMode":"insert","password":"test##","table":"test","tableNumber":1,"username":"test","writerThreadCount":10} ] 16:49:43.746 [job-0] INFO c.a.datax.plugin.rdbms.util.DBUtil - this is ob1_0 jdbc url. 16:49:43.747 [job-0] INFO c.a.datax.plugin.rdbms.util.DBUtil - this is ob1_0 jdbc url. user=obcluster:test_tenant:test :url=jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true 16:49:45.974 [job-0] INFO c.a.d.p.w.o.util.DbUtils - value for query [show variables like 'version'] is [3.2.3.0] 16:49:57.858 [job-0] INFO c.a.datax.core.job.JobContainer - jobContainer starts to do split ... 16:49:57.858 [job-0] INFO c.a.datax.core.job.JobContainer - Job set Max-Byte-Speed to 10485760 bytes. 16:49:57.858 [job-0] INFO c.a.datax.core.job.JobContainer - DataX Reader.Job [streamreader] splits to [5] tasks. 16:49:57.859 [job-0] INFO c.a.datax.core.job.JobContainer - DataX Writer.Job [oceanbasev10writer] splits to [5] tasks. 16:49:57.859 [job-0] DEBUG c.a.datax.core.job.JobContainer - transformer configuration: null 16:49:57.878 [job-0] DEBUG c.a.datax.core.job.JobContainer - contentConfig configuration: [{"internal":{"reader":{"name":"streamreader","parameter":{"column":["{"type":"string","value":"DataX"}","{"type":"long","value":19890604}","{"dateFormat":"yyyy-MM-dd HH:mm:ss","type":"date","value":"1989-06-04 00:00:00"}","{"type":"bool","value":true}","{"type":"bytes","value":"test"}"],"sliceRecordCount":100000}},"taskId":0,"writer":{"name":"oceanbasev10writer","parameter":{"batchSize":1000,"column":["toolname","appid","OPERATEDATE","isfinished"],"insertOrReplaceTemplate":"INSERT INTO %s (toolname,appid,OPERATEDATE,isfinished) VALUES(?,?,?,?)","jdbcUrl":"||dsc_ob10_dsc||obcluster:test_tenant||dsc_ob10_dsc||jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","memstoreThreshold":"0.9","obCompatibilityMode":"ORACLE","obVersion":"3.2.3.0","obWriteMode":"insert","password":"test##","table":"test","tableNumber":1,"username":"test","writerThreadCount":10}}},"keys":["writer.parameter.memstoreThreshold","reader.parameter.column[4]","writer.parameter.column[1]","writer.parameter.tableNumber","writer.parameter.jdbcUrl","writer.parameter.obVersion","writer.name","writer.parameter.obWriteMode","writer.parameter.password","reader.name","writer.parameter.column[3]","reader.parameter.column[1]","writer.parameter.writerThreadCount","reader.parameter.column[3]","writer.parameter.column[2]","writer.parameter.column[0]","writer.parameter.insertOrReplaceTemplate","reader.parameter.sliceRecordCount","writer.parameter.obCompatibilityMode","writer.parameter.batchSize","writer.parameter.table","reader.parameter.column[2]","reader.parameter.column[0]","taskId","writer.parameter.username"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"streamreader","parameter":{"column":["{"type":"string","value":"DataX"}","{"type":"long","value":19890604}","{"dateFormat":"yyyy-MM-dd HH:mm:ss","type":"date","value":"1989-06-04 00:00:00"}","{"type":"bool","value":true}","{"type":"bytes","value":"test"}"],"sliceRecordCount":100000}},"taskId":1,"writer":{"name":"oceanbasev10writer","parameter":{"batchSize":1000,"column":["toolname","appid","OPERATEDATE","isfinished"],"insertOrReplaceTemplate":"INSERT INTO %s (toolname,appid,OPERATEDATE,isfinished) VALUES(?,?,?,?)","jdbcUrl":"||dsc_ob10_dsc||obcluster:test_tenant||dsc_ob10_dsc||jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","memstoreThreshold":"0.9","obCompatibilityMode":"ORACLE","obVersion":"3.2.3.0","obWriteMode":"insert","password":"test##","table":"test","tableNumber":1,"username":"test","writerThreadCount":10}}},"keys":["writer.parameter.memstoreThreshold","reader.parameter.column[4]","writer.parameter.column[1]","writer.parameter.tableNumber","writer.parameter.jdbcUrl","writer.parameter.obVersion","writer.name","writer.parameter.obWriteMode","writer.parameter.password","reader.name","writer.parameter.column[3]","reader.parameter.column[1]","writer.parameter.writerThreadCount","reader.parameter.column[3]","writer.parameter.column[2]","writer.parameter.column[0]","writer.parameter.insertOrReplaceTemplate","reader.parameter.sliceRecordCount","writer.parameter.obCompatibilityMode","writer.parameter.batchSize","writer.parameter.table","reader.parameter.column[2]","reader.parameter.column[0]","taskId","writer.parameter.username"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"streamreader","parameter":{"column":["{"type":"string","value":"DataX"}","{"type":"long","value":19890604}","{"dateFormat":"yyyy-MM-dd HH:mm:ss","type":"date","value":"1989-06-04 00:00:00"}","{"type":"bool","value":true}","{"type":"bytes","value":"test"}"],"sliceRecordCount":100000}},"taskId":2,"writer":{"name":"oceanbasev10writer","parameter":{"batchSize":1000,"column":["toolname","appid","OPERATEDATE","isfinished"],"insertOrReplaceTemplate":"INSERT INTO %s (toolname,appid,OPERATEDATE,isfinished) VALUES(?,?,?,?)","jdbcUrl":"||dsc_ob10_dsc||obcluster:test_tenant||dsc_ob10_dsc||jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","memstoreThreshold":"0.9","obCompatibilityMode":"ORACLE","obVersion":"3.2.3.0","obWriteMode":"insert","password":"test##","table":"test","tableNumber":1,"username":"test","writerThreadCount":10}}},"keys":["writer.parameter.memstoreThreshold","reader.parameter.column[4]","writer.parameter.column[1]","writer.parameter.tableNumber","writer.parameter.jdbcUrl","writer.parameter.obVersion","writer.name","writer.parameter.obWriteMode","writer.parameter.password","reader.name","writer.parameter.column[3]","reader.parameter.column[1]","writer.parameter.writerThreadCount","reader.parameter.column[3]","writer.parameter.column[2]","writer.parameter.column[0]","writer.parameter.insertOrReplaceTemplate","reader.parameter.sliceRecordCount","writer.parameter.obCompatibilityMode","writer.parameter.batchSize","writer.parameter.table","reader.parameter.column[2]","reader.parameter.column[0]","taskId","writer.parameter.username"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"streamreader","parameter":{"column":["{"type":"string","value":"DataX"}","{"type":"long","value":19890604}","{"dateFormat":"yyyy-MM-dd HH:mm:ss","type":"date","value":"1989-06-04 00:00:00"}","{"type":"bool","value":true}","{"type":"bytes","value":"test"}"],"sliceRecordCount":100000}},"taskId":3,"writer":{"name":"oceanbasev10writer","parameter":{"batchSize":1000,"column":["toolname","appid","OPERATEDATE","isfinished"],"insertOrReplaceTemplate":"INSERT INTO %s (toolname,appid,OPERATEDATE,isfinished) VALUES(?,?,?,?)","jdbcUrl":"||dsc_ob10_dsc||obcluster:test_tenant||dsc_ob10_dsc||jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","memstoreThreshold":"0.9","obCompatibilityMode":"ORACLE","obVersion":"3.2.3.0","obWriteMode":"insert","password":"test##","table":"test","tableNumber":1,"username":"test","writerThreadCount":10}}},"keys":["writer.parameter.memstoreThreshold","reader.parameter.column[4]","writer.parameter.column[1]","writer.parameter.tableNumber","writer.parameter.jdbcUrl","writer.parameter.obVersion","writer.name","writer.parameter.obWriteMode","writer.parameter.password","reader.name","writer.parameter.column[3]","reader.parameter.column[1]","writer.parameter.writerThreadCount","reader.parameter.column[3]","writer.parameter.column[2]","writer.parameter.column[0]","writer.parameter.insertOrReplaceTemplate","reader.parameter.sliceRecordCount","writer.parameter.obCompatibilityMode","writer.parameter.batchSize","writer.parameter.table","reader.parameter.column[2]","reader.parameter.column[0]","taskId","writer.parameter.username"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"streamreader","parameter":{"column":["{"type":"string","value":"DataX"}","{"type":"long","value":19890604}","{"dateFormat":"yyyy-MM-dd HH:mm:ss","type":"date","value":"1989-06-04 00:00:00"}","{"type":"bool","value":true}","{"type":"bytes","value":"test"}"],"sliceRecordCount":100000}},"taskId":4,"writer":{"name":"oceanbasev10writer","parameter":{"batchSize":1000,"column":["toolname","appid","OPERATEDATE","isfinished"],"insertOrReplaceTemplate":"INSERT INTO %s (toolname,appid,OPERATEDATE,isfinished) VALUES(?,?,?,?)","jdbcUrl":"||dsc_ob10_dsc||obcluster:test_tenant||dsc_ob10_dsc||jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","memstoreThreshold":"0.9","obCompatibilityMode":"ORACLE","obVersion":"3.2.3.0","obWriteMode":"insert","password":"test##","table":"test","tableNumber":1,"username":"test","writerThreadCount":10}}},"keys":["writer.parameter.memstoreThreshold","reader.parameter.column[4]","writer.parameter.column[1]","writer.parameter.tableNumber","writer.parameter.jdbcUrl","writer.parameter.obVersion","writer.name","writer.parameter.obWriteMode","writer.parameter.password","reader.name","writer.parameter.column[3]","reader.parameter.column[1]","writer.parameter.writerThreadCount","reader.parameter.column[3]","writer.parameter.column[2]","writer.parameter.column[0]","writer.parameter.insertOrReplaceTemplate","reader.parameter.sliceRecordCount","writer.parameter.obCompatibilityMode","writer.parameter.batchSize","writer.parameter.table","reader.parameter.column[2]","reader.parameter.column[0]","taskId","writer.parameter.username"],"secretKeyPathSet":[]}] 16:49:57.878 [job-0] INFO c.a.datax.core.job.JobContainer - jobContainer starts to do schedule ... 16:50:03.418 [job-0] INFO c.a.datax.core.job.JobContainer - Scheduler starts [1] taskGroups. 16:51:03.429 [job-0] INFO c.a.datax.core.job.JobContainer - Running by standalone Mode. 16:53:03.049 [job-0] DEBUG c.a.d.c.j.s.AbstractScheduler - com.alibaba.datax.core.statistics.communication.Communication@63355449[ counter={} state=RUNNING throwable= timestamp=1666255982312 message={} ] 16:53:51.968 [taskGroup-0] DEBUG c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0]'s task configs[[{"internal":{"reader":{"name":"streamreader","parameter":{"column":["{"type":"string","value":"DataX"}","{"type":"long","value":19890604}","{"dateFormat":"yyyy-MM-dd HH:mm:ss","type":"date","value":"1989-06-04 00:00:00"}","{"type":"bool","value":true}","{"type":"bytes","value":"test"}"],"sliceRecordCount":100000}},"taskId":0,"writer":{"name":"oceanbasev10writer","parameter":{"batchSize":1000,"column":["toolname","appid","OPERATEDATE","isfinished"],"insertOrReplaceTemplate":"INSERT INTO %s (toolname,appid,OPERATEDATE,isfinished) VALUES(?,?,?,?)","jdbcUrl":"||dsc_ob10_dsc||obcluster:test_tenant||dsc_ob10_dsc||jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","memstoreThreshold":"0.9","obCompatibilityMode":"ORACLE","obVersion":"3.2.3.0","obWriteMode":"insert","password":"test##","table":"test","tableNumber":1,"username":"test","writerThreadCount":10}}},"keys":["writer.parameter.memstoreThreshold","reader.parameter.column[4]","writer.parameter.column[1]","writer.parameter.tableNumber","writer.parameter.jdbcUrl","writer.parameter.obVersion","writer.name","writer.parameter.obWriteMode","writer.parameter.password","reader.name","writer.parameter.column[3]","reader.parameter.column[1]","writer.parameter.writerThreadCount","reader.parameter.column[3]","writer.parameter.column[2]","writer.parameter.column[0]","writer.parameter.insertOrReplaceTemplate","reader.parameter.sliceRecordCount","writer.parameter.obCompatibilityMode","writer.parameter.batchSize","writer.parameter.table","reader.parameter.column[2]","reader.parameter.column[0]","taskId","writer.parameter.username"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"streamreader","parameter":{"column":["{"type":"string","value":"DataX"}","{"type":"long","value":19890604}","{"dateFormat":"yyyy-MM-dd HH:mm:ss","type":"date","value":"1989-06-04 00:00:00"}","{"type":"bool","value":true}","{"type":"bytes","value":"test"}"],"sliceRecordCount":100000}},"taskId":4,"writer":{"name":"oceanbasev10writer","parameter":{"batchSize":1000,"column":["toolname","appid","OPERATEDATE","isfinished"],"insertOrReplaceTemplate":"INSERT INTO %s (toolname,appid,OPERATEDATE,isfinished) VALUES(?,?,?,?)","jdbcUrl":"||dsc_ob10_dsc||obcluster:test_tenant||dsc_ob10_dsc||jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","memstoreThreshold":"0.9","obCompatibilityMode":"ORACLE","obVersion":"3.2.3.0","obWriteMode":"insert","password":"test##","table":"test","tableNumber":1,"username":"test","writerThreadCount":10}}},"keys":["writer.parameter.memstoreThreshold","reader.parameter.column[4]","writer.parameter.column[1]","writer.parameter.tableNumber","writer.parameter.jdbcUrl","writer.parameter.obVersion","writer.name","writer.parameter.obWriteMode","writer.parameter.password","reader.name","writer.parameter.column[3]","reader.parameter.column[1]","writer.parameter.writerThreadCount","reader.parameter.column[3]","writer.parameter.column[2]","writer.parameter.column[0]","writer.parameter.insertOrReplaceTemplate","reader.parameter.sliceRecordCount","writer.parameter.obCompatibilityMode","writer.parameter.batchSize","writer.parameter.table","reader.parameter.column[2]","reader.parameter.column[0]","taskId","writer.parameter.username"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"streamreader","parameter":{"column":["{"type":"string","value":"DataX"}","{"type":"long","value":19890604}","{"dateFormat":"yyyy-MM-dd HH:mm:ss","type":"date","value":"1989-06-04 00:00:00"}","{"type":"bool","value":true}","{"type":"bytes","value":"test"}"],"sliceRecordCount":100000}},"taskId":2,"writer":{"name":"oceanbasev10writer","parameter":{"batchSize":1000,"column":["toolname","appid","OPERATEDATE","isfinished"],"insertOrReplaceTemplate":"INSERT INTO %s (toolname,appid,OPERATEDATE,isfinished) VALUES(?,?,?,?)","jdbcUrl":"||dsc_ob10_dsc||obcluster:test_tenant||dsc_ob10_dsc||jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","memstoreThreshold":"0.9","obCompatibilityMode":"ORACLE","obVersion":"3.2.3.0","obWriteMode":"insert","password":"test##","table":"test","tableNumber":1,"username":"test","writerThreadCount":10}}},"keys":["writer.parameter.memstoreThreshold","reader.parameter.column[4]","writer.parameter.column[1]","writer.parameter.tableNumber","writer.parameter.jdbcUrl","writer.parameter.obVersion","writer.name","writer.parameter.obWriteMode","writer.parameter.password","reader.name","writer.parameter.column[3]","reader.parameter.column[1]","writer.parameter.writerThreadCount","reader.parameter.column[3]","writer.parameter.column[2]","writer.parameter.column[0]","writer.parameter.insertOrReplaceTemplate","reader.parameter.sliceRecordCount","writer.parameter.obCompatibilityMode","writer.parameter.batchSize","writer.parameter.table","reader.parameter.column[2]","reader.parameter.column[0]","taskId","writer.parameter.username"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"streamreader","parameter":{"column":["{"type":"string","value":"DataX"}","{"type":"long","value":19890604}","{"dateFormat":"yyyy-MM-dd HH:mm:ss","type":"date","value":"1989-06-04 00:00:00"}","{"type":"bool","value":true}","{"type":"bytes","value":"test"}"],"sliceRecordCount":100000}},"taskId":3,"writer":{"name":"oceanbasev10writer","parameter":{"batchSize":1000,"column":["toolname","appid","OPERATEDATE","isfinished"],"insertOrReplaceTemplate":"INSERT INTO %s (toolname,appid,OPERATEDATE,isfinished) VALUES(?,?,?,?)","jdbcUrl":"||dsc_ob10_dsc||obcluster:test_tenant||dsc_ob10_dsc||jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","memstoreThreshold":"0.9","obCompatibilityMode":"ORACLE","obVersion":"3.2.3.0","obWriteMode":"insert","password":"test##","table":"test","tableNumber":1,"username":"test","writerThreadCount":10}}},"keys":["writer.parameter.memstoreThreshold","reader.parameter.column[4]","writer.parameter.column[1]","writer.parameter.tableNumber","writer.parameter.jdbcUrl","writer.parameter.obVersion","writer.name","writer.parameter.obWriteMode","writer.parameter.password","reader.name","writer.parameter.column[3]","reader.parameter.column[1]","writer.parameter.writerThreadCount","reader.parameter.column[3]","writer.parameter.column[2]","writer.parameter.column[0]","writer.parameter.insertOrReplaceTemplate","reader.parameter.sliceRecordCount","writer.parameter.obCompatibilityMode","writer.parameter.batchSize","writer.parameter.table","reader.parameter.column[2]","reader.parameter.column[0]","taskId","writer.parameter.username"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"streamreader","parameter":{"column":["{"type":"string","value":"DataX"}","{"type":"long","value":19890604}","{"dateFormat":"yyyy-MM-dd HH:mm:ss","type":"date","value":"1989-06-04 00:00:00"}","{"type":"bool","value":true}","{"type":"bytes","value":"test"}"],"sliceRecordCount":100000}},"taskId":1,"writer":{"name":"oceanbasev10writer","parameter":{"batchSize":1000,"column":["toolname","appid","OPERATEDATE","isfinished"],"insertOrReplaceTemplate":"INSERT INTO %s (toolname,appid,OPERATEDATE,isfinished) VALUES(?,?,?,?)","jdbcUrl":"||dsc_ob10_dsc||obcluster:test_tenant||dsc_ob10_dsc||jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true&yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","memstoreThreshold":"0.9","obCompatibilityMode":"ORACLE","obVersion":"3.2.3.0","obWriteMode":"insert","password":"test##","table":"test","tableNumber":1,"username":"test","writerThreadCount":10}}},"keys":["writer.parameter.memstoreThreshold","reader.parameter.column[4]","writer.parameter.column[1]","writer.parameter.tableNumber","writer.parameter.jdbcUrl","writer.parameter.obVersion","writer.name","writer.parameter.obWriteMode","writer.parameter.password","reader.name","writer.parameter.column[3]","reader.parameter.column[1]","writer.parameter.writerThreadCount","reader.parameter.column[3]","writer.parameter.column[2]","writer.parameter.column[0]","writer.parameter.insertOrReplaceTemplate","reader.parameter.sliceRecordCount","writer.parameter.obCompatibilityMode","writer.parameter.batchSize","writer.parameter.table","reader.parameter.column[2]","reader.parameter.column[0]","taskId","writer.parameter.username"],"secretKeyPathSet":[]}]] 16:53:51.969 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroupId=[0] start [5] channels for [5] tasks. 16:55:19.005 [taskGroup-0] INFO c.a.d.core.transport.channel.Channel - Channel set byte_speed_limit to 2000000. 16:55:19.006 [taskGroup-0] INFO c.a.d.core.transport.channel.Channel - Channel set record_speed_limit to -1, No tps activated. 16:55:39.615 [job-0] INFO c.a.d.c.s.c.c.j.StandAloneJobContainerCommunicator - Total 0 records, 0 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.000s | All Task WaitReaderTime 0.000s | Percentage 0.00% 16:57:02.042 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[0] attemptCount[1] is started 16:57:02.043 [0-0-0-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ... 16:57:02.043 [0-0-0-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ... 16:57:02.044 [0-0-0-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ... 16:57:02.045 [0-0-0-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ... 16:57:02.047 [0-0-4-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ... 16:57:02.047 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[4] attemptCount[1] is started 16:57:02.047 [0-0-4-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ... 16:57:02.050 [0-0-4-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ... 16:57:02.051 [0-0-4-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ... 16:57:02.056 [0-0-0-writer] INFO c.a.d.p.w.o.OceanBaseV10Writer$Task - tableNumber:1,writerTask Class:com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask 16:57:02.056 [0-0-2-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ... 16:57:02.056 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[2] attemptCount[1] is started 16:57:02.056 [0-0-2-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ... 16:57:02.056 [0-0-4-writer] INFO c.a.d.p.w.o.OceanBaseV10Writer$Task - tableNumber:1,writerTask Class:com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask 16:57:02.057 [0-0-2-writer] INFO c.a.d.p.w.o.OceanBaseV10Writer$Task - tableNumber:1,writerTask Class:com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask 16:57:02.057 [0-0-2-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ... 16:57:02.059 [0-0-2-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ... 16:57:02.062 [0-0-4-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - configure url is unavailable, use obclient for connections. 16:57:02.063 [0-0-0-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - configure url is unavailable, use obclient for connections. 16:57:02.065 [0-0-3-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ... 16:57:02.065 [0-0-3-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ... 16:57:02.064 [0-0-2-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - configure url is unavailable, use obclient for connections. 16:57:02.067 [0-0-3-writer] INFO c.a.d.p.w.o.OceanBaseV10Writer$Task - tableNumber:1,writerTask Class:com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask 16:57:02.067 [0-0-3-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ... 16:57:02.065 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[3] attemptCount[1] is started 16:57:02.069 [0-0-3-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ... 16:57:02.073 [0-0-3-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - configure url is unavailable, use obclient for connections. 16:57:02.075 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[1] attemptCount[1] is started 16:57:02.076 [0-0-1-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ... 16:57:02.077 [0-0-1-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ... 16:57:02.078 [0-0-1-writer] INFO c.a.d.p.w.o.OceanBaseV10Writer$Task - tableNumber:1,writerTask Class:com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask 16:57:02.080 [0-0-1-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ... 16:57:02.082 [0-0-1-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ... 16:57:02.085 [0-0-1-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - configure url is unavailable, use obclient for connections. 16:57:02.208 [0-0-4-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - this is oracle compatible mode, change database to SHORTINSAPP, table to TESTFORDATAX 16:57:02.209 [0-0-4-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - Disable partition calculation feature. 16:57:02.327 [0-0-1-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - this is oracle compatible mode, change database to SHORTINSAPP, table to TESTFORDATAX 16:57:02.329 [0-0-1-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - Disable partition calculation feature. 16:57:02.434 [0-0-3-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - this is oracle compatible mode, change database to SHORTINSAPP, table to TESTFORDATAX 16:57:02.434 [0-0-3-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - Disable partition calculation feature. 16:57:02.535 [0-0-2-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - this is oracle compatible mode, change database to SHORTINSAPP, table to TESTFORDATAX 16:57:02.536 [0-0-2-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - Disable partition calculation feature. 16:57:03.291 [0-0-0-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - this is oracle compatible mode, change database to SHORTINSAPP, table to TESTFORDATAX 16:57:03.292 [0-0-0-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - Disable partition calculation feature. 16:57:03.701 [0-0-2-writer] INFO c.a.d.p.r.w.CommonRdbmsWriter$Task - write mode: insert 16:57:03.701 [0-0-2-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - writeRecordSql :INSERT INTO TESTFORDATAX (toolname,appid,OPERATEDATE,isfinished) VALUES(?,?,?,?) 16:57:03.711 [0-0-2-writer] ERROR c.a.d.c.t.runner.WriterRunner - Writer Runner Received Exceptions: java.lang.NumberFormatException: multiple points at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1914) ~[na:1.8.0_282] at sun.misc.FloatingDecimal.parseFloat(FloatingDecimal.java:122) ~[na:1.8.0_282] at java.lang.Float.parseFloat(Float.java:451) ~[na:1.8.0_282] at java.lang.Float.valueOf(Float.java:416) ~[na:1.8.0_282] at com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask.init(ConcurrentTableWriterTask.java:136) ~[oceanbasev10writer-0.0.1-SNAPSHOT.jar:na] at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Task.init(OceanBaseV10Writer.java:222) ~[oceanbasev10writer-0.0.1-SNAPSHOT.jar:na] at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:44) ~[classes/:na] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_282] 16:57:03.711 [0-0-2-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ... Exception in thread "taskGroup-0" com.alibaba.datax.common.exception.DataXException: Code:[Framework-13], Description:[DataX插件运行时出错, 具体原因请参看DataX运行结束时的错误诊断信息 .]. - java.lang.NumberFormatException: multiple points at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1914) at sun.misc.FloatingDecimal.parseFloat(FloatingDecimal.java:122) at java.lang.Float.parseFloat(Float.java:451) at java.lang.Float.valueOf(Float.java:416) at com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask.init(ConcurrentTableWriterTask.java:136) at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Task.init(OceanBaseV10Writer.java:222) at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:44) at java.lang.Thread.run(Thread.java:748)

  • java.lang.NumberFormatException: multiple points at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1914) at sun.misc.FloatingDecimal.parseFloat(FloatingDecimal.java:122) at java.lang.Float.parseFloat(Float.java:451) at java.lang.Float.valueOf(Float.java:416) at com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask.init(ConcurrentTableWriterTask.java:136) at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Task.init(OceanBaseV10Writer.java:222) at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:44) at java.lang.Thread.run(Thread.java:748)

    at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:48) at com.alibaba.datax.core.taskgroup.TaskGroupContainer.start(TaskGroupContainer.java:195) at com.alibaba.datax.core.taskgroup.runner.TaskGroupContainerRunner.run(TaskGroupContainerRunner.java:24) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NumberFormatException: multiple points at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1914) at sun.misc.FloatingDecimal.parseFloat(FloatingDecimal.java:122) at java.lang.Float.parseFloat(Float.java:451) at java.lang.Float.valueOf(Float.java:416) at com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask.init(ConcurrentTableWriterTask.java:136) at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Task.init(OceanBaseV10Writer.java:222) at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:44) ... 1 more 16:57:03.794 [0-0-3-writer] INFO c.a.d.p.r.w.CommonRdbmsWriter$Task - write mode: insert 16:57:03.795 [0-0-3-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - writeRecordSql :INSERT INTO TESTFORDATAX (toolname,appid,OPERATEDATE,isfinished) VALUES(?,?,?,?) 16:57:03.796 [0-0-3-writer] ERROR c.a.d.c.t.runner.WriterRunner - Writer Runner Received Exceptions: java.lang.NumberFormatException: multiple points at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1914) ~[na:1.8.0_282] at sun.misc.FloatingDecimal.parseFloat(FloatingDecimal.java:122) ~[na:1.8.0_282] at java.lang.Float.parseFloat(Float.java:451) ~[na:1.8.0_282] at java.lang.Float.valueOf(Float.java:416) ~[na:1.8.0_282] at com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask.init(ConcurrentTableWriterTask.java:136) ~[oceanbasev10writer-0.0.1-SNAPSHOT.jar:na] at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Task.init(OceanBaseV10Writer.java:222) ~[oceanbasev10writer-0.0.1-SNAPSHOT.jar:na] at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:44) ~[classes/:na] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_282] 16:57:03.796 [0-0-3-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ... 16:57:03.894 [0-0-1-writer] INFO c.a.d.p.r.w.CommonRdbmsWriter$Task - write mode: insert 16:57:03.894 [0-0-1-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - writeRecordSql :INSERT INTO TESTFORDATAX (toolname,appid,OPERATEDATE,isfinished) VALUES(?,?,?,?) 16:57:03.895 [0-0-1-writer] ERROR c.a.d.c.t.runner.WriterRunner - Writer Runner Received Exceptions: java.lang.NumberFormatException: multiple points at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1914) ~[na:1.8.0_282] at sun.misc.FloatingDecimal.parseFloat(FloatingDecimal.java:122) ~[na:1.8.0_282] at java.lang.Float.parseFloat(Float.java:451) ~[na:1.8.0_282] at java.lang.Float.valueOf(Float.java:416) ~[na:1.8.0_282] at com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask.init(ConcurrentTableWriterTask.java:136) ~[oceanbasev10writer-0.0.1-SNAPSHOT.jar:na] at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Task.init(OceanBaseV10Writer.java:222) ~[oceanbasev10writer-0.0.1-SNAPSHOT.jar:na] at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:44) ~[classes/:na] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_282] 16:57:03.896 [0-0-1-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ... 16:57:03.991 [0-0-4-writer] INFO c.a.d.p.r.w.CommonRdbmsWriter$Task - write mode: insert 16:57:03.991 [0-0-4-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - writeRecordSql :INSERT INTO TESTFORDATAX (toolname,appid,OPERATEDATE,isfinished) VALUES(?,?,?,?) 16:57:03.992 [0-0-4-writer] ERROR c.a.d.c.t.runner.WriterRunner - Writer Runner Received Exceptions: java.lang.NumberFormatException: multiple points at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1914) ~[na:1.8.0_282] at sun.misc.FloatingDecimal.parseFloat(FloatingDecimal.java:122) ~[na:1.8.0_282] at java.lang.Float.parseFloat(Float.java:451) ~[na:1.8.0_282] at java.lang.Float.valueOf(Float.java:416) ~[na:1.8.0_282] at com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask.init(ConcurrentTableWriterTask.java:136) ~[oceanbasev10writer-0.0.1-SNAPSHOT.jar:na] at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Task.init(OceanBaseV10Writer.java:222) ~[oceanbasev10writer-0.0.1-SNAPSHOT.jar:na] at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:44) ~[classes/:na] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_282] 16:57:03.993 [0-0-4-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ... 16:57:04.116 [0-0-0-writer] INFO c.a.d.p.r.w.CommonRdbmsWriter$Task - write mode: insert 16:57:04.116 [0-0-0-writer] INFO c.a.d.p.w.o.t.ConcurrentTableWriterTask - writeRecordSql :INSERT INTO TESTFORDATAX (toolname,appid,OPERATEDATE,isfinished) VALUES(?,?,?,?) 16:57:04.117 [0-0-0-writer] ERROR c.a.d.c.t.runner.WriterRunner - Writer Runner Received Exceptions: java.lang.NumberFormatException: multiple points at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1914) ~[na:1.8.0_282] at sun.misc.FloatingDecimal.parseFloat(FloatingDecimal.java:122) ~[na:1.8.0_282] at java.lang.Float.parseFloat(Float.java:451) ~[na:1.8.0_282] at java.lang.Float.valueOf(Float.java:416) ~[na:1.8.0_282] at com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask.init(ConcurrentTableWriterTask.java:136) ~[oceanbasev10writer-0.0.1-SNAPSHOT.jar:na] at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Task.init(OceanBaseV10Writer.java:222) ~[oceanbasev10writer-0.0.1-SNAPSHOT.jar:na] at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:44) ~[classes/:na] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_282] 16:57:04.117 [0-0-0-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ... Disconnected from the target VM, address: '127.0.0.1:63287', transport: 'socket' 16:58:19.768 [job-0] DEBUG c.a.d.c.j.s.AbstractScheduler - com.alibaba.datax.core.statistics.communication.Communication@9353778[ counter={readSucceedRecords=2560, waitWriterTime=43101400, readSucceedBytes=66560, waitReaderTime=0} state=FAILED throwable=java.lang.NumberFormatException: multiple points timestamp=1666256299767 message={} ] 16:58:19.768 [job-0] INFO c.a.d.c.s.c.c.j.StandAloneJobContainerCommunicator - Total 2560 records, 66560 bytes | Speed 209B/s, 8 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.043s | All Task WaitReaderTime 0.000s | Percentage 0.00% 16:58:19.769 [job-0] INFO c.a.datax.common.statistics.VMInfo - [delta cpu info] => curDeltaCpu | averageCpu | maxDeltaCpu | minDeltaCpu
    -1.00% | -1.00% | -1.00% | -1.00%

    [delta memory info] => NAME | used_size | used_percent | max_used_size | max_percent
    PS Eden Space | 16.65MB | 26.01% | 16.65MB | 26.01%
    Code Cache | 5.22MB | 98.27% | 5.22MB | 98.27%
    Compressed Class Space | 1.60MB | 91.38% | 1.60MB | 91.38%
    PS Survivor Space | 8.21MB | 78.21% | 8.21MB | 78.21%
    PS Old Gen | 0.02MB | 0.01% | 0.02MB | 0.01%
    Metaspace | 15.55MB | 97.17% | 15.55MB | 97.17%

    [delta gc info] => NAME | curDeltaGCCount | totalGCCount | maxDeltaGCCount | minDeltaGCCount | curDeltaGCTime | totalGCTime | maxDeltaGCTime | minDeltaGCTime
    PS MarkSweep | 0 | 0 | 0 | 0 | 0.000s | 0.000s | 0.000s | 0.000s
    PS Scavenge | 1 | 1 | 1 | 1 | 0.005s | 0.005s | 0.005s | 0.005s

16:58:19.770 [job-0] ERROR c.a.datax.core.job.JobContainer - 运行scheduler 模式[standalone]出错. 16:58:19.771 [job-0] ERROR c.a.datax.core.job.JobContainer - Exception when job run com.alibaba.datax.common.exception.DataXException: Code:[Framework-13], Description:[DataX插件运行时出错, 具体原因请参看DataX运行结束时的错误诊断信息 .]. - java.lang.NumberFormatException: multiple points at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1914) at sun.misc.FloatingDecimal.parseFloat(FloatingDecimal.java:122) at java.lang.Float.parseFloat(Float.java:451) at java.lang.Float.valueOf(Float.java:416) at com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask.init(ConcurrentTableWriterTask.java:136) at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Task.init(OceanBaseV10Writer.java:222) at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:44) at java.lang.Thread.run(Thread.java:748)

  • java.lang.NumberFormatException: multiple points at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1914) at sun.misc.FloatingDecimal.parseFloat(FloatingDecimal.java:122) at java.lang.Float.parseFloat(Float.java:451) at java.lang.Float.valueOf(Float.java:416) at com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask.init(ConcurrentTableWriterTask.java:136) at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Task.init(OceanBaseV10Writer.java:222) at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:44) at java.lang.Thread.run(Thread.java:748)

    at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:48) ~[classes/:na] at com.alibaba.datax.core.job.scheduler.processinner.ProcessInnerScheduler.dealFailedStat(ProcessInnerScheduler.java:39) ~[classes/:na] at com.alibaba.datax.core.job.scheduler.AbstractScheduler.schedule(AbstractScheduler.java:99) ~[classes/:na] at com.alibaba.datax.core.job.JobContainer.schedule(JobContainer.java:535) ~[classes/:na] at com.alibaba.datax.core.job.JobContainer.start(JobContainer.java:119) ~[classes/:na] at com.alibaba.datax.core.Engine.start(Engine.java:93) [classes/:na] at com.alibaba.datax.core.Engine.entry(Engine.java:175) [classes/:na] at com.alibaba.datax.core.Engine.main(Engine.java:208) [classes/:na] java.lang.NumberFormatException: multiple points at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1914) ~[na:1.8.0_282] at sun.misc.FloatingDecimal.parseFloat(FloatingDecimal.java:122) ~[na:1.8.0_282] at java.lang.Float.parseFloat(Float.java:451) ~[na:1.8.0_282] at java.lang.Float.valueOf(Float.java:416) ~[na:1.8.0_282] at com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask.init(ConcurrentTableWriterTask.java:136) ~[na:na] at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Task.init(OceanBaseV10Writer.java:222) ~[na:na] at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:44) ~[classes/:na] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_282] 16:58:19.771 [job-0] INFO c.a.d.c.s.c.c.j.StandAloneJobContainerCommunicator - Total 2560 records, 66560 bytes | Speed 65.00KB/s, 2560 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.043s | All Task WaitReaderTime 0.000s | Percentage 0.00% 16:58:19.771 [job-0] ERROR com.alibaba.datax.core.Engine -

经DataX智能分析,该任务最可能的错误原因是: com.alibaba.datax.common.exception.DataXException: Code:[Framework-13], Description:[DataX插件运行时出错, 具体原因请参看DataX运行结束时的错误诊断信息 .]. - java.lang.NumberFormatException: multiple points at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1914) at sun.misc.FloatingDecimal.parseFloat(FloatingDecimal.java:122) at java.lang.Float.parseFloat(Float.java:451) at java.lang.Float.valueOf(Float.java:416) at com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask.init(ConcurrentTableWriterTask.java:136) at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Task.init(OceanBaseV10Writer.java:222) at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:44) at java.lang.Thread.run(Thread.java:748)

  • java.lang.NumberFormatException: multiple points at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1914) at sun.misc.FloatingDecimal.parseFloat(FloatingDecimal.java:122) at java.lang.Float.parseFloat(Float.java:451) at java.lang.Float.valueOf(Float.java:416) at com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask.init(ConcurrentTableWriterTask.java:136) at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Task.init(OceanBaseV10Writer.java:222) at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:44) at java.lang.Thread.run(Thread.java:748)

    at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:48) at com.alibaba.datax.core.job.scheduler.processinner.ProcessInnerScheduler.dealFailedStat(ProcessInnerScheduler.java:39) at com.alibaba.datax.core.job.scheduler.AbstractScheduler.schedule(AbstractScheduler.java:99) at com.alibaba.datax.core.job.JobContainer.schedule(JobContainer.java:535) at com.alibaba.datax.core.job.JobContainer.start(JobContainer.java:119) at com.alibaba.datax.core.Engine.start(Engine.java:93) at com.alibaba.datax.core.Engine.entry(Engine.java:175) at com.alibaba.datax.core.Engine.main(Engine.java:208) Caused by: java.lang.NumberFormatException: multiple points at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1914) at sun.misc.FloatingDecimal.parseFloat(FloatingDecimal.java:122) at java.lang.Float.parseFloat(Float.java:451) at java.lang.Float.valueOf(Float.java:416) at com.alibaba.datax.plugin.writer.oceanbasev10writer.task.ConcurrentTableWriterTask.init(ConcurrentTableWriterTask.java:136) at com.alibaba.datax.plugin.writer.oceanbasev10writer.OceanBaseV10Writer$Task.init(OceanBaseV10Writer.java:222) at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:44) at java.lang.Thread.run(Thread.java:748)

Process finished with exit code 1

wistwill avatar Oct 20 '22 13:10 wistwill

{ "job": { "setting": { "speed": { "byte":10485760 }, "errorLimit": { "record": 0, "percentage": 0.02 } }, "content": [ { "reader": { "name": "streamreader", "parameter": { "column" : [ { "value": "DataX", "type": "string" }, { "value": 19890604, "type": "long" }, { "value": "1989-06-04 00:00:00", "type": "date" }, { "value": true, "type": "bool" }, { "value": "test", "type": "bytes" } ], "sliceRecordCount": 100000 } }, "writer": { "name": "oceanbasev10writer", "parameter": { "obWriteMode": "insert", "column": [ "*" ], "preSql": [ "truncate table testfordatax" ], "connection": [ { "jdbcUrl": "||dsc_ob10_dsc||obcluster:test_tenant||dsc_ob10_dsc||jdbc:oceanbase://192.168.100.15:2883/test?useLocalSessionState=true&allowBatch=true&allowMultiQueries=true&rewriteBatchedStatements=true", "table": [ "testfordatax" ] } ], "username": "test", "password":"test#", "writerThreadCount":10, "batchSize": 1000, "memstoreThreshold": "0.9" } } } ] } }

wistwill avatar Oct 20 '22 13:10 wistwill

Check you source value is valid or not.

When you insert an invalid value to double/decimal column can cause this exception, like 1.2.3

dingxiaobo avatar Oct 22 '22 00:10 dingxiaobo

Check you source value is valid or not.

When you insert an invalid value to double/decimal column can cause this exception, like 1.2.3

This is Bug.I tried fix it. may be you can see the issues: https://github.com/alibaba/DataX/issues/1500

wistwill avatar Oct 24 '22 17:10 wistwill

Working on this bug

dingxiaobo avatar Oct 25 '22 12:10 dingxiaobo