tis
tis copied to clipboard
datavane
Support agile DataOps Based on Flink, DataX and Flink-CDC, Chunjun with Web-UI
as long time passed developing，some package like `solr.tgz.tar` has been abandon from TIS solutiuon ,so We shall make some fixs for tis-ansible script . 1. fix ansible script remove some...
RabbitMQ是非常流行的消息中间件，当前TIS只能支持数据库到数据库的数据同步，还不能支持到消息队列，希望后面能提供此功能。支持 AMQP协议。配置参数参考：  RabbitMQ的maven依赖： ``` xml com.rabbitmq amqp-client 5.14.0 ``` 连接示例代码： ``` java import com.rabbitmq.client.ConnectionFactory; import com.rabbitmq.client.Connection; import com.rabbitmq.client.Channel; public class RabbitMQExample { private final static String QUEUE_NAME = "hello";...
## 日志 ``` Job insert-into_default_catalog.default_database.t_account_agent_pkg_reconciliation_detail,default_catalog.default_database.t_account_agent_pkg_reconciliation_daily_summary (472c596eab2e42afead2996bcaa37400) switched from state FAILING to FAILED. org.apache.flink.runtime.JobException: The failure is not recoverable at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:119) ~[flink-dist_2.11-tis-1.13.1.jar:tis-1.13.1] at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82) ~[flink-dist_2.11-tis-1.13.1.jar:tis-1.13.1] at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:207) ~[flink-dist_2.11-tis-1.13.1.jar:tis-1.13.1] at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:197) ~[flink-dist_2.11-tis-1.13.1.jar:tis-1.13.1]...
用户需要修改datax 生成ddl 的配置，目前版本中用户只能使用默认的TIS定制好的DDL脚本，用户在某场景下需要能够修改系统提供的默认脚本来实现自己的需求 https://github.com/datavane/tis/issues/245
报错显示为： 猜测原因是停止之后datax没有反应过来。
mysql-sr 实时同步表中有主建没有识别，选择主键之后进行部署 显示没有主键 com.qlangtech.tis.lang.TisException: The main method caused an error: UpsertStreamTableSink requires that Table has a full primary keys if it is updated. at com.qlangtech.tis.lang.TisException.create(TisException.java:88) at com.qlangtech.tis.coredefine.module.action.CoreAction.doDeployIncrSyncChannal(CoreAction.java:552) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)...
AWS 的s3和s3 Glue 有广泛的使用场景，可以使用TIS将数据导入其中 * 参考文档：[https://aws.amazon.com/cn/blogs/china/use-aws-glue-amazon-s3-build-datalake](https://aws.amazon.com/cn/blogs/china/use-aws-glue-amazon-s3-build-datalake/) * [s3 glue spec](https://github.com/airbytehq/airbyte/blob/master/airbyte-integrations/connectors/destination-s3-glue/src/main/resources/spec.json) * [s3 spec](https://github.com/airbytehq/airbyte/blob/master/airbyte-integrations/connectors/destination-s3/src/main/resources/spec.json)
