Yohei Onishi
# overview * If I start Airflow containers using `docker-compose-CeleryExecutor.yml`, airflow CLI fails with `no such table` error. I guess this is because Airflow CLI tries to use local sqlite...
decorder does not support `application/x-www-form-urlencoded` yet https://github.com/go-chi/render/blob/7bbdb19f4016118d23bc31d6d33dc1dd517c6b2e/decoder.go#L28
I am using msgpack-node with TypeScript. so I need types file for TypeScript code so that I can import msgpack-node from TypeScript code. https://basarat.gitbooks.io/typescript/content/docs/types/@types.html Although, msgpack-node does not have DefinitelyTyped...
Kafka connect should support `topics.regex`. https://issues.apache.org/jira/browse/KAFKA-3073 https://github.com/apache/kafka/pull/4151 https://kafka.apache.org/documentation/#connect ``` Sink connectors also have a few additional options to control their input. Each sink connector must set one of the following:...
Hi, I am using `kafka-connect-bigquery` to sync data from PostgreSQL to BigQuery. Then I found that these errors repeatedly show up on my Kafka connect logs. These fields are required...
Kafka connect throws an error like this when payload size exceeds the limit. Is payload size configurable? ``` Request payload size exceeds the limit: 10485760 bytes ``` Thanks in advance.
# Background * In current implementation, BigQuery sink connector specifies partition explicitly like `mydataset.table$20170301` based on timestamp column or current date time as default. https://github.com/wepay/kafka-connect-bigquery/blob/6270dd8726acab7b897ad4139d22dd2fe90ce836/kcbq-connector/src/main/java/com/wepay/kafka/connect/bigquery/BigQuerySinkTask.java#L144-L146 * When using partition decorator,...
BigQuery supports de-duplication. Does `kafka-connect-bigquery` support this feature? https://cloud.google.com/bigquery/streaming-data-into-bigquery#dataconsistency ``` To help ensure data consistency, you can supply insertId for each inserted row. BigQuery remembers this ID for at least...
**Is your feature request related to a problem? Please describe.** * Table has a property `change_tracking`, which is a requirement to create a stream on a table https://registry.terraform.io/providers/Snowflake-Labs/snowflake/latest/docs/resources/table * but...
**Is your feature request related to a problem? Please describe.** We want to use UNIQUE key for columns in CREATE TABLE statements https://docs.snowflake.com/en/sql-reference/constraints-overview.html but can not find in current implementation...