Chris Egerton

@MosheBlumbergX this can be closed now, right?

@alexhwoods it's difficult to debug just based on that message. Could you supply a complete log and your connector config?

@mtagle @criccomini bump :) Would you guys be interested in this and willing to review a PR for it?

Thanks guys! Responses for each of you: @whynick1 - - The DML quota for BigQuery has now been lifted: https://cloud.google.com/blog/products/data-analytics/dml-without-limits-now-in-bigquery. - Although the potential for misalignment between users' expectations and...

Thanks, Moira. I agree that there are a ton of details that need to be worked out for how to implement this and would be happy to draw up and...

Sounds good! I'll see if I can a Google doc together sometime in the next few days.

Alright, design doc is up and anyone can comment on it here: https://docs.google.com/document/d/1p8_rLQqR9GIALIruB3-MjqR8EgYdaEw2rlFF1fxRJf0/edit

@mukund26 you may be able to use an [ExtractField SMT](https://docs.confluent.io/current/connect/transforms/extractfield.html#extractfield) to alter the data that the connector writes to BigQuery. Can you give a concrete example of what you're trying...

@mukund26 hmmm... if you're only working with a single topic and the input/output schema for the data is unlikely to change, you could try an SMT like this (to be...

@mukund26 can you provide more information about what's not working with the SMT-based approach? I'm not sure an approach involving a custom `SchemaRetriever` is actually feasible. As far as I...