Ben Bernays

I have taken a look at this and I think it could have significant value if we were to do this as a tutorial (or a series of tutorials). In...

@DylanKeyer and @skhreshefsharvit - I will be working on this issue. Are there any specific tables that you would particularly be interested in seeing support Incremental syncs?

Update: - As of aws plugin `v24.1.0` `aws_inspector2_findings` now supports incremental sync - The following tables cannot be converted into `aws_ec2_ebs_snapshots`,`aws_ec2_instances`, `aws_ec2_instance_statuses` into incremental tables as their is no API...

DeleteStale message specifies a single table. When using `DeleteRecord` it specifies a top level table and then multiple nested tables. It is important to flush the nested tables prior to...

Yes, the destination has to craft a query that joins `_cq_id` on `_cq_parent_id`. Here is the implementation for PG: https://github.com/cloudquery/cloudquery/blob/aa8659512d9d3c4f23d210cc7b4df31d399af5d0/plugins/destination/postgresql/client/delete.go#L36-L38

We have added a `cloudquery validate-config` command. This new command will still require the plugin to be downloaded and available locally, but it will not require any credentials for the...

Based on the GCP docs, it seems like this data is already being synced. The data seems to be in the `config` column of the `gcp_serviceusage_services` table. gcp_serviceusage_services --> Config...

So looked into this, the nested `quota` field is always nil because it is only filled when the request is made with the `GetService` rather than the `ListServices` method. https://pkg.go.dev/cloud.google.com/go/[email protected]/apiv1/serviceusagepb#Service...

Update: changed the current resolving code from a list call to a list + get pattern and when I synced a single project I was rate limited... I think the...

While I think we could write a tutorial on how to do it for Postgres, but I don't think it will scale to all of our destinations that support. As...