camel-quarkus icon indicating copy to clipboard operation
camel-quarkus copied to clipboard

Google-bigquery: Enable `sqlCrudOperations` test once Camel version is 18.3

Open JiriOndrusek opened this issue 2 years ago • 1 comments

Google-bigquery tests require a fix https://github.com/apache/camel/pull/8162 to work completely. Until Camel 18.3 is adopted, test sqlCrudOperations has to stay disabled.

JiriOndrusek avatar Aug 23 '22 06:08 JiriOndrusek

Once tests are enabled, the status of https://issues.apache.org/jira/browse/CAMEL-18437 may affect the test itself.

JiriOndrusek avatar Aug 29 '22 12:08 JiriOndrusek

The sqlCrudOperations test fails with Camel 3.18.3.

Maybe the tests need adapting. I see some commits relating to google-bigquery are not present in 3.18.x. For now I'm going to disable sqlCrudOperations on the 2.13.x branch.

Caused by: java.lang.Exception: Query INSERT INTO `test-project.google_bigquery_test_dataset.google_bigquery_table_for_sql_crud` VALUES(@id, @col1, @col2) failed: null
	at org.apache.camel.component.google.bigquery.sql.GoogleBigQuerySQLProducer.executeSQL(GoogleBigQuerySQLProducer.java:126)
	at org.apache.camel.component.google.bigquery.sql.GoogleBigQuerySQLProducer.process(GoogleBigQuerySQLProducer.java:82)
	at org.apache.camel.support.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:66)
	at org.apache.camel.impl.engine.SharedCamelInternalProcessor.process(SharedCamelInternalProcessor.java:214)
	at org.apache.camel.impl.engine.SharedCamelInternalProcessor$1.process(SharedCamelInternalProcessor.java:111)
	at org.apache.camel.impl.engine.DefaultAsyncProcessorAwaitManager.process(DefaultAsyncProcessorAwaitManager.java:83)
	at org.apache.camel.impl.engine.SharedCamelInternalProcessor.process(SharedCamelInternalProcessor.java:108)
	at org.apache.camel.support.cache.DefaultProducerCache.send(DefaultProducerCache.java:199)
	at org.apache.camel.impl.engine.DefaultProducerTemplate.send(DefaultProducerTemplate.java:176)
	at org.apache.camel.impl.engine.DefaultProducerTemplate.send(DefaultProducerTemplate.java:172)
	at org.apache.camel.impl.engine.DefaultProducerTemplate.requestBodyAndHeaders(DefaultProducerTemplate.java:439)
	... 31 more
Caused by: com.google.cloud.bigquery.BigQueryException: 404 Not Found
POST http://localhost:38423/bigquery/v2/projects/test-project/jobs?prettyPrint=false
	at com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.translate(HttpBigQueryRpc.java:115)
	at com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.create(HttpBigQueryRpc.java:220)
	at com.google.cloud.bigquery.BigQueryImpl$5.call(BigQueryImpl.java:404)
	at com.google.cloud.bigquery.BigQueryImpl$5.call(BigQueryImpl.java:389)
	at com.google.api.gax.retrying.DirectRetryingExecutor.submit(DirectRetryingExecutor.java:103)
	at com.google.cloud.bigquery.BigQueryRetryHelper.run(BigQueryRetryHelper.java:86)
	at com.google.cloud.bigquery.BigQueryRetryHelper.runWithRetries(BigQueryRetryHelper.java:49)
	at com.google.cloud.bigquery.BigQueryImpl.create(BigQueryImpl.java:388)
	at com.google.cloud.bigquery.BigQueryImpl.create(BigQueryImpl.java:353)
	at org.apache.camel.component.google.bigquery.sql.GoogleBigQuerySQLProducer.executeSQL(GoogleBigQuerySQLProducer.java:108)
	... 41 more
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 404 Not Found
POST http://localhost:38423/bigquery/v2/projects/test-project/jobs?prettyPrint=false
	at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
	at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:118)
	at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:37)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:428)
	at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1111)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:514)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:455)
	at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:565)
	at com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.create(HttpBigQueryRpc.java:218)
	... 49 more

jamesnetherton avatar Nov 08 '22 10:11 jamesnetherton

Fixed in the 2.13.2 release from https://github.com/apache/camel-quarkus/pull/4290.

jamesnetherton avatar Jun 06 '23 15:06 jamesnetherton