airbyte icon indicating copy to clipboard operation
airbyte copied to clipboard

Rename source acceptance test to connector acceptance test

Open flash1293 opened this issue 1 year ago • 56 comments

What

Fixes https://github.com/airbytehq/airbyte/issues/21382

This PR renames the SATs to simply (connector) acceptance tests. The "connector" prefix can be dropped in descriptions if there is no ambiguity. This is done to make it clear that parts of the provided test suites (the spec-related tests) are general enough to also be used for destinations. In a separate step these will be rolled out for existing destinations.

The general way of configuring tests via the acceptance-test-config.yml doesn't change.

Note: Originally I wanted to remove the connector- prefix in more places, but there are places where I would strongly prefer it (e.g. in the name of the docker image to make clear what it is about or the gradle plugin as there are also kubernetes acceptance tests at the moment) and it seemed weird to me to switch the naming over in some place so I stuck with it in most places for now (e.g. name of the python package).

How

  • Source acceptance tests (SAT) are renamed to connector acceptance tests in all places (directory names of the code, docker image, gradle plugin and tasks)
  • The new docker image airebyte/connector-acceptance-tests will start with the same version as the existing one to ease migration. Existing references to the old image will still work, they just won't receive upgrades anymore. (it's not published yet, I will do this once this PR is approved)
  • Documentation page is adjusted to document new structure
    • Existing pages referencing source acceptance tests directly are renamed
    • Test this by running yarn && yarn build && yarn serve in the docusaurus directory

How to review

  • airbyte-integrations/bases - rename source-acceptance-test directory
  • airbyte-integrations/connector-templates - reference new docker image / gradle task
  • airbyte-integrations/connectors
    • Switch to new docker image in helper shell script and adjust comment in yml file
    • Switch to new gradle task* docs
    • Existing pages referencing source acceptance tests directly are renamed
    • There is a redirect page for the existing source-acceptance-test page to teach people it got renamed
    • Test this by running yarn && yarn build && yarn serve in the docusaurus directory
  • buildSrc rename gradle plugin and make it use the new image
  • settings.gradle change name of task for building acceptance tests themselves
  • tools rename references

flash1293 avatar Jan 25 '23 14:01 flash1293

Affected Connector Report

NOTE ⚠️ Changes in this PR affect the following connectors. Make sure to do the following as needed:

  • Run integration tests
  • Bump connector or module version
  • Add changelog
  • Publish the new version

✅ Sources (89)

Connector Version Changelog Publish
source-airtable 2.0.2
source-alloydb 1.0.36
source-alloydb-strict-encrypt 1.0.36 🔵
(ignored)
🔵
(ignored)
source-amazon-ads 0.1.29
source-amazon-seller-partner 0.2.31
source-amazon-sqs 0.1.0
source-amplitude 0.1.21
source-appsflyer 0.1.0
source-asana 0.1.5
source-azure-table 0.1.3
source-bigquery 0.2.3
source-braintree 0.1.3
source-cart 0.2.0
source-chargebee 0.1.16
source-clickhouse 0.1.15
source-clickhouse-strict-encrypt 0.1.15 🔵
(ignored)
🔵
(ignored)
source-cockroachdb 0.1.19
source-cockroachdb-strict-encrypt 0.1.19 🔵
(ignored)
🔵
(ignored)
source-commercetools 0.1.0
source-confluence 0.1.1
source-datadog 0.1.0
source-db2 0.1.17
source-db2-strict-encrypt 0.1.17 🔵
(ignored)
🔵
(ignored)
source-delighted 0.2.0
source-drift 0.2.5
source-elasticsearch 0.1.1
source-facebook-marketing 0.2.84
source-freshcaller 0.1.0
source-freshsales 0.1.2
source-freshservice 0.1.1
source-github 0.4.1
source-gitlab 1.0.2
source-google-ads 0.2.9
source-google-search-console 0.1.19
source-greenhouse 0.3.0
source-harvest 0.1.15
source-instagram 1.0.1
source-iterable 0.1.23
source-kafka 0.2.3
source-klaviyo 0.1.11
source-lemlist 0.1.1
source-lever-hiring 0.1.3
source-linnworks 0.1.5
source-mailchimp 0.3.2
source-mailgun 0.1.0
source-monday 0.2.2
source-mongodb-strict-encrypt 0.1.19 🔵
(ignored)
🔵
(ignored)
source-mongodb-v2 0.1.19
source-mssql 0.4.28
source-mssql-strict-encrypt 0.4.28 🔵
(ignored)
🔵
(ignored)
source-mysql 1.0.21
source-mysql-strict-encrypt 1.0.21 🔵
(ignored)
🔵
(ignored)
source-notion 1.0.1
source-okta 0.1.14
source-onesignal 0.1.2
source-openweather 0.1.6
source-oracle 0.3.22
source-oracle-strict-encrypt 0.3.22 🔵
(ignored)
🔵
(ignored)
source-outreach 0.1.2
source-pardot 0.1.1
source-paystack 0.1.1
source-pinterest 0.2.2
source-pipedrive 0.1.13
source-plaid 0.3.2
source-postgres 1.0.42
source-postgres-strict-encrypt 1.0.42 🔵
(ignored)
🔵
(ignored)
source-posthog 0.1.8
source-prestashop 0.3.0
source-quickbooks-singer 0.1.5
source-recharge 0.2.5
source-redshift 0.3.16
source-retently 0.1.3
source-salesforce 1.0.30
source-salesloft 0.1.3
source-scaffold-java-jdbc 0.1.0 🔵
(ignored)
🔵
(ignored)
source-sendgrid 0.3.1
source-sentry 0.1.10
source-sftp 0.1.2
source-snowflake 0.1.29
source-strava 0.1.2
source-surveymonkey 0.1.14
source-tidb 0.2.2
source-tplcentral 0.1.1
source-twilio 0.1.15
source-weatherstack 0.1.0
source-youtube-analytics 0.1.3
source-zendesk-sunshine 0.1.1
source-zendesk-talk 0.1.6
source-zenloop 0.1.4
  • See "Actionable Items" below for how to resolve warnings and errors.

✅ Destinations (0)

Connector Version Changelog Publish
  • See "Actionable Items" below for how to resolve warnings and errors.

✅ Other Modules (0)

Actionable Items

(click to expand)

Category Status Actionable Item
Version
mismatch
The version of the connector is different from its normal variant. Please bump the version of the connector.

doc not found
The connector does not seem to have a documentation file. This can be normal (e.g. basic connector like source-jdbc is not published or documented). Please double-check to make sure that it is not a bug.
Changelog
doc not found
The connector does not seem to have a documentation file. This can be normal (e.g. basic connector like source-jdbc is not published or documented). Please double-check to make sure that it is not a bug.

changelog missing
There is no chnagelog for the current version of the connector. If you are the author of the current version, please add a changelog.
Publish
not in seed
The connector is not in the seed file (e.g. source_definitions.yaml), so its publication status cannot be checked. This can be normal (e.g. some connectors are cloud-specific, and only listed in the cloud seed file). Please double-check to make sure that it is not a bug.

diff seed version
The connector exists in the seed file, but the latest version is not listed there. This usually means that the latest version is not published. Please use the /publish command to publish the latest version.

github-actions[bot] avatar Jan 25 '23 14:01 github-actions[bot]

Airbyte Code Coverage

There is no coverage information present for the Files changed

Total Project Coverage 24.52% :x:

github-actions[bot] avatar Jan 25 '23 14:01 github-actions[bot]

/test connector=connectors/source-airtable

flash1293 avatar Jan 27 '23 21:01 flash1293

/test connector=connectors/source-airtable

:clock2: connectors/source-airtable https://github.com/airbytehq/airbyte/actions/runs/4033708557 :x: connectors/source-airtable https://github.com/airbytehq/airbyte/actions/runs/4033708557 :bug: https://gradle.com/s/ezp3quz4lnryk

Build Failed

Test summary info:

=========================== short test summary info ============================
FAILED test_core.py::TestDiscovery::test_backward_compatibility[inputs0] - co...
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/plugin.py:63: Skipping TestIncremental.test_two_sequential_reads: Incremental syncs are not supported on this connector.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:94: The previous and actual specifications are identical.
============== 1 failed, 30 passed, 2 skipped in 69.93s (0:01:09) ==============

flash1293 avatar Jan 28 '23 21:01 flash1293

/test connector=bases/connector-acceptance-tests

:clock2: bases/connector-acceptance-tests https://github.com/airbytehq/airbyte/actions/runs/4033710355 :x: bases/connector-acceptance-tests https://github.com/airbytehq/airbyte/actions/runs/4033710355 :bug: https://gradle.com/s/hq7kqr65pgit6

Build Failed

Test summary info:

Could not find result summary

flash1293 avatar Jan 28 '23 21:01 flash1293

/test connector=bases/connector-acceptance-test

:clock2: bases/connector-acceptance-test https://github.com/airbytehq/airbyte/actions/runs/4033744178 :white_check_mark: bases/connector-acceptance-test https://github.com/airbytehq/airbyte/actions/runs/4033744178 No Python unittests run

Build Passed

Test summary info:

All Passed

flash1293 avatar Jan 28 '23 21:01 flash1293

/test connector=connectors/source-slack

:clock2: connectors/source-slack https://github.com/airbytehq/airbyte/actions/runs/4035290546 :x: connectors/source-slack https://github.com/airbytehq/airbyte/actions/runs/4035290546 :bug: https://gradle.com/s/5mmarygkdxmww

Build Failed

Test summary info:

=========================== short test summary info ============================
FAILED test_core.py::TestBasicRead::test_read[inputs0] - Failed: Timeout >300.0s
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:94: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:377: The previous and actual discovered catalogs are identical.
====== 1 failed, 30 passed, 2 skipped, 31 warnings in 1535.03s (0:25:35) =======

> Task :airbyte-integrations:connectors:source-slack:connectorAcceptanceTest FAILED

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
48 actionable tasks: 23 executed, 25 up-to-date

Publishing build scan...
https://gradle.com/s/5mmarygkdxmww

The remote build cache was disabled during the build due to errors.
S3 cache writes: 1, elapsed: 597ms, sent to cache: 447 B

flash1293 avatar Jan 29 '23 05:01 flash1293

/test connector=connectors/source-stripe

:clock2: connectors/source-stripe https://github.com/airbytehq/airbyte/actions/runs/4035901843 :white_check_mark: connectors/source-stripe https://github.com/airbytehq/airbyte/actions/runs/4035901843 Python tests coverage:

Name                        Stmts   Miss  Cover
-----------------------------------------------
source_stripe/source.py        22      0   100%
source_stripe/__init__.py       2      0   100%
source_stripe/streams.py      304     27    91%
-----------------------------------------------
TOTAL                         328     27    92%
	 Name                                                    Stmts   Miss  Cover   Missing
	 -------------------------------------------------------------------------------------
	 connector_acceptance_test/base.py                          12      4    67%   16-19
	 connector_acceptance_test/config.py                       141      5    96%   87, 93, 239, 243-244
	 connector_acceptance_test/conftest.py                     211     95    55%   36, 42-44, 49, 54, 77, 83, 89-91, 110, 115-117, 123-125, 131-132, 137-138, 143, 149, 158-167, 173-178, 193, 217, 248, 254, 262-267, 275-285, 293-306, 311-317, 324-335, 342-358
	 connector_acceptance_test/plugin.py                        69     25    64%   22-23, 31, 36, 120-140, 144-148
	 connector_acceptance_test/tests/test_core.py              402    115    71%   53, 58, 93-104, 109-116, 120-121, 125-126, 308, 346-363, 376-387, 391-396, 402, 435-440, 478-485, 528-530, 533, 598-606, 618-621, 626, 682-683, 689, 692, 728-738, 751-776
	 connector_acceptance_test/tests/test_incremental.py       160     14    91%   58-65, 70-83, 246
	 connector_acceptance_test/utils/asserts.py                 39      2    95%   62-63
	 connector_acceptance_test/utils/common.py                  94     10    89%   16-17, 32-38, 72, 75
	 connector_acceptance_test/utils/compare.py                 62     23    63%   21-51, 68, 97-99
	 connector_acceptance_test/utils/connector_runner.py       133     33    75%   24-27, 46-47, 50-54, 57-58, 73-75, 78-80, 83-85, 88-90, 93-95, 124-125, 159-161, 208
	 connector_acceptance_test/utils/json_schema_helper.py     107     13    88%   30-31, 38, 41, 65-68, 96, 120, 192-194
	 -------------------------------------------------------------------------------------
	 TOTAL                                                    1609    339    79%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:94: The previous and actual specifications are identical.
============ 49 passed, 1 skipped, 31 warnings in 865.13s (0:14:25) ============

flash1293 avatar Jan 29 '23 08:01 flash1293

/test connector=connectors/destination-bigquery

:clock2: connectors/destination-bigquery https://github.com/airbytehq/airbyte/actions/runs/4046227266 :white_check_mark: connectors/destination-bigquery https://github.com/airbytehq/airbyte/actions/runs/4046227266 Python tests coverage:

Name                                                              Stmts   Miss  Cover
-------------------------------------------------------------------------------------
normalization/transform_config/__init__.py                            2      0   100%
normalization/transform_catalog/reserved_keywords.py                 14      0   100%
normalization/transform_catalog/__init__.py                           2      0   100%
normalization/destination_type.py                                    14      0   100%
normalization/__init__.py                                             4      0   100%
normalization/transform_catalog/destination_name_transformer.py     166      8    95%
normalization/transform_catalog/table_name_registry.py              174     34    80%
normalization/transform_config/transform.py                         189     48    75%
normalization/transform_catalog/utils.py                             51     14    73%
normalization/transform_catalog/dbt_macro.py                         22      7    68%
normalization/transform_catalog/catalog_processor.py                147     80    46%
normalization/transform_catalog/transform.py                         61     38    38%
normalization/transform_catalog/stream_processor.py                 595    400    33%
-------------------------------------------------------------------------------------
TOTAL                                                              1441    629    56%

Build Passed

Test summary info:

All Passed

grishick avatar Jan 30 '23 16:01 grishick

/test connector=connectors/source-hubspot

:clock2: connectors/source-hubspot https://github.com/airbytehq/airbyte/actions/runs/4048355343 :x: connectors/source-hubspot https://github.com/airbytehq/airbyte/actions/runs/4048355343 :bug: https://gradle.com/s/cy3bnh5llffdm

Build Failed

Test summary info:

Could not find result summary

evantahler avatar Jan 30 '23 21:01 evantahler

/test connector=connectors/source-alloydb

:clock2: connectors/source-alloydb https://github.com/airbytehq/airbyte/actions/runs/4053038642 :x: connectors/source-alloydb https://github.com/airbytehq/airbyte/actions/runs/4053038642 :bug:

Build Passed

Test summary info:

All Passed

flash1293 avatar Jan 31 '23 10:01 flash1293

/test connector=connectors/source-amazon-ads

:clock2: connectors/source-amazon-ads https://github.com/airbytehq/airbyte/actions/runs/4053040305 :x: connectors/source-amazon-ads https://github.com/airbytehq/airbyte/actions/runs/4053040305 :bug: https://gradle.com/s/zmphcn4pnndkc

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:98: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:507: The previous and actual discovered catalogs are identical.
================== 36 passed, 2 skipped in 947.34s (0:15:47) ===================

flash1293 avatar Jan 31 '23 10:01 flash1293

/test connector=connectors/source-amplitude

:clock2: connectors/source-amplitude https://github.com/airbytehq/airbyte/actions/runs/4053042237 :x: connectors/source-amplitude https://github.com/airbytehq/airbyte/actions/runs/4053042237 :bug: https://gradle.com/s/lcvanburs2a2o

Build Failed

Test summary info:

Could not find result summary

flash1293 avatar Jan 31 '23 10:01 flash1293

/test connector=connectors/source-bing-ads

:clock2: connectors/source-bing-ads https://github.com/airbytehq/airbyte/actions/runs/4053043946 :x: connectors/source-bing-ads https://github.com/airbytehq/airbyte/actions/runs/4053043946 :bug:

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/plugin.py:63: Skipping TestIncremental.test_two_sequential_reads: not found in the config.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:98: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:507: The previous and actual discovered catalogs are identical.
============ 33 passed, 3 skipped, 35 warnings in 583.86s (0:09:43) ============

flash1293 avatar Jan 31 '23 10:01 flash1293

/test connector=connectors/source-chargebee

:clock2: connectors/source-chargebee https://github.com/airbytehq/airbyte/actions/runs/4053045395 :x: connectors/source-chargebee https://github.com/airbytehq/airbyte/actions/runs/4053045395 :bug: https://gradle.com/s/tavq24376tcby

Build Failed

Test summary info:

=========================== short test summary info ============================
FAILED test_core.py::TestDiscovery::test_backward_compatibility[inputs0] - co...
FAILED test_incremental.py::TestIncremental::test_two_sequential_reads[inputs0]
FAILED test_incremental.py::TestIncremental::test_read_sequential_slices[inputs0]
FAILED test_incremental.py::TestIncremental::test_state_with_abnormally_large_values[inputs0]
================== 4 failed, 33 passed, 37 warnings in 38.25s ==================

flash1293 avatar Jan 31 '23 10:01 flash1293

/test connector=connectors/source-facebook-marketing

:clock2: connectors/source-facebook-marketing https://github.com/airbytehq/airbyte/actions/runs/4053046703 :x: connectors/source-facebook-marketing https://github.com/airbytehq/airbyte/actions/runs/4053046703 :bug: https://gradle.com/s/yaslisbld2yri

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:98: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:507: The previous and actual discovered catalogs are identical.
================== 35 passed, 2 skipped in 2909.33s (0:48:29) ==================

flash1293 avatar Jan 31 '23 10:01 flash1293

/test connector=connectors/source-file

:clock2: connectors/source-file https://github.com/airbytehq/airbyte/actions/runs/4053048154 :x: connectors/source-file https://github.com/airbytehq/airbyte/actions/runs/4053048154 :bug:

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/plugin.py:63: Skipping TestIncremental.test_two_sequential_reads: Incremental syncs are not supported on this connector.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:98: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:507: The previous and actual discovered catalogs are identical.
======================== 32 passed, 3 skipped in 46.25s ========================

flash1293 avatar Jan 31 '23 10:01 flash1293

/test connector=connectors/source-freshdesk

:clock2: connectors/source-freshdesk https://github.com/airbytehq/airbyte/actions/runs/4053050266 :x: connectors/source-freshdesk https://github.com/airbytehq/airbyte/actions/runs/4053050266 :bug: https://gradle.com/s/2df5kp5pwvydw

Build Failed

Test summary info:

=========================== short test summary info ============================
FAILED test_core.py::TestBasicRead::test_read[inputs0] - Failed: Stream conta...
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:98: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:507: The previous and actual discovered catalogs are identical.
============= 1 failed, 34 passed, 2 skipped in 345.04s (0:05:45) ==============

flash1293 avatar Jan 31 '23 10:01 flash1293

The runs above failed, but I think this is caused by https://github.com/airbytehq/airbyte/issues/22127 - I pulled in https://github.com/airbytehq/airbyte/pull/22131 which seems to make the builds work for now. FYI @bechurch so you are aware of this work

flash1293 avatar Jan 31 '23 10:01 flash1293

/test connector=connectors/source-alloydb

:clock2: connectors/source-alloydb https://github.com/airbytehq/airbyte/actions/runs/4053173317 :x: connectors/source-alloydb https://github.com/airbytehq/airbyte/actions/runs/4053173317 :bug:

Build Passed

Test summary info:

All Passed

flash1293 avatar Jan 31 '23 10:01 flash1293

/test connector=connectors/source-file

:clock2: connectors/source-file https://github.com/airbytehq/airbyte/actions/runs/4053175119 :x: connectors/source-file https://github.com/airbytehq/airbyte/actions/runs/4053175119 :bug:

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/plugin.py:63: Skipping TestIncremental.test_two_sequential_reads: Incremental syncs are not supported on this connector.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:98: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:507: The previous and actual discovered catalogs are identical.
======================== 32 passed, 3 skipped in 47.92s ========================

flash1293 avatar Jan 31 '23 10:01 flash1293

@evantahler @bechurch I tested on a clean master state and I'm getting exactly the same error as on this PR when trying to run connectors - the tests run fine but the QA checks fail: https://github.com/airbytehq/airbyte/pull/22136#issuecomment-1410148433

Could you take a look at that?

flash1293 avatar Jan 31 '23 11:01 flash1293

Platform Test Results

   243 files     243 suites   23m 59s :stopwatch: 1 661 tests 1 650 :heavy_check_mark: 11 :zzz: 0 :x: 1 680 runs  1 669 :heavy_check_mark: 11 :zzz: 0 :x:

Results for commit 6fc9c998.

:recycle: This comment has been updated with latest results.

github-actions[bot] avatar Jan 31 '23 12:01 github-actions[bot]

/test connector=connectors/source-file

flash1293 avatar Jan 31 '23 17:01 flash1293

/test connector=connectors/source-alloydb

flash1293 avatar Jan 31 '23 17:01 flash1293

/test connector=connectors/source-file

flash1293 avatar Jan 31 '23 17:01 flash1293

/test connector=connectors/source-file

:clock2: connectors/source-file https://github.com/airbytehq/airbyte/actions/runs/4056941645 :white_check_mark: connectors/source-file https://github.com/airbytehq/airbyte/actions/runs/4056941645 Python tests coverage:

Name                      Stmts   Miss  Cover
---------------------------------------------
source_file/__init__.py       2      0   100%
source_file/utils.py         13      1    92%
source_file/source.py        81      7    91%
source_file/client.py       283     37    87%
---------------------------------------------
TOTAL                       379     45    88%
Name                      Stmts   Miss  Cover
---------------------------------------------
source_file/__init__.py       2      0   100%
source_file/client.py       283     40    86%
source_file/utils.py         13      5    62%
source_file/source.py        81     46    43%
---------------------------------------------
TOTAL                       379     91    76%
	 Name                                                    Stmts   Miss  Cover   Missing
	 -------------------------------------------------------------------------------------
	 connector_acceptance_test/base.py                          12      4    67%   16-19
	 connector_acceptance_test/config.py                       141      5    96%   87, 93, 239, 243-244
	 connector_acceptance_test/conftest.py                     211     95    55%   36, 42-44, 49, 54, 77, 83, 89-91, 110, 115-117, 123-125, 131-132, 137-138, 143, 149, 158-167, 173-178, 193, 217, 248, 254, 262-267, 275-285, 293-306, 311-317, 324-335, 342-358
	 connector_acceptance_test/plugin.py                        69     25    64%   22-23, 31, 36, 120-140, 144-148
	 connector_acceptance_test/tests/test_core.py              476    117    75%   53, 58, 97-108, 113-120, 124-125, 129-130, 380, 400, 438, 476-493, 506-517, 521-526, 532, 565-570, 608-615, 658-660, 663, 728-736, 748-751, 756, 812-813, 819, 822, 858-868, 881-906
	 connector_acceptance_test/tests/test_incremental.py       160     14    91%   58-65, 70-83, 246
	 connector_acceptance_test/utils/asserts.py                 39      2    95%   62-63
	 connector_acceptance_test/utils/common.py                  94     10    89%   16-17, 32-38, 72, 75
	 connector_acceptance_test/utils/compare.py                 62     23    63%   21-51, 68, 97-99
	 connector_acceptance_test/utils/connector_runner.py       133     33    75%   24-27, 46-47, 50-54, 57-58, 73-75, 78-80, 83-85, 88-90, 93-95, 124-125, 159-161, 208
	 connector_acceptance_test/utils/json_schema_helper.py     114     13    89%   31-32, 39, 42, 66-69, 97, 121, 203-205
	 -------------------------------------------------------------------------------------
	 TOTAL                                                    1690    341    80%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/plugin.py:63: Skipping TestIncremental.test_two_sequential_reads: Incremental syncs are not supported on this connector.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:98: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:507: The previous and actual discovered catalogs are identical.
======================== 32 passed, 3 skipped in 49.58s ========================

flash1293 avatar Jan 31 '23 17:01 flash1293

/test connector=connectors/source-alloydb

:clock2: connectors/source-alloydb https://github.com/airbytehq/airbyte/actions/runs/4057391572 :white_check_mark: connectors/source-alloydb https://github.com/airbytehq/airbyte/actions/runs/4057391572 No Python unittests run

Build Passed

Test summary info:

All Passed

flash1293 avatar Jan 31 '23 18:01 flash1293

/test connector=connectors/source-amazon-ads

:clock2: connectors/source-amazon-ads https://github.com/airbytehq/airbyte/actions/runs/4057401198

flash1293 avatar Jan 31 '23 18:01 flash1293

/test connector=connectors/source-amplitude

flash1293 avatar Jan 31 '23 18:01 flash1293