amplify-swift icon indicating copy to clipboard operation
amplify-swift copied to clipboard

Integration Tests Failing in CI

Open ameter opened this issue 2 years ago • 3 comments

Describe the bug

A number of integration tests are currently failing in GitHub Actions.

Steps To Reproduce

run integration tests workflow

Expected behavior

tests should pass

Amplify Framework Version

n/a

Amplify Categories

Analytics

Dependency manager

Cocoapods

Swift version

n/a

CLI version

n/a

Xcode version

n/a

Relevant log output

No response

Is this a regression?

No

Regression additional context

No response

Device

n/a

iOS Version

n/a

Specific to simulators

no

Additional context

No response

ameter avatar May 06 '22 23:05 ameter

Failures per test in the last 11 runs

Test Failures
analytics-integration-test 8
api-integration-test 1
auth-integration-test 2
datastore-integration-test 4
geo-integration-test 0
predictions-integration-test 1
storage-integration-test 4
api-graphqliam-integration-test 2
api-graphqluserpool-integration-test 5
api-restiam-integration-test 0
api-restuserpool-integration-test 1
api-graphqllambda-integration-test 1

The only test that hasn't failed in the past 11 runs is geo-integration-test. I didn't include metrics on the various datastore-x-integration-test because they're skipped if datastore-integration-test fails.

atierian avatar May 27 '22 13:05 atierian

Analytics integration tests updated and passing.

phantumcode avatar May 27 '22 18:05 phantumcode

This PR https://github.com/aws-amplify/amplify-ios/pull/1940 sets up a way to canary the failing tests, without impacting the entire workflow. I've enabled the geo and analytics integ tests to fail the workflow if they fail

lawmicha avatar Jun 22 '22 15:06 lawmicha

The tests has been fixed as part of Amplify 2.0 release.

harsh62 avatar Nov 02 '22 16:11 harsh62