airbyte icon indicating copy to clipboard operation
airbyte copied to clipboard

✨Source Amazon SQS: Migrate Python CDK to Low code

Open btkcodedev opened this issue 1 year ago • 4 comments

What

Migrating Source Amazon SQS to Low-Code CDK

How

Developed using (Configuration Based Source) low-code CDK

Recommended reading order

  1. spec.yaml
  2. manifest.yaml
  3. schemas/*

🚨 User Impact 🚨

  • Migration to low-code

btkcodedev avatar Jul 09 '24 15:07 btkcodedev

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
airbyte-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jan 14, 2025 5:52pm

vercel[bot] avatar Jul 09 '24 15:07 vercel[bot]

Awaiting Creds

btkcodedev avatar Jul 16 '24 15:07 btkcodedev

Blocked due to unavailable credentials

btkcodedev avatar Aug 15 '24 16:08 btkcodedev

@btkcodedev rebase this, let's dust it off. Then, set metadata.releases.isReleaseCandidate = true and set the version in metadata and in dockerImageTag and in pyproject.toml to be whatever-rc1.

This will trigger a release candidate publish, and we'll proceed with the merge.

natikgadzhi avatar Oct 14 '24 02:10 natikgadzhi

@btkcodedev this is still important, but I'd say let's go all the way to Manifest-Only, even if there are custom components.

Builder supports custom components when running in abctl.

Do you have everything you need to work on this, or blocked?

natikgadzhi avatar Dec 03 '24 00:12 natikgadzhi

Hi @natikgadzhi, I was waiting for the creds for completely testing the migration. I'll dust and rebase! Lets gooo

btkcodedev avatar Dec 03 '24 02:12 btkcodedev

Taking this as priority

btkcodedev avatar Dec 05 '24 18:12 btkcodedev

This boto3 package is giving some headache. I'll try to reinvent the wheel, because the previous custom component that i made somehow seems to be broken after 4 months :P so that it could be completely configured with declarative manifest :)

btkcodedev avatar Dec 05 '24 19:12 btkcodedev

/format-fix

Format-fix job started... Check job output.

✅ Changes applied successfully. (78c6a2d223d1d3e20b68f6535388745a648e6efd)

btkcodedev avatar Dec 05 '24 20:12 btkcodedev

Yahoo! Reinventing wheel is success! Got the connection without any boto3 dependency image

btkcodedev avatar Dec 06 '24 22:12 btkcodedev

Currently, the test account has 0 messages, I've updated some specs and documentation, This PR would be a breaking change image

btkcodedev avatar Dec 06 '24 23:12 btkcodedev

/format-fix

Format-fix job started... Check job output.

✅ Changes applied successfully. (2518269d6dcddda2ff26297bd29dd2edee0eb5be)

btkcodedev avatar Dec 06 '24 23:12 btkcodedev

/format-fix

Format-fix job started... Check job output.

✅ Changes applied successfully. (f31ebc800e70f870e09868ca47b90cf357f91a50)

btkcodedev avatar Dec 09 '24 13:12 btkcodedev

/format-fix

Format-fix job started... Check job output.

✅ Changes applied successfully. (7dbe815806fe7fb616d7ac5c19527dcabfa284ff)

btkcodedev avatar Dec 09 '24 16:12 btkcodedev

Connection successfull in local, Waiting for maintainers to update CI creds

btkcodedev avatar Dec 12 '24 23:12 btkcodedev

Creds updated. @btkcodedev do you have task for this PR? Couldn't find on the board.

DanyloGL avatar Dec 17 '24 15:12 DanyloGL

The "PR" was only updated on board, I will update it as an issue. Thanks for the reminder! @DanyloGL

btkcodedev avatar Dec 17 '24 15:12 btkcodedev

Done & Done, Connection passed and checks cleared. Note: The MessageQueue is currently empty in the production account. A review is needed from breaking-change-reviewers. Thanks!

btkcodedev avatar Dec 17 '24 16:12 btkcodedev

Alright I'm tired of this one. @btkcodedev if you can resolve conflicts on this and make setup.py go away for good, I will yolo merge this. However MAYBE there was a manifest-only version of this? I'm lost.

natikgadzhi avatar Jan 14 '25 16:01 natikgadzhi

😂😂😂Again conflicts. @natikgadzhi Yes sir

btkcodedev avatar Jan 14 '25 17:01 btkcodedev

/format-fix

Format-fix job started... Check job output.

✅ Changes applied successfully. (64f7280cef1e93e981e933dc01e3fa4c0e4f95a1)

btkcodedev avatar Jan 14 '25 17:01 btkcodedev

@natikgadzhi It's ready to merge,

I'll make it manifest-only as soon as it's merged successfully.

btkcodedev avatar Jan 14 '25 18:01 btkcodedev