dbeam
dbeam copied to clipboard
spotify
DBeam exports SQL tables into Avro files using JDBC and Apache Beam
Bumps [com.fasterxml.jackson:jackson-bom](https://github.com/FasterXML/jackson-bom) from 2.17.0 to 2.17.1. Commits 50ab40a [maven-release-plugin] prepare release jackson-bom-2.17.1 38201de Prepare for 2.17.1 release 4d2e95a Back to snapshot deps 3f7a9ee [maven-release-plugin] prepare for next development iteration See...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps com.google.apis:google-api-services-cloudkms from v1-rev20240219-2.0.0 to v1-rev20240425-2.0.0. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a...
[//]: # (dependabot-start) ⚠️ **Dependabot is rebasing this PR** ⚠️ Rebasing might not happen immediately, so don't worry if this takes some time. Note: if you make any changes to...
Print user-provided Avro schema to a log. ## Unit-tests to illustrate existing issues when incorrect user-supplied Avro schema is used. #579 ### Testing * "Unit tests are included" ## Checklist...
Bumps nexus-staging-maven-plugin from 1.6.8 to 1.6.13. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) You can trigger a rebase of this PR by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- Dependabot commands...
Creates an Avro schema with a field `type` instead of `[null, type]` for SQL column with `NOT NULL` constrain. Configurable behaviour. ## Checklist for PR author(s) - [x] Changes are...
This PR is meant to be a solution for issue #579 . Also make a schema generation process less dependant on a user-provided schema and more fault-tolerant. ## Current implementation...
We do a DB table dump daily and would like to include partition date's data or earlier (but not later), so DB dumps are actually reproducible/deterministic. So, is it possibe...
