gcs-tools
gcs-tools copied to clipboard
spotify
GCS support for avro-tools, parquet-tools and protobuf
STR: 1a. Install all latest (v0.2.2 on Aug 29) tools 1b. Or build latest master to parquet-cli-1.12.3.jar, proto-tools-3.21.1.jar, avro-tools-1.11.0.jar,magnolify-tools-0.4.8.jar 2. Run all of them using basic read command like `...
an example use case is inspecting the `pipelineUrl` file that Dataflow stages (which is a .pb file representing [org.apache.beam.model.pipeline.v1.Pipeline](https://github.com/apache/beam/blob/master/model/pipeline/src/main/proto/beam_runner_api.proto#L81)) to verify coders and transforms. It would just be a wrapper...
## About this PR 📦 Updates [com.google.protobuf:protobuf-java](https://github.com/protocolbuffers/protobuf) from `4.27.1` to `4.27.2` ## Usage ✅ **Please merge!** I'll automatically update this PR to resolve conflicts as long as you don't change...
## About this PR 📦 Updates [org.scalatest:scalatest](https://github.com/scalatest/scalatest) from `3.2.18` to `3.2.19` ## Usage ✅ **Please merge!** I'll automatically update this PR to resolve conflicts as long as you don't change...
## About this PR 📦 Updates * [org.apache.parquet:parquet-avro](https://parquet.apache.org) * [org.apache.parquet:parquet-cli](https://parquet.apache.org) * [org.apache.parquet:parquet-hadoop](https://parquet.apache.org) from `1.14.0` to `1.14.1` ## Usage ✅ **Please merge!** I'll automatically update this PR to resolve conflicts as...
## About this PR 📦 Updates [org.scalameta:scalafmt-core](https://github.com/scalameta/scalafmt) from `3.8.1` to `3.8.2` 📜 [GitHub Release Notes](https://github.com/scalameta/scalafmt/releases/tag/v3.8.2) - [Version Diff](https://github.com/scalameta/scalafmt/compare/v3.8.1...v3.8.2) ## Usage ✅ **Please merge!** I'll automatically update this PR to resolve...
## About this PR 📦 Updates * [com.fasterxml.jackson.core:jackson-annotations](https://github.com/FasterXML/jackson-annotations) * [com.fasterxml.jackson.core:jackson-core](https://github.com/FasterXML/jackson-core) * [com.fasterxml.jackson.core:jackson-databind](https://github.com/FasterXML/jackson-databind) from `2.15.4` to `2.18.0` ## Usage ✅ **Please merge!** I'll automatically update this PR to resolve conflicts as...