Luís Bianchin
Luís Bianchin
Ah, interesting. Thanks for the clarification @jto ! In some cases, it would also be good to have these configurations defined in a file. Do you know a way to...
FYI internally in Spotify we have been hacking on `pipeline-config` project. It uses [HOCON configuration files](https://github.com/lightbend/config/blob/master/HOCON.md) to configure Beam's `PipelineOptions`. If we find that project valuable, we will consider in...
Now Beam 2.5.0 depends on `google-api-client:1.23.0`, see https://cloud.google.com/dataflow/docs/concepts/sdk-worker-dependencies. Is this still an issue?
_Here how I solved this, if others are looking:_ I used to use `ag` before and defined an alias in `bashrc`/`zshrc` to "invoke ag with less": ``` alias agl="ag --pager='less...
No plans yet. It would be nice if DBeam supported more flexible output formats. A few examples other than Avro could be: Parquet, CSV, Proto, ... DBeam is build on...
Great! Still, there can be the case of System properties being configured outside of the command line e.g. with `System.getProperties().setProperty()`. Maybe we don't have to fix for that, but at...
Yes. `--partitionColumn=col` is the way to do it. NO need for user-provided SQL. There are several examples internally in Spotify. I can show some examples, if needed.
Hi. Sorry it took me a while to get here, as I am putting little time on this project... Is this PR still relevant? It has some conflicts with the...
> I don't remember, but did you also try separating out the read and writes into two different DoFns? Does that move the thread management to Beam? I remember trying...
Thanks for raising this! There has been a PR https://github.com/spotify/dbeam/pull/32 , but it did not went further. I don't think there is any plan currently to add support for it....