exporters
exporters copied to clipboard
Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
Bumps the pip group with 6 updates in the / directory: | Package | From | To | | --- | --- | --- | | [pyyaml](https://github.com/yaml/pyyaml) | `3.11` |...
This PR adds a new formatter to format data in the [Avro](https://avro.apache.org/docs/1.2.0/) format, using [fastavro](https://github.com/tebeka/fastavro) as the backend. This format is designed to be parallelized. To allow for streaming write...
Added the new accepted parameters for [kafka-scanner version 0.3.4](https://github.com/scrapinghub/kafka-scanner/pull/8)
I was thinking on how help field in supported could be used, and I realized that having such an assistant would be really useful for users.
Adds support to define incompatibilities among modules.
We're hitting a bug with S3Reader that happens when files are big-ish destination is a bit slow. While it's uploading the file, it gets a connection reset ([in this suspicious...
Right now, the library base export manager only support one filter before transforming, and one filter after transforming. I think we should support list of filters both before and after...
We currently run exporters in Python 2 only. It would be nice to start running the tests in Python 3, ignoring the tests that aren't passing yet, as an initial...