Maxim Martynov

Results 76 issues of Maxim Martynov

To suggest an idea or inquire about a new Message Broker supporting feature or any other enhancement, please follow this template: **Is your feature request related to a problem? Please...

enhancement

**Describe the bug** How `KafkaMessage` annotation should be used with `batch=True`? * using `batch=True` with `messages: list[KafkaMessage]` fails. * using `batch=True` with `message: KafkaMessage` got `body=[b"...", ...]`, but expected `body:...

bug

I've discovered that handling every row during write/read process leads calls for `DateTimeFormatter.ofPattern(...)`. This takes quite time. I've updated the code to parse pattern only once, then DataFrameWriter/DataFrameReader is created....

I'm trying to use this connector with Spark session created using `.master("local[2]")` to write data to GP in 2 parallel connections instead of just one. Unfortunately, I've got errors like:...

See #17 for more details. Replaces current logic of getting current host name and IP address with one used by Spark: https://github.com/apache/spark/blob/v3.5.4/core/src/main/scala/org/apache/spark/util/Utils.scala#L952-L989

I'm trying to use this connector to write data to GP table. GP segment hostnames cannot be resolved from my host, so I got an exception like: ``` java.net.UnknownHostException: my-gp-s084:...

By default on Linux machines hostname is just an alias for `localhost` address, set via `/etc/hosts`: ``` 127.0.0.1 localhost myhostname ``` Because of this, using Spark session with `.master("local[1]")` leads...

Using this connector with session created with `.master("local[1]")` hang because `sparkContext.getExecutorMemoryStatus()` always return 1, so `guess` is always 0, and while loop never ends. This was already reported in #14....

**Service Name** Reddit **URL to an example embed** iframe URL looks like: `https://embed.reddit.com/r/crystalgrowing/comments/1k33pyx/erythritol/?embed=true` Original post URL is `https://www.reddit.com/r/crystalgrowing/comments/1k33pyx/erythritol/`, so the only thing changed in post URL is actually a domain...

enhancement

Hi. I've rolled out new instance of API + web + db containers on a host using `./docker/up.sh`, and set up several Spark sessions & Airflow instances to send events...