Julien Richard-Foy

I agree that it would be good to have a way to signal to the user that the code did not compile (even better: report the compilation errors).

Thank you for your response. > If you run the same test several times, does it output consistent results? Yes it does. I also tried increasing the number of samples...

AFAIU, the exception you see in the logs (“Exception when trying to determine instance types java.nio.file.NoSuchFileException: /mnt/var/lib/info/job-flow.json”) is not a real issue. It happens because the library that we use...

The logic in emr-dynamodb-connector is pretty involved and it would be good to know better which parameters are significant. Maybe we should replace scanSegments with something else. @pdbossman are you...

> maybe we can take it from old audienceproject library, I remember seeing some logic around splits there From their README: > `readPartitions` number of partitions to split the initial...

They use [tableSizeBytes](https://sdk.amazonaws.com/java/api/latest/software/amazon/awssdk/services/dynamodb/model/TableDescription.html#tableSizeBytes()). But anyway, we are not using the audienceproject connector anymore.

@pdbossman Thank you for your feedback. I ran some investigations and the configuration logic for the Hadoop job is complicated. It turns out the table read throughput plays an important...

Thank you for your experiments @pdbossman. I can not reproduce your output even if I use the same config as you, though… See my logs: ~~~ text 24/04/29 06:25:19 WARN...

Hello @ricardoborenstein. We do support a `where` property in the configuration when migrating from a CQL-compatible source: https://github.com/scylladb/scylla-migrator/blob/95826a28b77de4870f91a2528bb1e2f2ba3cf7f5/config.yaml.example#L44-L45 Does that address your need? Do you need something similar for DynamoDB-compatible...

The next steps are the following: - [x] Review and merge https://github.com/scylladb/emr-dynamodb-connector/pull/1 - [x] Setup secrets to publish to Sonatype in https://github.com/scylladb/emr-dynamodb-connector - [x] Publish version 5.5.0 - [ ]...