Edmondo Porcu

Results 89 comments of Edmondo Porcu

@tdas this works only locally, as the major blocker on CI is the worker type that GitHub provides (https://docs.github.com/en/actions/using-github-hosted-runners/about-github-hosted-runners#supported-runners-and-hardware-resources). 2 Core, 7GB of ram are really small to compile large...

1. Implemented 2. Automatically done by SBT, see below 3. Not much of a difference because the hosted runner from GitHub are single core and 7GB of ram. We could...

Some useful metrics trying with 8 cores: ``` ➜ delta git:(issue-1128) ✗ export TEST_RUN_IN_PARALLEL=TRUE ➜ delta git:(issue-1128) ✗ export TEST_PARALLELISM_COUNT=8 ➜ delta git:(issue-1128) ✗ sbt test > highparallelism.log ➜ delta...

> Hey @edmondo1984 . Thank you for answering my questions and all the updates. Most of the changes look good. except the need for two env variables. Just trying to...

> > I think larger workers are more user friendly than breaking down the tests into splits in the CI/CD pipeline, what do you think? > > I agree that...

Do you think that preserving the case should be enabled by default and there should be an option to switch it off? How about a flag that is mandatory if...

Yes, can you assign the issue to me @zsxwing ?

@tdas one possible solution is to split the test in N partitions and execute them sequentially on separate JVM, would it be ok? An higher speed can certainly be achieved...

@scottsand-db I had a look at the RunnableCommand and I hadn't grasped the meaning of the returned row. If I understood it correctly, this change should be sufficient. https://github.com/edmondo1984/delta/commit/17998f4ca58f98fe808ce68114a44349ea345966 I...

@wjones127 can you give me a feedback on https://github.com/edmondo1984/delta-rs/commit/b524f66322a388fecb9670a95676329fe9df567c as a starting point? I am a little confused since I found that the call to the catalog was actually within...