Steffen Grohsschmiedt

Results 14 comments of Steffen Grohsschmiedt

I haven't looked closely at Dataproc's native autoscaler but supporting replacing our simple heuristic makes sense. It has been our overall strategy to fill in gaps and replace our tools...

We are currently stuck with the same issue. We currently configure the authorizer and the gateway by hand but we have to redo it every time we add a new...

You might be able to use the [MiniCluster](https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/CLIMiniCluster.html) to reproduce this. If that doesn't help then I should be able to give you access to my debug cluster if you...

Glad to hear you got it running. I understand the pain of getting this running all to well. It seems strange to me that it didn't get stuck right away...

Just tried with 0.9.2 and it got stuck as well. Maybe related to some Python dependencies that I have installed. I have the following in my debug setup: ``` (venv)...

I tried to reproduce it by locally installing Hadoop and succeeded. I also uploaded the parquet file I'm using in case it's related to the file. I used a fresh...

I tried a different parquet file to ensure it's not related to my data and it's still getting stuck. I tried using the Fare field from the Titanic dataset that...

I also tried upgrading my dependencies and that appears to have made a difference in terms of number of iterations. Before it was getting stuck after 5 to 15 iterations...