datafusion-ballista Streamline github actions

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

Github actions look very busy, and repeatable (multiple actions do same check), on top of that they need 25+ mins to finish. rust compilation is done in dedicated rust container.

There is no clean difference between "Test Workspace ..." & "Test Ballista" ...

Also, some of the actions are complaining about deprecations.

Describe the solution you'd like

streamline and modernise github actions file, use github action for rust setup, build caching ... . remove options which are not used anymore.

Describe alternatives you've considered

Additional context

Nov 23 '24 14:11 milenkovicm

Nov 23 '24 15:11 milenkovicm

there is #703 which is asking same

Apr 18 '25 18:04 milenkovicm

I can give this a try, but do we have any idea of what an ideal workflow should be? For example. datafusion Rust workflow also takes 25-30min to complete: https://github.com/apache/datafusion/actions/workflows/rust.yml

Jun 16 '25 23:06 Huy1Ng

DataFusion has much more tests. I'm open for suggestions, my main concern with current state of git actions is that they may be quite few repeated steps.

Jun 17 '25 20:06 milenkovicm

There is ongoing effort in DataFusion to speed up the build https://github.com/apache/datafusion/issues/13813

Jul 20 '25 06:07 milenkovicm

Im closing this as @Huy1Ng did good job on it. We can open new issue if we want further improvements

thanks @Huy1Ng

Jul 30 '25 09:07 milenkovicm