mindsdb icon indicating copy to clipboard operation
mindsdb copied to clipboard

[New Integration]: AutoKeras

Open Davidnet opened this issue 3 years ago • 0 comments

Is there an existing integration?

  • [X] I have searched the existing integrations.

Use Case

AutoKeras is one of the battle tested automl frameworks defined by the Texas A&M lab, since the consideration that we can instantiate a model depending on the type of the schema of a given dataset, we propose adding the backend automl to explore the idea of custom automl frameworks

Motivation

Mindsdb automl framework could use a custom autokeras that can be speeded-up via XLA using jax.jit and this may gives us an idea of moving certain numerical operations to jax before converting to pandas dataframes. (also maybe removing the dependency of dask and using things like jax.pjit (parallel map and jit)

Implementation

In the same vein of lightwood and mlflow, we will define a handler autokeras_handler.py and instead of parallelizing with dask, maybe explore the idea of parallel with jax.pjit

Anything else?

PJIT: https://jax.readthedocs.io/en/latest/_modules/jax/experimental/pjit.html JAX: https://jax.readthedocs.io AutoKeras: https://github.com/keras-team/autokeras

Davidnet avatar Sep 02 '22 19:09 Davidnet