BigDL-2.x
BigDL-2.x copied to clipboard
Chronos: Move `orca.automl.metrics` to `Chronos`
- Since
orca.automl
is used for customized model for any area, while most of the metrics inorca.automl.metrics
is designed and optimized for time series tasks. - The built-in metrics in
orca.automl
can be a simple map between string andsklearn.metrics
- This will help
Chronos
to be self-contained.
Since in ·orca.automl·, AutoXGBoost
also uses metrics
, it might not be convenient to directly move metrics
from orca
to chronos
.Otherwise, orca
need depend on chronos
.
For chronos
, in the cases of
-
Single node acceleration with
nano
: we could directly useTorchMetrics
inpytorch-lightning
, which might also be more efficient regarding both performance and memory. -
Distributed training or distributed tuning, both of which will depend on
orca
and could choose to usemetrics
inorca.automl
.
[TBD]However, we might move metrics
to nano
, since it is for single node only...