FEDOT
FEDOT copied to clipboard
aimclub
Bagging method implementation to FEDOT
~~Adding an ensemble (stacking and bagging) operations to FEDOT~~ UPD: The main task was reformulated and divided into small tasks. In this PR is solving one from this tasks, more specifically bagging implementation.
Implementation: bagging method from sklearn to FEDOT multi-layer stack ensembling + n-repeated k-fold bagging method for boosting methods
Minor changes: Added ExtraTrees models to FEDOT
Codecov Report
Merging #1005 (2a12f83) into master (17b2ecd) will increase coverage by
9.26%. Report is 8 commits behind head on master. The diff coverage is95.00%.
:exclamation: Current head 2a12f83 differs from pull request most recent head 2049f0e. Consider uploading reports for the commit 2049f0e to get more accurate results
@@ Coverage Diff @@
## master #1005 +/- ##
==========================================
+ Coverage 79.70% 88.97% +9.26%
==========================================
Files 141 133 -8
Lines 9851 9433 -418
==========================================
+ Hits 7852 8393 +541
+ Misses 1999 1040 -959
| Files | Coverage Δ | |
|---|---|---|
| ...ot/core/composer/gp_composer/specific_operators.py | 90.41% <100.00%> (+10.10%) |
:arrow_up: |
| fedot/core/data/data_split.py | 96.70% <100.00%> (+1.96%) |
:arrow_up: |
| ...ore/operations/evaluation/evaluation_interfaces.py | 90.26% <ø> (+4.42%) |
:arrow_up: |
| fedot/core/pipelines/tuning/search_space.py | 100.00% <ø> (ø) |
|
| fedot/core/operations/evaluation/bagging.py | 93.84% <93.84%> (ø) |
... and 97 files with indirect coverage changes
![codecov[bot] avatar](https://avatars.githubusercontent.com/in/254?v=4 "Published by a pub.dev verified publisher"){kind=small}
Hello @aPovidlo! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:
- In the file
fedot/core/data/data_split.py:
Line 31:15: F821 undefined name 'np' Line 32:18: F821 undefined name 'np' Line 33:20: F821 undefined name 'np' Line 69:59: F821 undefined name 'np' Line 70:58: F821 undefined name 'np' Line 100:44: F821 undefined name 'np' Line 124:19: F821 undefined name 'np'
- In the file
fedot/core/operations/evaluation/bagging_kfold.py:
Line 177:1: W391 blank line at end of file
- In the file
fedot/core/operations/evaluation/operation_implementations/models/bag_ensembles/bag_ensemble.py:
Line 1:1: F401 'copy' imported but unused Line 2:1: F401 'time' imported but unused Line 15:121: E501 line too long (122 > 120 characters) Line 135:121: E501 line too long (123 > 120 characters)
- In the file
fedot/core/operations/evaluation/operation_implementations/models/bag_ensembles/fold_fitting_strategy.py:
Line 172:26: W292 no newline at end of file
Line 3:1: F401 'lightgbm.LGBMClassifier' imported but unused Line 4:1: F401 'catboost.CatBoostClassifier' imported but unused Line 9:1: F401 'fedot.core.operations.evaluation.bagging_kfold.KFoldBaggingClassifier' imported but unused Line 10:1: F401 'fedot.core.pipelines.pipeline.Pipeline' imported but unused Line 13:1: F401 'fedot.core.repository.operation_types_repository.OperationTypesRepository' imported but unused Line 16:1: F401 'test.unit.pipelines.test_decompose_pipelines.get_classification_data' imported but unused Line 156:48: E261 at least two spaces before inline comment Line 161:52: E261 at least two spaces before inline comment Line 166:48: E261 at least two spaces before inline comment Line 171:48: E261 at least two spaces before inline comment Line 176:50: E261 at least two spaces before inline comment Line 181:48: E261 at least two spaces before inline comment Line 223:5: F841 local variable 'y_hat_m' is assigned to but never used Line 225:121: E501 line too long (129 > 120 characters) Line 244:30: W292 no newline at end of file Line 244:30: W292 no newline at end of file Line 244:30: W292 no newline at end of file
- In the file
fedot/core/pipelines/tuning/search_space.py:
Line 607:51: F821 undefined name 'np' Line 607:65: F821 undefined name 'np' Line 610:47: F821 undefined name 'np' Line 610:61: F821 undefined name 'np' Line 611:48: F821 undefined name 'np' Line 611:62: F821 undefined name 'np' Line 641:51: F821 undefined name 'np' Line 641:65: F821 undefined name 'np' Line 644:47: F821 undefined name 'np' Line 644:61: F821 undefined name 'np' Line 645:48: F821 undefined name 'np' Line 645:62: F821 undefined name 'np' Line 810:55: F821 undefined name 'np' Line 810:69: F821 undefined name 'np' Line 819:55: F821 undefined name 'np' Line 819:69: F821 undefined name 'np' Line 822:53: F821 undefined name 'np' Line 822:67: F821 undefined name 'np' Line 831:55: F821 undefined name 'np' Line 831:69: F821 undefined name 'np' Line 842:55: F821 undefined name 'np' Line 842:69: F821 undefined name 'np' Line 845:51: F821 undefined name 'np' Line 845:65: F821 undefined name 'np' Line 846:52: F821 undefined name 'np' Line 846:66: F821 undefined name 'np' Line 855:55: F821 undefined name 'np' Line 855:69: F821 undefined name 'np' Line 858:51: F821 undefined name 'np' Line 858:65: F821 undefined name 'np' Line 859:52: F821 undefined name 'np' Line 859:66: F821 undefined name 'np' Line 867:55: F821 undefined name 'np' Line 867:69: F821 undefined name 'np' Line 870:53: F821 undefined name 'np' Line 870:67: F821 undefined name 'np' Line 878:55: F821 undefined name 'np' Line 878:69: F821 undefined name 'np' Line 888:55: F821 undefined name 'np' Line 888:69: F821 undefined name 'np' Line 891:51: F821 undefined name 'np' Line 891:65: F821 undefined name 'np' Line 892:52: F821 undefined name 'np' Line 892:66: F821 undefined name 'np' Line 900:55: F821 undefined name 'np' Line 900:69: F821 undefined name 'np' Line 903:51: F821 undefined name 'np' Line 903:65: F821 undefined name 'np' Line 904:52: F821 undefined name 'np' Line 904:66: F821 undefined name 'np'
- In the file
fedot/preprocessing/data_types.py:
- In the file
test/unit/optimizer/gp_operators/test_mutation.py:
Line 249:1: W391 blank line at end of file
Comment last updated at 2023-09-21 15:22:57 UTC
-
Я мб пропустил, но где-то бэггинг мутация в процессе автоматической работы федота используется?
-
Для тестов стоит подобрать более простые модели или уменьшить значение параметров. Видимо долго работает
- Я мб пропустил, но где-то бэггинг мутация в процессе автоматической работы федота используется?
- Пока еще не добавлял ее в дефолтные мутации, или какие-либо параметры для запуска в автоматической режиме работы
- Для тестов стоит подобрать более простые модели или уменьшить значение параметров. Видимо долго работает
- Данная очевидность уже обсуждалась. Сейчас и так подобранны минимальные значения параметров. Хотелось бы проверять все модели, но возможно стоит ограничится только
'dt', т.к. раз на раз бывает превышения времени выполнения тестов
Hello @aPovidlo! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:
- In the file
fedot/core/operations/evaluation/operation_implementations/models/bag_ensembles/bag_ensemble.py:
Line 1:1: F401 'copy' imported but unused Line 2:1: F401 'time' imported but unused Line 26:121: E501 line too long (127 > 120 characters)
- In the file
fedot/core/operations/evaluation/operation_implementations/models/bag_ensembles/fold_fitting_strategy.py:
Line 7:1: F401 'joblib.cpu_count' imported but unused Line 78:62: F541 f-string is missing placeholders Line 183:26: W292 no newline at end of file
Line 3:1: F401 'lightgbm.LGBMClassifier' imported but unused Line 4:1: F401 'catboost.CatBoostClassifier' imported but unused Line 9:1: F401 'fedot.core.operations.evaluation.bagging_kfold.KFoldBaggingClassifier' imported but unused Line 10:1: F401 'fedot.core.pipelines.pipeline.Pipeline' imported but unused Line 13:1: F401 'fedot.core.repository.operation_types_repository.OperationTypesRepository' imported but unused Line 16:1: F401 'test.unit.pipelines.test_decompose_pipelines.get_classification_data' imported but unused Line 146:1: E303 too many blank lines (3) Line 156:48: E261 at least two spaces before inline comment Line 161:52: E261 at least two spaces before inline comment Line 166:48: E261 at least two spaces before inline comment Line 171:48: E261 at least two spaces before inline comment Line 176:50: E261 at least two spaces before inline comment Line 181:48: E261 at least two spaces before inline comment Line 223:5: F841 local variable 'y_hat_m' is assigned to but never used Line 225:121: E501 line too long (129 > 120 characters) Line 244:30: W292 no newline at end of file Line 244:30: W292 no newline at end of file Line 244:30: W292 no newline at end of file
- In the file
fedot/core/pipelines/tuning/search_space.py:
Line 607:51: F821 undefined name 'np' Line 607:65: F821 undefined name 'np' Line 610:47: F821 undefined name 'np' Line 610:61: F821 undefined name 'np' Line 611:48: F821 undefined name 'np' Line 611:62: F821 undefined name 'np' Line 641:51: F821 undefined name 'np' Line 641:65: F821 undefined name 'np' Line 644:47: F821 undefined name 'np' Line 644:61: F821 undefined name 'np' Line 645:48: F821 undefined name 'np' Line 645:62: F821 undefined name 'np' Line 810:55: F821 undefined name 'np' Line 810:69: F821 undefined name 'np' Line 819:55: F821 undefined name 'np' Line 819:69: F821 undefined name 'np' Line 822:53: F821 undefined name 'np' Line 822:67: F821 undefined name 'np' Line 831:55: F821 undefined name 'np' Line 831:69: F821 undefined name 'np' Line 842:55: F821 undefined name 'np' Line 842:69: F821 undefined name 'np' Line 845:51: F821 undefined name 'np' Line 845:65: F821 undefined name 'np' Line 846:52: F821 undefined name 'np' Line 846:66: F821 undefined name 'np' Line 855:55: F821 undefined name 'np' Line 855:69: F821 undefined name 'np' Line 858:51: F821 undefined name 'np' Line 858:65: F821 undefined name 'np' Line 859:52: F821 undefined name 'np' Line 859:66: F821 undefined name 'np' Line 867:55: F821 undefined name 'np' Line 867:69: F821 undefined name 'np' Line 870:53: F821 undefined name 'np' Line 870:67: F821 undefined name 'np' Line 878:55: F821 undefined name 'np' Line 878:69: F821 undefined name 'np' Line 888:55: F821 undefined name 'np' Line 888:69: F821 undefined name 'np' Line 891:51: F821 undefined name 'np' Line 891:65: F821 undefined name 'np' Line 892:52: F821 undefined name 'np' Line 892:66: F821 undefined name 'np' Line 900:55: F821 undefined name 'np' Line 900:69: F821 undefined name 'np' Line 903:51: F821 undefined name 'np' Line 903:65: F821 undefined name 'np' Line 904:52: F821 undefined name 'np' Line 904:66: F821 undefined name 'np'
- In the file
test/unit/optimizer/gp_operators/test_mutation.py:
Line 249:1: W391 blank line at end of file
