OpenMLDB icon indicating copy to clipboard operation
OpenMLDB copied to clipboard

feat: auto Feature Engineering

Open explcre opened this issue 1 year ago • 4 comments

  • What kind of change does this PR introduce? (Bug fix, feature, docs update, ...) 2022 gitlink code link Auto Feature Engineering.

  • What is the current behavior? (You can also link to an open issue here)

  • What is the new behavior (if this is a feature change)?

  • Developed an automated feature engineering pipeline, including feature generation and selection, based on AutoX and OpenMLDB sql with Python.
  • The program automatically generates sql query which meets OpenMLDB standard and get data from it through web request.
  • The data is transformed by OpenMLDB sql to get time series and statistics features, and then we select the most important k features based on some algorithms.

explcre avatar Aug 21 '22 15:08 explcre

Codecov Report

Base: 75.61% // Head: 75.60% // Decreases project coverage by -0.01% :warning:

Coverage data is based on head (34b3519) compared to base (ba29780). Patch has no changes to coverable lines.

Additional details and impacted files
@@             Coverage Diff              @@
##               main    #2381      +/-   ##
============================================
- Coverage     75.61%   75.60%   -0.02%     
  Complexity      392      392              
============================================
  Files           644      644              
  Lines        121410   121410              
  Branches       1060     1060              
============================================
- Hits          91807    91789      -18     
- Misses        29366    29384      +18     
  Partials        237      237              
Impacted Files Coverage Δ
...s/query_response_time/deploy_query_response_time.h 81.25% <0.00%> (-18.75%) :arrow_down:
...atistics/query_response_time/query_response_time.h 78.26% <0.00%> (-4.35%) :arrow_down:
src/rpc/rpc_client.h 85.13% <0.00%> (-4.06%) :arrow_down:
.../query_response_time/deploy_query_response_time.cc 97.10% <0.00%> (-2.90%) :arrow_down:
src/sdk/db_sdk.cc 66.14% <0.00%> (-0.45%) :arrow_down:
src/catalog/client_manager.cc 42.20% <0.00%> (-0.29%) :arrow_down:
src/nameserver/name_server_impl.cc 43.56% <0.00%> (-0.13%) :arrow_down:
src/client/tablet_client.cc 57.43% <0.00%> (-0.12%) :arrow_down:
src/tablet/tablet_impl.cc 62.65% <0.00%> (ø)
hybridse/src/vm/runner.cc 68.11% <0.00%> (+0.03%) :arrow_up:
... and 2 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

codecov[bot] avatar Aug 21 '22 15:08 codecov[bot]

Linux Test Report

568 tests   561 :heavy_check_mark:  26m 13s :stopwatch:   57 suites      7 :zzz:   51 files        0 :x:

Results for commit 34b35193.

:recycle: This comment has been updated with latest results.

github-actions[bot] avatar Aug 21 '22 16:08 github-actions[bot]

SDK Test Report

  83 files    83 suites   1m 44s :stopwatch: 174 tests 168 :heavy_check_mark: 6 :zzz: 0 :x: 220 runs  214 :heavy_check_mark: 6 :zzz: 0 :x:

Results for commit 34b35193.

:recycle: This comment has been updated with latest results.

github-actions[bot] avatar Aug 21 '22 16:08 github-actions[bot]

auto-fe is a tool? whether to move to openmldb_tool dir @vagetablechicken

dl239 avatar Sep 01 '22 08:09 dl239

auto-fe is a tool? whether to move to openmldb_tool dir @vagetablechicken

It will take so many dependencies. It' better to be a standalone project

vagetablechicken avatar Oct 11 '22 04:10 vagetablechicken