SynapseML icon indicating copy to clipboard operation
SynapseML copied to clipboard

WIP: annual VW related improvements

Open eisber opened this issue 3 years ago • 49 comments

Summary

  • add support for One Against All #804
  • add support for VW command line style examples #1376
  • add support for inter-pass All Reduce synchronization (aka single pass per partition while synchronizing weights according to a user-specified schedule)
  • add support for Counter Factual Evaluation (CSE) for bandits.

Tests

some added.

Dependency changes

Updated to the latest VW binding (thanks @jackgerrits for pushing so hard)

AB#1890635

eisber avatar Jul 21 '22 11:07 eisber

/azp run

eisber avatar Jul 25 '22 07:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 25 '22 07:07 azure-pipelines[bot]

Codecov Report

Merging #1579 (2cca7d5) into master (01e31dc) will increase coverage by 0.02%. The diff coverage is 86.59%.

@@            Coverage Diff             @@
##           master    #1579      +/-   ##
==========================================
+ Coverage   86.77%   86.79%   +0.02%     
==========================================
  Files         277      295      +18     
  Lines       14725    15378     +653     
  Branches      759      780      +21     
==========================================
+ Hits        12777    13347     +570     
- Misses       1948     2031      +83     
Impacted Files Coverage Δ
...soft/azure/synapse/ml/core/utils/ClusterUtil.scala 68.49% <ø> (ø)
...re/synapse/ml/core/utils/ParamsStringBuilder.scala 90.69% <ø> (ø)
...crosoft/azure/synapse/ml/vw/HasSumCollisions.scala 100.00% <ø> (ø)
...m/microsoft/azure/synapse/ml/vw/VectorZipper.scala 100.00% <ø> (ø)
...crosoft/azure/synapse/ml/vw/VowpalWabbitUtil.scala 92.00% <ø> (ø)
...ft/azure/synapse/ml/vw/VowpalWabbitBaseSpark.scala 44.87% <44.87%> (ø)
...a/com/microsoft/azure/synapse/ml/vw/KahanSum.scala 52.94% <52.94%> (ø)
...re/synapse/ml/policyeval/CressieReadInterval.scala 81.11% <81.11%> (ø)
...t/azure/synapse/ml/vw/VowpalWabbitPrediction.scala 84.09% <84.09%> (ø)
.../azure/synapse/ml/vw/VowpalWabbitBaseLearner.scala 86.20% <86.20%> (ø)
... and 29 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

codecov-commenter avatar Jul 25 '22 08:07 codecov-commenter

/azp run

eisber avatar Jul 25 '22 10:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 25 '22 10:07 azure-pipelines[bot]

/azp run

eisber avatar Jul 25 '22 11:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 25 '22 11:07 azure-pipelines[bot]

/azp run

eisber avatar Jul 25 '22 11:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 25 '22 11:07 azure-pipelines[bot]

/azp run

eisber avatar Jul 25 '22 13:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 25 '22 13:07 azure-pipelines[bot]

/azp run

eisber avatar Jul 25 '22 15:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 25 '22 15:07 azure-pipelines[bot]

/azp run

eisber avatar Jul 25 '22 17:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 25 '22 17:07 azure-pipelines[bot]

/azp run

eisber avatar Jul 25 '22 18:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 25 '22 18:07 azure-pipelines[bot]

/azp run

eisber avatar Jul 25 '22 20:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 25 '22 20:07 azure-pipelines[bot]

/azp run

eisber avatar Jul 26 '22 06:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 26 '22 06:07 azure-pipelines[bot]

/azp run

eisber avatar Jul 26 '22 07:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 26 '22 07:07 azure-pipelines[bot]

/azp run

eisber avatar Jul 26 '22 07:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 26 '22 07:07 azure-pipelines[bot]

/azp run

eisber avatar Jul 26 '22 10:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 26 '22 10:07 azure-pipelines[bot]

/azp run

eisber avatar Jul 26 '22 10:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 26 '22 10:07 azure-pipelines[bot]

/azp run

eisber avatar Jul 26 '22 12:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 26 '22 12:07 azure-pipelines[bot]

/azp run

eisber avatar Jul 27 '22 23:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 27 '22 23:07 azure-pipelines[bot]

/azp run

eisber avatar Jul 28 '22 08:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 28 '22 08:07 azure-pipelines[bot]

/azp run

eisber avatar Jul 28 '22 09:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 28 '22 09:07 azure-pipelines[bot]

/azp run

eisber avatar Jul 28 '22 19:07 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Jul 28 '22 19:07 azure-pipelines[bot]

/azp run

eisber avatar Aug 10 '22 15:08 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Aug 10 '22 15:08 azure-pipelines[bot]

/azp run

eisber avatar Aug 10 '22 16:08 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Aug 10 '22 16:08 azure-pipelines[bot]

/azp run

eisber avatar Aug 10 '22 17:08 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Aug 10 '22 17:08 azure-pipelines[bot]

/azp run

eisber avatar Aug 10 '22 20:08 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Aug 10 '22 20:08 azure-pipelines[bot]

/azp run

eisber avatar Aug 16 '22 07:08 eisber

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Aug 16 '22 07:08 azure-pipelines[bot]