vscode-dvc icon indicating copy to clipboard operation
vscode-dvc copied to clipboard

Incorrect display smooth feature

Open SoyGema opened this issue 1 year ago • 15 comments

CONTEXT : Neural Machine Translation training scenario.

  • VSCode version 1.7.8
  • DVC Version 2.56.0
  • DVC VSCode extension Version 0.8.7

The smoothing feature shows two lines instead of one. The thicker green line should be transformed as the UI smoothing basr is moving through the bar but it´s not.

https://user-images.githubusercontent.com/24204714/236618849-5b88dd69-e1ae-4f40-a9ee-2993ac6248c6.mp4

From conversation in Discord

Increasing plot size test seems to have the same issue increasingplotsize

Machine Learning Epicstemics coming from the conversation in discord

The signal or number of datapoints can increase significantly when we change the batch size parameter during experiments : batch size controls the accuracy of the estimate of the error gradient when training Neural Networks. Too large batch sizes -less data points- may cause bad generalization. Many data points (smaller batch sizes ) take more training time but might have better generalization.

Iterating over this parameter can be a common case of experimentation scenario.

NOTE for machine learning practitioners: this parameter starts with 8 and increases by powers of 2. Experimenting with this parameter is key for better generalization by having other rational hypotheses in mind. This article gives good hints.

For developers

  • Test smoothing Scaling with respect XY axis ? Maybe might work changing the range and linearly interpolating in between values ?

Nice work !

SoyGema avatar May 06 '23 11:05 SoyGema