tensorboardX icon indicating copy to clipboard operation
tensorboardX copied to clipboard

Projector dose not load new data

Open mbenami opened this issue 6 years ago • 6 comments

Hi I try to use the example for using the tensorboard projector as in the
demo_embedding.py but

but the tensorboard doesn't load new data only if I stop it and relaunch it again (on the same folder ) I can see the new data

I'm trying to see the progress of the embedding cluster as the train goes

Thanks

mbenami avatar Dec 17 '18 15:12 mbenami

How do you add new data? Will the example work? https://github.com/lanpa/tensorboardX/blob/master/examples/demo_multiple_embedding.py

lanpa avatar Dec 19 '18 14:12 lanpa

Same here, it doesn't refresh automatically and I have to restart tensorboard to get the new global_step that I added.

Timonzimm avatar Feb 15 '19 08:02 Timonzimm

Can confirm this also happens when adding new runs.

LemonPi avatar Jun 28 '19 21:06 LemonPi

This requires a big rewrite to fix.

A quick fix would be adding return True in ~/anaconda3/envs/pytorch_dev/lib/python3.7/site-packages/tensorboard/plugins/projector/projector_plugin.py

def _latest_checkpoints_changed(configs, run_path_pairs):
  return True
  """Returns true if the latest checkpoint has changed in any of the runs."""

lanpa avatar Jul 13 '19 06:07 lanpa

Same here tensorboard 2.2.1 tensorboardX (Version: 2.0+9d26706) any update? I try the workaround.. didn't help me

mbenami avatar May 21 '20 20:05 mbenami

Hey, is there any workaround for this? Restarting tensorboard does work but it's quite a hassle if I am running something on a remote server.

MukundVarmaT avatar Oct 26 '20 07:10 MukundVarmaT