Owen Vallis

icon indicating a website link https://www.owenvallis.com/ icon indicating an email [email protected]

icon company @google icon location Works at Google. Anti-abuse, Research, Machine Learning, and Analytics, co-founder of Kadenze Inc., and Professor of Creative Technologies.

Results 78 comments of Owen Vallis

Google Summer of Code

Thanks for updating the loss. I meant to revert the changes to `pyproject.toml` but accidentally deleted the file. The change in the line-length was causing the Black formatting checks to...

Google Summer of Code

Looks like the Black and Isort formatting checks are failing for tensorflow_similarity/losses/multinegrank_loss.py. Otherwise looks good to go, thanks.

TPU Error while trying to train SimCLR contrastive model on Colab

I think it doesn't like the use of tf.range in the one_hot call. I could see where that would be stateful if if is implemented as a generator. Can you...

TPU Error while trying to train SimCLR contrastive model on Colab

Glad to hear you have a work around for now. I can run some TPU tests next week. If you can share your notebook, that would be super helpful. Thanks!

Implement SwAV for self-supervised learning

Great, thanks!

Incredible stuff and some comments

removing the 0.14 milestone as benchmarking will be done in an upcoming release.

Incredible stuff and some comments

Also, self-supervised algorithms will be included in 0.15 and are available on the development branch. We currently have support for SimCLR, SimSiam, and Barlow Twins and we are working on...

Look into adding soft KNN for monitoring during training

"As an analytical tool, it provides insights into the evolution of class similarity structures during learning"

How to do cross-modal retrieval?

This would similar to the [CLIP](https://github.com/openai/CLIP) model. We are looking to add an example notebook for this at some point.

Lifted Structured loss

Hi @abhisharsinha, that would be great! I started an implementation based on the one in tf addons: https://github.com/tensorflow/similarity/blob/new_losses/tensorflow_similarity/losses/lifted_struct_loss.py but I haven't checked it for correctness.