sonnet

sonnet copied to clipboard

Hi, It seems `updated_ema_cluster_size` in `VectorQuantizerEMA` use small epsilon to avoid zero in denominator, but the formula is strange to me, so can you explain the logic here, and why...

wztdream

Cannot install sonnet on mac m1

5

I install dm-sonnet and I see: Requirement already satisfied: sonnet in ``` /Users/maryamkia/Homebrew/Caskroom/miniforge/base/envs/pytorch_x86/lib/python3.8/site-packages (0.1.6) Requirement already satisfied: networkx==1.8.1 in /Users/maryamkia/Homebrew/Caskroom/miniforge/base/envs/pytorch_x86/lib/python3.8/site-packages (from sonnet) (1.8.1) ``` Note: you may need to restart...

maryamastero

` attention_mlp = basic.BatchApply( mlp.MLP([self._mem_size] * self._attention_mlp_layers))` `for _ in range(self._num_blocks): attended_memory = self._multihead_attention(memory)` shouldnt it be this `attended_memory = memory` `for _ in range(self._num_blocks):` `attended_memory = self._multihead_attention(attended_memory)` i know...

ava6969

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.5.1 to 2.7.2. Release notes Sourced from tensorflow's releases. TensorFlow 2.7.2 Release 2.7.2 This releases introduces several vulnerability fixes: Fixes a code injection in saved_model_cli (CVE-2022-29216) Fixes...

dependabot[bot]

Spectral Normalisation for ConvND Layers

3

Hi, I'm trying to do Spectral Norm for 2D and 3D convolutional layers. I found the code for a spectral normaliser in [this notebook](https://github.com/deepmind/sonnet/blob/v2/examples/little_gan_on_mnist.ipynb) but it isn't quite working for...

txir-met

Make tf.Variable a CompositeTensor.

copybara-service[bot]

Hi, I am trying to write a gan with a convnet component with sonnet. This is my base Conv function (there's some extra functionality to it but I'm trying to...

txir-met

how to remove model from gpu memory？

1

I have model_a and model_b, is there any elegant way to remove model_a from gpu memory after i copy weights from model_a to model_b. Except for save and reload from...

xfchen0912

Module not found `sonnet`

1

Hi, after installing sonnet and tensorflow I'm getting the Module not found `sonnet` error. I'm using ``` dm-sonnet 1.36 tensorflow 2.8.0 tensorflow-estimator 1.15.1 tensorflow-gpu 1.15.5 tensorflow-io-gcs-filesystem 0.24.0 tensorflow-probability 0.8.0 ```

AnaRhisT94

Is there any convenient way to do spectrum normalization? (Sonnet version: 2.0.0)

3

Dear Deepminder: For generative adversarial network, there introduces a normalization called spectrum normalization (ref: https://arxiv.org/abs/1802.05957). However I find according to the knowledge of me, it is a little hard for...

isletennos