DIM
DIM copied to clipboard
rdevon
Deep InfoMax (DIM), or "Learning Deep Representations by Mutual Information Estimation and Maximization"
Hi. As can be seen in paper, the prior matching is a bi-level optimization problem. For params of encoder, we should maximize the objective, while we should minimize it for...
Hi Dr, I've cloned your repo and although i've cloned cortex-dev branch I get ``` Could not find a version that satisfies the requirement cortex==0.13a0 (from cortex-DIM==0.13) (from versions: 0.1a0,...
Hi, I got a TypeError when I run the main.py, the message is this, and my workdir is E:\pythonProjectTorch/DIM, Traceback (most recent call last): File "E:/pythonProjectTorch/DIM/scripts/main.py", line 70, in controller...
Dear Professor R Devon Hjelm, Is the mutual information between inputs and global representations constant, since the network is deterministic? If so, how to understand the mutual information used in...
 I don not understand the reason that you utilize the [softplus function] for mutual information calculation. Can you give me a clear explanation? Thanks.
Traceback (most recent call last): File "scripts/main.py", line 66, in run(controller) File "/home/py/miniconda3/envs/DIM/lib/python3.6/site-packages/cortex/main.py", line 38, in run data.setup(**exp.ARGS['data']) File "/home/py/miniconda3/envs/DIM/lib/python3.6/site-packages/cortex/_lib/data/__init__.py", line 69, in setup plugin.handle(source, **data_args_) File "/home/py/miniconda3/envs/DIM/lib/python3.6/site-packages/cortex/built_ins/datasets/torchvision_datasets.py", line 85,...
hello! thanks for your great repo. I followed all instructions and made a new conda environment specific to this code. I'm not sure why but it seems to fail on...
Is there any way to use your codes for finding mutual information between two images?
Thank you very much for your interesting work and releasing the code, much appreciated !! I am implementing several manifold learning methods (from 64x64 images to 3D) that includes a...
Hi, thank you for your interesting DIM model and the open-source code. However, I am confused about the realization of prior matching part https://github.com/rdevon/DIM/blob/bac4765a8126746675f517c7bfa1b04b88044d51/cortex_DIM/models/discriminator.py#L62 It seems that GAN is used...
