David W. Romero

icon indicating a website link https://www.davidwromero.xyz icon indicating an email [email protected]

icon company NVIDIA icon location San Francisco icon location Research Scientist. PhD in Efficient Deep Learning.

Results 3 issues of David W. Romero

Error during backprop when bias=True in Mamba block

4 comment

Hi Albert & Tri, Awesome work! Thank you for sharing! I noticed a bug when using bias=True in a Mamba block. For example, using: ``` layer = Mamba( # This...

The link to the ShapeNet dataset does not show the structure you mention in DATASET.md

The dataset downloaded from the GoogleDrive link only contains the folder ShapeNet55/shapenet_pc . There are no train.txt / test.txt files. Can it be that the link is wrong?

[BUG] Residual VQ - self.embed.data[ind][mask] = sampled - RuntimeError: shape mismatch:

10 comment

Hi all, I noticed that using `ResidualVQ` as: ``` ResidualVQ( dim=Z_CHANNELS, # 512 num_quantizers=NUM_QUANTIZERS, # 2 codebook_size=CODEBOOK_SIZE, # 16 * 1024 stochastic_sample_codes=True, shared_codebook=True, commitment_weight=1.0, kmeans_init=True, threshold_ema_dead_code=2, quantize_dropout=True, quantize_dropout_cutoff_index=1, quantize_dropout_multiple_of=1, )...