Marc Romeyn

icon indicating an email [email protected]

icon company NVIDIA icon location Netherlands icon location ML-engineer @NVIDIA. Working on https://github.com/NVIDIA/NeMo, open-source library to train LLMs with trillion of parameters. Ex. @spotify

Results 37 issues of Marc Romeyn

[Task] Improve negative sampling for retrieval

4 comment

## Problem: There is a considerable amount of tech-debt in the code that’s responsible for negative sampling in retrieval. The biggest issue is that it relies heavily on the model-context,...

roadmap

Port SoftEmbedding to features-API in tf

1 comment

Currently blocked by #52.

area/tensorflow
area/tests
area/api

Port TabularLayerNorm from PyTorch to TF

Port the [TabularLayerNorm ](https://github.com/NVIDIA-Merlin/Transformers4Rec/blob/538fc54bb8f2e3dc79224e497bebee15b00e4ab7/transformers4rec/torch/tabular/transformations.py#L90)from PyTorch to TF

good first issue
area/tensorflow
P1

Create Sequential-prediction head & integrate default heads with sequential models for tf

Currently blocked by #51.

area/tensorflow
P0
area/api

Add basic testing for torch.aggregator & tf.aggregator

This ticket includes the 3 basic aggregators we support for non-sequential data: - [ ] ConcatFeatures - [ ] StackFeatures - [ ] ElementwiseSum

area/tensorflow
P0
area/pytorch
area/tests

First pass over moving transformation-layers to sub package

1 comment

Fixes # (issue) ### Goals :soccer: ### Implementation Details :construction: ### Testing Details :mag:

Rename BatchedDataset to Loader

5 comment

### Goals :soccer: To prepare for migrating to our new dataloaders package, this PR renames `BatchedDataset` to `Loader` since that will be the new name. This PR also exposes the...

chore

Tf/encoder

5 comment

Fixes # (issue) ### Goals :soccer: ### Implementation Details :construction: ### Testing Details :mag:

enhancement

[TASK] Add select_by_tag to ParallelBlock

We would like to add capabilities to a `ParallelBlock` to select sub-graphs. This can be useful for instance to select the `item-id` embedding-table from a `InputBlock`. Another instance where this...

[TASK] Add EncoderBlock

There’s a need to introduce a new concept: `Encoder` which is a block that encodes features into some representation. This class can be used for prediction but can’t be trained/evaluated...