sanjari-orb

How to support new ICL task types in own codebase

9

Hi, I want to add a custom ICL task type which corresponds to a new ICL metric in my codebase. Currently we have created our own patch of the training...

Allow multiprocessing when preparing ICL dataset

8

## 🚀 Feature Request Allow passing `num_proc`/`num_workers` parameter in`InContextLearningDataset` so that preparation of dataset can use more than one processes. ## Motivation When loading bigger ICL eval datasets, it is...

Need for resetting in run som scripts

2

Hi, I am looking at the scripts `run_reddit_som.sh, run_shopping_som.sh, run_classifieds_som.sh`. IIUC, they all involve creating batches of indices and the docker gets reset between each of these batches. https://github.com/web-arena-x/visualwebarena/blob/b56b6d821e0b0f926fb940a7efe7d3f1246eab36/scripts/run_reddit_som.sh#L21 However,...