Shayekh Islam

New Language Support

1

I am interested in listing about the advancement in my native language 'Bengali'. Is it possible for me to join? Thanks.

High Memory & Disk Requirement for SMAC

1

By running `python -m examples.smac.generate_ant_data`, more than 70 GB is already consumed. What is the requirement for running SMAC? And how to reduce the memory footprint?

Physics GRE task added

7

This PR adds the [Physics GRE dataset](https://github.com/InflectionAI/Inflection-Benchmarks/tree/main?tab=readme-ov-file#physics-gre) released in the Public Inflection Benchmark by @InflectionAI. Please refer [here](https://github.com/ShayekhBinIslam/lm-evaluation-harness/tree/physics_gre/lm_eval/tasks/physics_gre) for the details. It solved the issue #1554.

DoRA support for Embedding

3

### Feature request Supporting DoRA with Embedding to allow seamless integration with the LoRA framework. ### Motivation I need to finetune a model where additional tokens have to be trained....

Support for the `Embedding` module

1

DoRA is not currently supported when new tokens are added and embedding layer needs to be retrained. Is there any solution?

Hi, Is it possible to provide the processed input data after [the data preparation step 1](https://github.com/AkariAsai/self-rag/blob/main/data_creation/generator/README.md#process-input-data)? We need to run directly [the step 2](https://github.com/AkariAsai/self-rag/blob/main/data_creation/generator/README.md#critic-evaluation-retrieval-tokens). It would be helpful if you...

Code for WebShop Benchmark

1

Will the WebShop code be available?

Is it possible to make the images available in the docker hub?

Is it possible to run any web-arena environments without using a "Pre-installed Amazon Machine Image", such as in Kubernetes? If yes, what are those environments?