Shilong Deng

icon location London icon location UCL Computer Science | Deep Learning Huawei Noah's Ark Lab Research Intern Reinforcement Leaning Team

Results 3 issues of Shilong Deng

Auto-Configuration Error when run Bazel

3 comment

When I run the `bazel run -c opt :print_names_and_sources /tmp/dm-code_contests/code_contests_valid.riegeli`, an error occurred. ERROR: An error occurred during the fetch of repository 'local_config_cc': Traceback (most recent call last): File "/home/sameul/.cache/bazel/_bazel_sameul/25938179392971c8c07cd72c7f57c456/external/bazel_tools/tools/cpp/cc_configure.bzl",...

Change of model

1 comment

Hi, is it possible to change the structure of model instead of using the model provided in the library

help_wanted
discussion

Low loss but can't get the expected output during inference

Hi, I am training the LLaMa3 using the SFTtrainer to fit only one data point. The training arguments are shown below: `base_model = "meta-llama/Meta-Llama-3-8B" dataset = load_dataset("json", data_files="data.json", split="train") compute_dtype...