Philip May
Philip May
like this ``` # HELP smartctl_device_power_cycle_count Device power cycle count # TYPE smartctl_device_power_cycle_count counter smartctl_device_power_cycle_count{device="/dev/sda",model_family="Plextor M3/M5/M6 Series SSDs",model_name="PLEXTOR PX-128M6S",serial_number="P02448109994"} 572.0 smartctl_device_power_cycle_count{device="/dev/sdb",model_family="SandForce Driven SSDs",model_name="OCZ-VERTEX3",serial_number="A20Y8011312000361"} 1170.0 smartctl_device_power_cycle_count{device="/dev/sdc",model_family="Western Digital Red",model_name="WDC WD20EFRX-68EUZN0",serial_number="WD-WCC4M4VX3C69"} 146.0 smartctl_device_power_cycle_count{device="/dev/sdd",model_family="Western...
See here ```text /home/mike/.cache/huggingface/datasets/downloads/f12d10e84012b8e838b51ba4b122f22ffaecca1178a0925e88b8aefd5579c034 {'sentence1': '', 'sentence2': '', 'similarity_score': '1.2'} Traceback (most recent call last): File "x.py", line 5, in dataset = load_dataset('stsb_multi_mt', LANG, split='train') File "/home/mike/dev/fork/datasets/src/datasets/load.py", line 741, in...
When I install lighteval form main and call this command: ```bash accelerate launch --num_processes=1 run_evals_accelerate.py \ --model_args "vonjack/Phi-3-mini-4k-instruct-LLaMAfied" \ --tasks tasks_examples/open_llm_leaderboard_tasks.txt \ --override_batch_size 1 \ --use_chat_template \ --output_dir="./evals/" ``` I...
In this line a latex writer is created but never used later. Some functionality seems to be missing. https://github.com/huggingface/lighteval/blob/996b50427b136c347029f6ed1379a05250029c16/src/lighteval/evaluator.py#L143
## Describe the bug This is very similar or maybe the same as #211 . But I am writing a new issue because it is not related to Windows. I...
The error text is saying: > "Prompt input ids and answer input ids should have the same length." This is very misleading. The code does not compare prompt and answer...