Jincheng Dai

I meet the same problem, and I check the source code finally find that there's one more step to do ``` # iterate over mini-batches of data batch_itr = task.get_batch_iterator(...

I also think this issue makes sense cause many well-known SFT work like alpaca and vicuna exclude the prompt's loss. Anyway, it's an interesting thing to explore whether we should...

> Hi, I used huggyllama/llama-7b, but I encounterd the following errors when I try to run scripts/summarization/eval.sh: > > ``` > Traceback (most recent call last): > File "/data1/H2O-main/h2o_hf/run_summarization.py", line...

> Yes, I was using your `pred.py` to run the inference and evaluation. Acutally I also get the same result

I debug for two week and find that it's easy to figure out, simply set the `executable_path`, but note that you should set chromium path not your no local chrome...

I also have this problem, I fix this bug in 0.5.5 in BrowserSession ``` try: result = await perform_click(lambda: element_handle and element_handle.click(timeout=2_000)) await self._wait_for_stable_network() # 需要等网络完全正常才能更新整个browser_state的状态，否则会造成不同步 return result # return...