Get this error when running trainer.fit()

[rahzaazhar]

File "pyarrow\error.pxi", line 99, in pyarrow.lib.check_status pyarrow.lib.ArrowInvalid: GetFileInfo() yielded path 'C:/Users/azhar/ray_results/llm', which is outside base dir 'C:/Users/azhar/ray_results\llm'

I am running the notebook on a windows machine

[yashpaneliya]

I changed the directory path in RunConfig and it worked for me. Give your local directory path.

run_config = RunConfig(name="llm", checkpoint_config=checkpoint_config, storage_path=Path('./').resolve())

[jgtiu]

I also ran the notebook on a Windows machine. This worked for me:

run_config = RunConfig(
    name="llm", checkpoint_config=checkpoint_config, storage_path=os.path.join(os.path.expanduser("~"), "ray_results")
)