NotImplementedError: Loading a dataset cached in a LocalFileSystem is not supported. After solving the problem, datasets conflicted with rl4lms
An error was encountered “NotImplementedError: Loading a dataset cached in a LocalFileSystem is not supported”. Then I looked at the issues on github, and it seemed like they had only been discovered in the last few days. The solution on github is to update the datasets package. But updating datasets will conflict with rl4lms, rl4lms will roll back the version, and then report several variables defined as null error; Updating the rl4lms will roll back the datasets version with an error message: LocalFileSystem is not supported. Another way is to upgrade the package, pip install fsspec==2023.9.2, but this will also report an undefined variable. The undefined variables are selected_data, test_data, and so on.