OfflineRL

OfflineRL copied to clipboard

1. 建议setup.py的install_requires将'sklearn'换成'scikit-learn'，只安装sklearn的话，在data.py的from sklearn.preprocessing import MinMaxScaler步骤会报错。
2. evaluation/neorl.py中的test_on_real_env函数中有判断：if "sp" or "sales" in env._name，但是d4rl环境似乎没有_name属性，会报错。
3. ray==1.2版本报错： Traceback (most recent call last): File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 323, in <module> loop.run_until_complete(agent.run()) File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 138, in run modules = self._load_modules() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/agent.py", line 92, in _load_modules c = cls(self) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/new_dashboard/modules/reporter/reporter_agent.py", line 72, in __init__ self._metrics_agent = MetricsAgent(dashboard_agent.metrics_export_port) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/metrics_agent.py", line 74, in __init__ prometheus_exporter.new_stats_exporter( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 333, in new_stats_exporter exporter = PrometheusStatsExporter( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 266, in __init__ self.serve_http() File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/ray/prometheus_exporter.py", line 320, in serve_http start_http_server( File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/prometheus_client/exposition.py", line 169, in start_wsgi_server TmpServer.address_family, addr = _get_best_family(addr, port) File "/home/luofm/Utils/pyenv/offlinerl/lib/python3.8/site-packages/prometheus_client/exposition.py", line 158, in _get_best_family infos = socket.getaddrinfo(address, port) File "/usr/lib/python3.8/socket.py", line 918, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): socket.gaierror: [Errno -2] Name or service not known 以上报错在ray==1.5.0版本依然存在，但是在ray==1.0.0版本不存在。

---

OfflineRL 版本: 08f51b59e316c8ab7755f0334cb7cdd4d4245d30 系统 Ubuntu 20.04.1 LTS x86_64 python==3.8.10 运行的命令：

python examples/train_d4rl.py --algo_name=mopo --exp_name=d4rl-halfcheetah-medium-mopo --task d4rl-halfcheetah-medium-v2