xiezhipeng-git
xiezhipeng-git
In sb3_examples/ppo.py It is other Bug. TypeError Traceback (most recent call last) /home/xzpwsl2/my/work/rlFrame/rl_frame/jorldy/test/cartpole_baseline.ipynb 单元格 10 line 1 [153](vscode-notebook-cell://wsl%2Bubuntu-22.04/home/xzpwsl2/my/work/rlFrame/rl_frame/jorldy/test/cartpole_baseline.ipynb#X12sdnNjb2RlLXJlbW90ZQ%3D%3D?line=152) print(f"Mean Reward: {mean_reward:.2f} +/- {std_reward:.2f}") [155](vscode-notebook-cell://wsl%2Bubuntu-22.04/home/xzpwsl2/my/work/rlFrame/rl_frame/jorldy/test/cartpole_baseline.ipynb#X12sdnNjb2RlLXJlbW90ZQ%3D%3D?line=154) # Test with Gym --> [156](vscode-notebook-cell://wsl%2Bubuntu-22.04/home/xzpwsl2/my/work/rlFrame/rl_frame/jorldy/test/cartpole_baseline.ipynb#X12sdnNjb2RlLXJlbW90ZQ%3D%3D?line=155)...
> 你确定这是一个pygame问题吗？每秒必须处理多少个键盘事件？我怀疑这可能会导致问题`render_mode="human"` > > 另外，为什么您不使用基于键盘的交互？`gym.utils.play` I'm not very sure, because I'm not sure if the WSL environment was also created by pygame. However, it seems that Gym recommends using "human"...
And use pymilvus has other error /home/xzpwsl2/.local/lib/python3.10/site-packages/requests/__init__.py:89: RequestsDependencyWarning: urllib3 (2.0.7) or chardet (3.0.4) doesn't match a supported version! warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported " RPC error:...
> Hi, we also observed some abnormal points in the results. Could you check them one by one? > > 1. The reward is always a negative number. Is this...
> @xiezhipeng-git Thank you for the wonderful experiments. It's like the LAMB optimizer can work with the 0.001 lr now, since the reward goes down to -140 (if I understand...
> @xiezhipeng-git I think that is just overfitting because 0.01 is a bit large (similar to [this figure](https://machinelearningmastery.com/wp-content/uploads/2018/11/Line-Plots-of-Train-and-Test-Accuracy-for-a-Suite-of-Learning-Rates-on-the-Blobs-Classification-Problem.png)). Optimization algorithms may differ in their best learning rates. BTW, could you...
use fairseq also need install apex ModuleNotFoundError: No module named 'apex' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "e:\study\machineStudy\project\My_matd3\my_matd3\MARL-code-pytorch\4.MADDPG_MATD3_MPE\MADDPG_MATD3_main.py", line 293, in...
@Trinkle23897 I would like to learn about other issues related to reset. Can the automatic reset function be manually turned off? Because the environment that you do not want to...
@Trinkle23897 Can you help me write the key code that can specify the control environment? Because I couldn't find the code to control the specified environment. Do you use env....
@Trinkle23897 def step( -- 222 | self, 223 | action: Union[Dict[str, Any], np.ndarray], 224 | env_id: Optional[np.ndarray] = None, Directly pass in the ID to be updated? env_id array?