LMDrive
LMDrive copied to clipboard
opendilab
[CVPR 2024] LMDrive: Closed-Loop End-to-End Driving with Large Language Models
Hi, thanks for your nice work. I have a question about reproducing the driving score shown in the paper. I run the evaluation with the following configurations: ``` preception_model =...
Hi, thanks for your excellent work and code release. According to the README file, it is required to update the scenario .json file and route .xml file accordingly. However, there...
论文4.2中提到，LLM生成必要的控制信号，并预测给定指令是否完成。但是我在代码中的leaderboard/team_code/lmdriver_agent.py里面，看到好像只有使用预测的waypoints进行导航，而并没有用到LLM预测的控制信号。 请问可以帮忙解释一下论文中LLM和控制信号的关系和起到的作用吗？我一开始以为是LLM和其他模态输入之后直接生成控制信号控制车辆运动。
I want to transform the 3d_bbs to 2D bounding boxes of the each frame, but I can't get extrinsic matrix of the sensor. Can you offer some suggestions for me...
Hi! How to convent Instruction codes such as "Follow-03-s1" to natural Language?
dataset
请问下载数据集一直卡在这里是正常的吗，已经卡好几天了  我是在openxlab下载的。
Hello, doctor Shao, wonderful work! may I ask if a 24GB 3090 GPU can handle the Vision encoder pre-training and Instruction finetuning? thank you!
Hi! Much appreciated for the excellent work! When doing instruction finetuning, I encountered an error: ------------------------ WARNING:root:Pytorch pre-release version 1.14.0a0+410ce96 - assuming intent to test it /usr/local/lib/python3.8/dist-packages/diffusers/models/cross_attention.py:30: FutureWarning: Importing from...
Hi! I have 2 questions about evaluation. I'd be grateful for you help. 1. Where to set directory of dataset before evaluation? 2. When running to the following code, the...
Hi, team. Thanks for releasing the exceptional work. I try to evaluate the released model (llava-v1.5) on town05 long benchmark (with leaderboard/data/evaluation_routes/routes_town05_long.xml), and sadly observe that the results are significantly...
