lingvo icon indicating copy to clipboard operation
lingvo copied to clipboard

Published 20 hours ago • verified publisher icon tensorflow

DeepFusion network structure

Open faikit opened this issue 3 years ago • 1 comments

Hi,

we are trying to reproduce the result, but quite a lot details are missing of the DeepFusion netwrok. Can you describe some details of the network? Like in which stages fuse the point cloud and image, and etc.

faikit avatar May 03 '22 10:05 faikit

We just released the code. You could start to read the code from here: https://github.com/tensorflow/lingvo/blob/master/lingvo/tasks/car/params/waymo_deepfusion.py#L797

You could look at MultiModalFeaturizer to know the fuse stage: https://github.com/tensorflow/lingvo/blob/6b75b054aa78b0db3adebd564ee21ba1afff86fd/lingvo/tasks/car/deep_fusion.py#L76

LiYingwei avatar Jun 22 '22 02:06 LiYingwei