Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how does the fisheye camera trigered by lidar? #123

Open
ZOUYIyi opened this issue Jun 21, 2024 · 4 comments
Open

how does the fisheye camera trigered by lidar? #123

ZOUYIyi opened this issue Jun 21, 2024 · 4 comments

Comments

@ZOUYIyi
Copy link

ZOUYIyi commented Jun 21, 2024

in the nuscence dataset , the camera is triggered when the lidar sweeps the center of the camera FOV.
is it the same case for the fisheye camera in this dataset ?
but the fisheye camera has big FOV, so even it is tiggered like this , the lidar points which projected to the left part of image have big timestamp diffrence than the lidar points which projected to the right part of image.
how to solve this ?
or it just interpolation the moving obj box ,so dont consider about the points projected to the image ?

@yiyiliao
Copy link
Collaborator

All the cameras are triggered at the same time when the laser faces forward.

When projecting lidar points to the cameras, you need to unwarp the LiDAR points to compensate for ego-motion. You can find scripts here:
https://github.com/autonomousvision/kitti360Scripts/blob/master/kitti360scripts/viewer/kitti360Viewer3DRaw.py#L132-L139

@ZOUYIyi
Copy link
Author

ZOUYIyi commented Jul 12, 2024

All the cameras are triggered at the same time when the laser faces forward.

When projecting lidar points to the cameras, you need to unwarp the LiDAR points to compensate for ego-motion. You can find scripts here: https://github.com/autonomousvision/kitti360Scripts/blob/master/kitti360scripts/viewer/kitti360Viewer3DRaw.py#L132-L139

for static objects ,it works fine ,but for the moving objects , the compensate cant work , the points in the moving object cant project to the right pixel of the image , how to solve this problem?

@ZOUYIyi
Copy link
Author

ZOUYIyi commented Jul 12, 2024

anyone have the project image to check if the moving object points cant project right?

@yiyiliao
Copy link
Collaborator

Indeed, for dynamic objects, there is no trivial solution to solve this problem..

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants