Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Instance Segmentation - Standard semantic ID only contains subset of objects #5842

Open
jokolaco opened this issue Oct 17, 2022 · 6 comments
Assignees

Comments

@jokolaco
Copy link

jokolaco commented Oct 17, 2022

According to the documentation " The R channel contains the standard semantic ID."
While this is true and working in the semantic segmentation case i noticed in the instance segmentation case
that e.g. cars are in the red channels 9,10,11 instead of only the 10th redchannel.

This makes it hard to access the segmented areas because they are not clearly living in one specific channel.
This is also the case for the "actor id" tagging.

Input:
586
Mask:
586_semseg

Redchannel:
9
InstanceSegmentation_Mask_r9
10
InstanceSegmentation_Mask0r10
11
InstanceSegmentation_Maskr11

CARLA version:
9.13 and latest night build, standard downloads from github and self compiled on Rocky Linux 8

Platform/OS:
Ubuntu 18 and Rocky Linux 8

@mozg1
Copy link

mozg1 commented Feb 16, 2023

Can the Instance Segmentation sensor finally be looked at for the next release, because it is simply not working according to the documentation. My thesis depends on this, thanks.

@JosenJiang
Copy link

JosenJiang commented Mar 2, 2023

Do you save instance segmentation image as JPG format? Please save it as PNG format. JPG is a lossy compression format, and some pixel's value will change when you save images as xx.jpg. PNG is lossless compression format.

@stale
Copy link

stale bot commented Jun 1, 2023

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the stale Issue has not had recent activity label Jun 1, 2023
@CaphalorAlb
Copy link

Do you save instance segmentation image as JPG format? Please save it as PNG format. JPG is a lossy compression format, and some pixel's value will change when you save images as xx.jpg. PNG is lossless compression format.

hey, I'm not sure how to do this properly, running into the same issue

this is what i'm using

image_pv_seg.save_to_disk(frame_path_seg + '.png')

@stale stale bot removed the stale Issue has not had recent activity label Nov 7, 2023
@CaphalorAlb
Copy link

According to the documentation " The R channel contains the standard semantic ID." While this is true and working in the semantic segmentation case i noticed in the instance segmentation case that e.g. cars are in the red channels 9,10,11 instead of only the 10th redchannel.

This makes it hard to access the segmented areas because they are not clearly living in one specific channel. This is also the case for the "actor id" tagging.

Input: 586 Mask: 586_semseg

Redchannel: 9 InstanceSegmentation_Mask_r9 10 InstanceSegmentation_Mask0r10 11 InstanceSegmentation_Maskr11

CARLA version: 9.13 and latest night build, standard downloads from github and self compiled on Rocky Linux 8

Platform/OS: Ubuntu 18 and Rocky Linux 8

did you ever find a solution for this? running into the same issue and i'm not sure how to work around it

@Blyron
Copy link
Contributor

Blyron commented Nov 6, 2024

Due to a contribution from @AreopagX Now the actor id generated by carla matches the instance segmentation one;
For docs check; https://carla.readthedocs.io/en/latest/ref_sensors/#instance-segmentation-camera
https://carla.readthedocs.io/en/latest/tuto_G_instance_segmentation_sensor/
https://carla.readthedocs.io/en/latest/tuto_D_create_semantic_tags/

Usually the id in red channel is Unreal generated actor id which differs from CARLA's. that's why everyobject can be shown in the red channel.

@Blyron Blyron self-assigned this Nov 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants