Machine Learning

1 readers

1 users here now

Community Rules:

Be nice. No offensive behavior, insults or attacks: we encourage a diverse community in which members feel safe and have a voice.
Make your post clear and comprehensive: posts that lack insight or effort will be removed. (ex: questions which are easily googled)
Beginner or career related questions go elsewhere. This community is focused in discussion of research and new projects that advance the state-of-the-art.
Limit self-promotion. Comments and posts should be first and foremost about topics of interest to ML observers and practitioners. Limited self-promotion is tolerated, but the sub is not here as merely a source for free advertisement. Such posts will be removed at the discretion of the mods.

founded 1 year ago

MODERATORS

communick@academy.garden

[D] How can you add additional features/attributes while doing instance segmentation? (alien.top)

submitted 1 year ago by phillylovesdata@alien.top to c/machinelearning@academy.garden

2 comments fedilink hide all child comments

I want to do an instance segmentation of objects in images.

Usually I would stick to something like an Mask R CNN and let it run. However additionally to the image itself and the pre-labeled images, I have additional features that might be interesting for the segmentation.

Example: I want to segment certain products in images from a factory and I have additional information about the products than run at a specific time (like product family, color, brand, etc.).

How do I add these additional features in an instance segmentation?

you are viewing a single comment's thread
view the rest of the comments

[–] Icko_@alien.top 1 points 1 year ago

You could just add an extra channel with the extra information. E.g. you want to use a pretrained model. You take (and freeze) everything but the last few layers. Let's say the frozen model reduces the image to 224x224x100. Just add a few more channels (with constant value for all pixels), e.g. 10 channels for color, 20 for product type, etc. This will work if the you have training data. If not, maybe something like what u/saintshing said might be the way to go.