Machine Learning

1 readers

1 users here now

Community Rules:

Be nice. No offensive behavior, insults or attacks: we encourage a diverse community in which members feel safe and have a voice.
Make your post clear and comprehensive: posts that lack insight or effort will be removed. (ex: questions which are easily googled)
Beginner or career related questions go elsewhere. This community is focused in discussion of research and new projects that advance the state-of-the-art.
Limit self-promotion. Comments and posts should be first and foremost about topics of interest to ML observers and practitioners. Limited self-promotion is tolerated, but the sub is not here as merely a source for free advertisement. Such posts will be removed at the discretion of the mods.

founded 1 year ago

MODERATORS

communick@academy.garden

[D] How can you add additional features/attributes while doing instance segmentation? (alien.top)

submitted 1 year ago by phillylovesdata@alien.top to c/machinelearning@academy.garden

2 comments fedilink hide all child comments

I want to do an instance segmentation of objects in images.

Usually I would stick to something like an Mask R CNN and let it run. However additionally to the image itself and the pre-labeled images, I have additional features that might be interesting for the segmentation.

Example: I want to segment certain products in images from a factory and I have additional information about the products than run at a specific time (like product family, color, brand, etc.).

How do I add these additional features in an instance segmentation?

top 2 comments

sorted by: hot top controversial new old

[–] saintshing@alien.top 1 points 1 year ago

additional information about the products than run at a specific time (like product family, color, brand, etc.).

Seems easier to just search for images based on the additional information and then train on those images. You would have to first predict the brand(which again requires you to extract visual features from product images of that brand) and maybe do ocr(slow) and use that to filter region proposal.

[–] Icko_@alien.top 1 points 1 year ago

You could just add an extra channel with the extra information. E.g. you want to use a pretrained model. You take (and freeze) everything but the last few layers. Let's say the frozen model reduces the image to 224x224x100. Just add a few more channels (with constant value for all pixels), e.g. 10 channels for color, 20 for product type, etc. This will work if the you have training data. If not, maybe something like what u/saintshing said might be the way to go.