Using AI to analyze Labels

Hi,

I’ve seen apps like OFF are using AI in order to analyze the label of a product. I know that OFF can already read the ingredient list, but it could also be used to scan for labels like organic, veggie, vegan, weight, size, product name and vendor, nutri score etc.

That would probably make it so much easier to add products to the database and maybe the accuracy even increases.

I know that technology wise , it might be challenging, but maybe AI can help developing this AI feature :grinning_face_with_smiling_eyes:

1 Like

Hello!

We are actually already using some models to do labels / weight / ingredients extraction.

You can have a look at hunger.openfoodfacts.org for all the “games” we implemented using AI models.

Cheers!

1 Like

Great stuff!
How about adding some a mechanism to in order to earn points and badges for playing the game?

would the OFF AI check if there is a contradiction between a label and it’s ingredients? e.g. there is product tagged with a vegan label, but the ingredients list has has non-vegan items on it.
Having such a check would increase the quality of product information in the OFF database.