Product addition (tracker)

[teolemon]

Who for

• Contributors

What

Product addition

Beta Give feedback

1. (Product Addition) There should be a confirmation button if you click "Finish" without uploading anything #4155
   +0
   
2. (Product Addition) Each additional photo in product addition should have its own entry #1399
   Product addition ✏️ Contribution +2
3. (Product Addition) We should take a photo of the scanned barcode right on barcode detection, and integrate it as a first photo in product addition
4. Add an Eco-Score completion pipeline #518
   2 of 6
   Eco-Score ✏️ Contribution 🛣️ Road to scores +3
5. Add a Nutri-Score completion pipeline #519
   1 of 2
   ✏️ Contribution 🚥 Nutri-Score 🛣️ Road to scores +3

More substantial addition

Beta Give feedback

1. Make the Road to Scores more explicit on product addition #2910
   Product addition 🎨 Mockups available 🎯 P1 🛣️ Road to scores +4
   
2. Implement guided packaging input (wizard-like) #515
   ✏️ Contribution ✏️ Editing - Packaging input 🎨 Mockups available +3
3. Revamp photo acquisition with the possibility to add a photo in other languages #3298
   P5 Product addition multilingual products ✨ enhancement 🎨 Mockups available +5
4. Add a "no nutrition information" toggle on the product addition screen #1701
   Product addition ✏️ Contribution ✨ enhancement 🎨 Mockup required 🎯 P1 +5
   
5. Add an option to add a photo of origins mentioned on the packaging #3297
   0 of 3
   Eco-Score image upload ✨ enhancement 🎨 Mockups available 🎯 P0 📍Origins 🖼️ Photos - additional photos +7
   
6. Allow to positively confirm the presence or absence of all Eco-Score labels #3295
   Eco-Score Product addition ✏️ Editing ✨ enhancement 🎨 Mockups available 🎯 P1 🛣️ Road to scores +7
7. Simplify the basic details input by using Robotoff predictions #3279
   Product addition ✏️ Editing ✨ enhancement 🎨 Mockups available 🎯 P1 🐛 bug 🤖 Robotoff +7
8. Implement full/guided ingredients origins input (tracker) #517
   Eco-Score Product addition ✏️ Contribution ✏️ Editing - ingredients 🎨 Mockups available 📍Origins +6
9. Nutrition input (Tracker) #511
   1 of 21
   nutrition facts ✏️ Contribution ✏️ Editing - Nutrition input 🎨 Mockups available 🛣️ Road to scores +5
10. Finish button hidden by "The image will be uploaded in the background as soon as possible" when adding new product #3963
    Product addition layout 🐛 bug +3
    
11. We can add Robotoff questions filtered on category in the category editing section #3985
    ✏️ Editing ✨ enhancement 🎯 P1 🤖 Robotoff +4
12. We can add Robotoff questions filtered on labels in the labels editing section #3986
    ✏️ Editing ✨ enhancement 🎯 P1 🤖 Robotoff +4
    
13. Add brand autocomplete from openfoodfacts-search #4068
    Product addition autosuggest ✏️ Editing ✏️ Editing - Basic info input ✨ enhancement 🎯 P1 +6

Done

Beta Give feedback

1. (Product Addition) Buttons to extract/input data from images should appear after upload of the relevant photo #1398
   P3 Product addition ✏️ Contribution ✏️ Editing - ingredients 🛣️ Road to scores +5
2. (Product Addition) A button to open nutrition extraction should appear after upload of the nutrition photo (and not immediately like currently) #2978
   P2 Product addition good first issue 🐛 bug +4
   
3. Add a checkmark if nutrition facts have been entered #2975
   Product addition good first issue 🐛 bug +3
4. The product addition check shouldn't look like a radio button #2974
   Product addition good first issue 🎯 P1 🐛 bug +4
5. (Product Addition) A button to open ingredient extraction should appear after upload of the ingredients photo #2977
   Product addition 🐛 bug +2
6. Product Addition - The image upload snackbar is blocking the finish button while it's visible #2944
   Product addition good first issue 🎨 UI / UX 🐛 bug +4
   
7. (Product Addition) Reword from "add to our database" to "add to Open Food Facts" #1397
   +0
8. (Product Addition) The newly added product should be immediately visible once you exit product addition #1395
   Product addition 🎯 P1 +2
   
9. After taking a photo and cropping, image shown is the previous one #1194
   good first issue image upload 🎯 P1 🐛 bug +4
   
10. Small improvements to the photo cropper in product addition #1400
    P4 Product addition ✏️ Contribution 🖼️ Photos - Cropping +4
11. (Product Addition) The "uploading image" dialog should not block the user from moving to the next photo #1393
    Offline Offline - Contribution Product addition ✏️ Contribution 🎯 P1 +5
    
12. (Product addition) We should be able to know that images and products were added with "Smoothie 0.0.3 (520)" #1396
    Product addition User agent +2
    

Video

https://photos.app.goo.gl/V1cwkaVEM9ArwJBL7

Part of

• Contribute (Tracker) #503

[teolemon]

[monsieurtanuki]

Was it a barcode search? A scan search with wrong barcode detection? A text search with the only 2 Romanian results for "snickers"?

[teolemon]

• It could either be a scan with a product with just "Snickers" or a product that does not exist at all.
• It could be a search that timed out due to the current infrastructure upgrade.

I'm very much aligned with the Nutri-Score and Eco-Score pipelines. We have those old issues

• Add an Eco-Score completion pipeline #518
• Add a Nutri-Score completion pipeline #519
• that should be mixed with (Draft & Call for feedback) Revamp of product addition in a wizard/pipeline form #3270

[teolemon]

@monsieurtanuki a quick and dirty fix would be one button per pipeline in the addition screen (plus two concatenations of editing sections)

[monsieurtanuki]

@teolemon The pipelines (actions behind "help!" buttons) do not exist yet, right?

I would even put the "help!" buttons on top, as it's probably what users want first. I mean, 1 star users may want an answer quickly, rather than contribute with pictures that they already see (no added value for them) (plus the gamification: as a user I see that my first inputs already have an impact).

[teolemon]

• They don't. I just had a look at the mockups in Figma, but they are too ambitious.
• Stacking the necessary existing editing sections on top of each other should be a good first.

[monsieurtanuki]

@teolemon Something like that?

top	bottom

[teolemon]

Looks reasonable.
Perhaps being honest ? "Help compute the Nutri-Score in 2 minutes."

Bugs to open

• We should reword to "Ajouter la catégorie du produit"
• Left align icons in KP action buttons #3951

[teolemon]

• Probably a beautification of the title (larger, using the same title as the Knowledge Panel titles Health and Environnment)
• using those (probably already cached assets):
  https://static.openfoodfacts.org/images/attributes/nutriscore-unknown.svg
  https://static.openfoodfacts.org/images/attributes/ecoscore-unknown.svg

[monsieurtanuki]

@teolemon Something like that?

Regarding a short "add THE product category", it means that we'll have to maintain 3 labels:

• add the product category (new product / empty category)
• Add missing product category (when the category is not good enough, cf. KP, cf. "skyr" that is not a precise enough category) (?)
• category entered! (or we just remove the button)

Same for nutrition facts and ingredients, right?

[teolemon]

yes, much better 👍

[teolemon]

and the grey nutri-score is replaced by the actual one, as soon as we have it

[raphael0202]

After discussing the issue with @teolemon, here is my opinion on implementing a new product addition pipeline.
First, from an AI perspective, we need to ask the user to upload images first, as there image upload takes time (especially if the user network is slow) and as prediction extraction by Robotoff also takes time.

The idea is to assist the user with information predicted by Robotoff during the product addition process.

I would suggest to set up the following simple pipeline with the following screens:

1. asking for most important images: front, nutrition, ingredient (in that order) + crops. I would drop the "packaging" and "additional photos" at this stage.
2. asking for product name + weight. If we have product_weight insights from Robotoff at this stage, we pre-fill the field.
3. asking to fill the nutritional information. At this step all Robotoff processing should be finished. We can ask Robotoff with the /predict/nutrition endpoint nutrition information and pre-fill the nutrient fields.
4. asking user to extract ingredients. Currently, Robotoff cannot do it automatically, but there is an ongoing AI project to do this.
5. asking user to provide the category. We should have a pretty good category prediction at this point with all the previously provided data (product name, nutrients, ingredients, images). We should provide Robotoff category insight as a category suggestion.
6. (optional for a first pipeline version) Asking user to add labels, using Robotoff suggestions.
7. (optional for a first pipeline version) Asking user to take packaging + additional pictures.

We should send data points as soon as the user submit the data at each pipeline stage, to be sure we get partial data in case the user drops the product addition.

I don't think it's valuable to talk about ecoscore or nutriscore at the beginning of the pipeline, as the user doesn't necessarily know what these scores are about. I think the user expect to have to provide some data to get information about the product, he/she just needs to be guided.

[monsieurtanuki]

I don't think it's valuable to talk about ecoscore or nutriscore at the beginning of the pipeline, as the user doesn't necessarily know what these scores are about. I think the user expect to have to provide some data to get information about the product, he/she just needs to be guided.

@raphael0202 I have no idea what users expect, but it would be fair to assume that at some point nutriscore and ecoscore mean something for them in the app, as:

• they are displayed on top of each product card
• there are only 3 attributes deemed important enough to be part of the default settings and they're among them (nutriscore: very_important, ecoscore: important, nova: important)

We could dismiss the nutriscore / ecoscore input in the "add new product" page for users that say they don't care about those attributes.

That said, my point here was to code a quick fix (slightly better looking, more interactive) by adding a couple of buttons.
Your suggestion is much more ambitious, and deserves a proper issue (if not several issues).
And keep in mind that the images are uploaded in the background, which means some glitches in the pipeline.

[raphael0202]

@monsieurtanuki My point about the ecoscore/nutriscore wasn't very clear, sorry for that. I was taking the perspective of a user in a country with low product coverage (such as Romania, where we're gaining some traction lately), where the user has a high chance of scanning a product not referenced by Open Food Facts. As such, his/her first "interaction" with nutriscore/ecoscore would be in the product addition page, and I find this a bit confusing.
I think it's preferable that users learn more about what is the ecoscore and the nutriscore on the product page instead.

I think it's a good time to implement a first version of the pipeline, as it would bring more value than quick fixes (and it's something that we have been postponing for a long time, we already talked about this for the old android app).

It's not an issue if images are not uploaded on time, as ML predictions only come as a bonus, it should be possible to complete the pipeline without it.

This can be implemented step by step, we don't need to implement the full pipeline now. Just adding step (2) (asking for product name + weight + Robotoff weight prediction) could be a good start.

I'm also curious about your feedback on this proposal @teolemon @g123k

[teolemon]

Composite pipelines

• For existing products, we will need those composite Nutri-Score and Eco-Score completion pipelines in the product page anyway (we currently have some mechanism in place thanks to the Knowledge Panel actions, but they are not linear, especially for Eco-Score)

We need to wire existing editing components to Robotoff (including for existing products)

• We need to fix Inline Robotoff questions to increase the answer rate #3326 (something was merged but does not work) so that we can validate robotoff inline and proceed to the easy steps

Easy

• We can add Robotoff questions filtered on category in the category editing section
• We can add Robotoff questions filtered on labels in the labels editing section
• We can add Robotoff questions filtered on weight in the basic details section (Simplify the basic details input by using Robotoff predictions #3279)

Harder

• We can wire the Robotoff nutrition facts prediction to the nutrition table editing section (remains to be seen how we integrate with the nutrition table itself, but we can do that in 2 steps possibly) (Offer in-line validation of Robotoff predictions for nutrition facts #3278)

Better Eco-Score and Nutri-Score onboarding

• We definitely need to add a good Eco-Score and Nutri-Score one-time explainer in app, beyond what we have for knowledge panels. It would require a reflexion: is a video good (like the official ones) ? Can we have a vertical video (none of them exist to my knowledge) to appear more native ? Should we have something animated by code instead (difficult) ? Is text and image enough, and will people actually engage with that little?
• Add a good, playful and interactive Eco-Score explainer #3982
• Add a good, playful and interactive Nutri-Score explainer  #3983

Be tougher on incomplete products / Towards personal pipelines

• Show a drive to complete data on the scan card when there's close to zero data on the product. Eg deny access to the product, unless there's significant data.
• Proposal: Trigger a specific "Road to Scores" pipeline, directly on the scan card, when mandatory choices are missing (eg: ingredients…) #1080
• Tapping on "Unknown product match" should open a road to get the match #1118