nutriingredientnet-v5

NutriIngredientNet v5

Single-RGB-photo food nutrition estimator trained on Nutrition5k (overhead RGB). No depth sensor required at inference — depth is predicted from the RGB image (Depth Anything V2) and fused as a 4th channel, following DPF-Nutrition (Han et al., 2023).

Test results (official RGB test split; T3 real full-dish, comparable to the paper)

• Reconciled calorie MAE: 79.7 kcal (31.5%)
• Blend / Direct / Soft / Hard: 77.6 / 77.6 / 107.4 / 121.5 kcal
• Mass MAE 69.1 g | macro MAE: fat 6.2 g, carb 6.9 g, protein 5.7 g
• Detection F1 0.634 (vs frequency-prior 0.110)
• Grams MAE 20.7 g (vs oracle-presence mean-gram 23.5 g)
• Atwater residual: 26.14 kcal (direct) -> 0.0000 kcal (reconciled, exact)
• Conformal: CRC lambda 0.730 (empirical recall 0.820); gram interval ±41.6 g (empirical coverage 87.0%)

Comparison

• Nutrition5k RGB-only baseline (Thames et al., CVPR 2021): 70.6 kcal / 26.1% (mean 254.94 kcal)
• DPF-Nutrition predicted-depth (Han et al., 2023): 14.7% calorie PMAE
• Prior versions: v2 = 117.8 kcal (46.6%), v3 = 76.5 kcal (30.2%)

Limitations (read before use)

• Fixed overhead camera geometry. Trained on the Nutrition5k rig; other angles degrade accuracy.
• Vocabulary / OOV ceiling. Only ingredients seen >= 10 times in train are modeled; novel foods are missed.
• Extreme-dish under-prediction. Calorie-dense low-volume foods (e.g. 119 g almonds in dish_1558373159, true 1013 kcal) are systematically under-predicted — beyond current published SOTA.
• Conformal caveat. Guarantees assume exchangeability; real-user photos are off-distribution.
• Not a medical device; for behavioral/trend feedback only (Atwater factors are ±5% at best).