search

Mobile SDK Overview

To begin, you will need your Nutrition AI Hub Key.

Get started with iOS, Android, Web, React Native, or Flutter in just a few steps. Follow our documentation guides to set up the SDK and start buildings. Please select your platform of choice:

iOS SDK Docschevron-rightAndroid SDK Docschevron-rightReact Native SDK Docschevron-rightFlutter SDK Docschevron-right

When integrated into your app the SDK provides you with food recognition and nutrition assistant technology. The SDK creates a video preview layer and outputs foods recognized by our computer vision technology in the video feed of your live camera along with nutrition data related to the recognized foods.

As the developer, you have complete control of when to turn on/off the SDK and to configure the outputs which includes:

  • food names (e.g. banana, hamburger, fruit salad, quest chocolate bar)

  • lists of alternatives for recognized foods (e.g., soy milk would be an alternative of a visually recognized class milk)

  • barcodes detected on food packages

  • packaged foods recognized by the text detected on food packages

  • nutrition information detected on food packages via Passio's Nutrition Facts reader which returns information written in Nutrition Facts labels

  • nutrition information associated with the foods

  • food weight and volume for certain foods

hashtag
Versions

circle-info

This guide will provide documentation for the latest version of the SDK. If the documentation is needed for an older version, be sure to check the VERSIONS section.

chevron-rightAvailable versionshashtag

3.2.4

3.2.2

3.2.0

3.1.4

hashtag
Latest SDK vs. Legacy

A key shift from our legacy SDK is the move from real-time on-device food logging to photo logging analyzed via cloud-side LLMs. While real-time scanning is still available as of Q4 2024, it’s no longer the primary mode. Passio now recommends photo logging, voice logging, and text search as the primary modes.

Outdated:

By default the SDK does not record/store any photos or videos. Instead, as the end user hovers over a food item with his/her camera phone, the SDK recognizes and identifies food items in real time. This hovering action is only transitory/temporary while the end user is pointing the camera at a particular item and is not recorded or stored within the SDK. As a developer, you can configure the SDK to capture images or videos and store them in your app.

PreviousCustom API Endpoints with Easy AINextMinimum requirements

Last updated