A.I. for Mobile Apps

Instituto de Investigaciones en Informática

UMSA

April 22, 2019

Me

@alvarez_tech

alvareztech

alvarez.tech

Daniel Alvarez

Mobile Apps

Apps then

Calculator

Forms

Questions games

Event Apps

Map points

Apps now

Devices Now

More battery

More connectivity

More power

More image quality

and more...

AI

?

Machine Learning

Artificial Intelligence

Deep Learning

Artificial Intelligence

Inteligencia llevado a cabo por máquinas

Machine Learning

Rama de la AI, cuyo objetivo es desarrollar técnicas que permitan que las computadoras aprendan

Deep Learning

Método de Machine Learning basado en el cerebro (redes neuronales)

Deep Learning

Artificial Intelligence

Machine Learning

Where ?

Model

Library, Framework for Machine learning

Trained

Model

Image classifier

AI for Mobile

?

Data

Server

Android & iOS ?

iOS

Android

MLKit

Google's Machine Learning SDK

Pre-trained models

Text recognition

Face detection

Image labelling

Barcode scanning

Landmark recognition

Language ID

iOS Barcode Sample

pod 'Firebase/Core'
pod 'Firebase/MLVision'
pod 'Firebase/MLVisionBarcodeModel'

Podfile

import Firebase

ViewController.swift

let format = VisionBarcodeFormat.all
let barcodeOptions = VisionBarcodeDetectorOptions(formats: format)
var vision = Vision.vision()
let barcodeDetector = vision.barcodeDetector(options: barcodeOptions)

Barcode detector

let visionImage = VisionImage(image: imageView.image!)
barcodeDetector.detect(in: visionImage) { features, error in
    guard error == nil, let features = features, !features.isEmpty else {
        print("No barcodes")
        return
    }
    
    for barcode in features {
        let displayValue = barcode.displayValue
        let rawValue = barcode.rawValue
        print("Barcode: \(displayValue) \(rawValue)")
        self.label.text = rawValue
    }
}

Run barcode detector

Demo

iOS

Custom models

A lightweight machine learning library and tools for mobile and embedded devices.

.tflite

ANDROID

iOS

Demo

ANDROID

Sample

Feature On-device Cloud
Text recognition
Face detection
Barcode scanning
Image labeling
Landmark recognition
Language identification
Smart Reply
Custom model inference

Some models

Thank you!

@alvarez_tech

alvareztech

alvarez.tech

Made with Slides.com