A.I. for Mobile Apps
Instituto de Investigaciones en Informática
UMSA
April 22, 2019
Me
@alvarez_tech
alvareztech
alvarez.tech
Daniel Alvarez
Mobile Apps
Apps then
Calculator
Forms
Questions games

Event Apps
Map points
Apps now






Devices Now
More battery
More connectivity
More power
More image quality
and more...
AI
?
Machine Learning
Artificial Intelligence
Deep Learning
Artificial Intelligence
Inteligencia llevado a cabo por máquinas
Machine Learning
Rama de la AI, cuyo objetivo es desarrollar técnicas que permitan que las computadoras aprendan
Deep Learning
Método de Machine Learning basado en el cerebro (redes neuronales)
Deep Learning
Artificial Intelligence
Machine Learning
Where ?



Model

Library, Framework for Machine learning
Trained
Model
Image classifier
AI for Mobile
?
Data
Server


Android & iOS ?
iOS


Android
MLKit
Google's Machine Learning SDK

Pre-trained models


Text recognition
Face detection


Image labelling
Barcode scanning


Landmark recognition
Language ID
iOS Barcode Sample
pod 'Firebase/Core'
pod 'Firebase/MLVision'
pod 'Firebase/MLVisionBarcodeModel'
Podfile
import Firebase
ViewController.swift
let format = VisionBarcodeFormat.all
let barcodeOptions = VisionBarcodeDetectorOptions(formats: format)
var vision = Vision.vision()
let barcodeDetector = vision.barcodeDetector(options: barcodeOptions)
Barcode detector
let visionImage = VisionImage(image: imageView.image!)
barcodeDetector.detect(in: visionImage) { features, error in
guard error == nil, let features = features, !features.isEmpty else {
print("No barcodes")
return
}
for barcode in features {
let displayValue = barcode.displayValue
let rawValue = barcode.rawValue
print("Barcode: \(displayValue) \(rawValue)")
self.label.text = rawValue
}
}
Run barcode detector
Demo
iOS
Custom models
A lightweight machine learning library and tools for mobile and embedded devices.



.tflite
ANDROID
iOS
Demo
ANDROID
Sample
Feature | On-device | Cloud |
---|---|---|
Text recognition | ✅ | ✅ |
Face detection | ✅ | |
Barcode scanning | ✅ | |
Image labeling | ✅ | ✅ |
Landmark recognition | ✅ | |
Language identification | ✅ | |
Smart Reply | ✅ | |
Custom model inference | ✅ |
Some models

