A.I. for Mobile Apps
Instituto de Investigaciones en Informática
UMSA
April 22, 2019
Me
@alvarez_tech
alvareztech
alvarez.tech
Daniel Alvarez
Mobile Apps
Apps then
Calculator
Forms
Questions games
Event Apps
Map points
Apps now
Devices Now
More battery
More connectivity
More power
More image quality
and more...
AI
?
Machine Learning
Artificial Intelligence
Deep Learning
Artificial Intelligence
Inteligencia llevado a cabo por máquinas
Machine Learning
Rama de la AI, cuyo objetivo es desarrollar técnicas que permitan que las computadoras aprendan
Deep Learning
Método de Machine Learning basado en el cerebro (redes neuronales)
Deep Learning
Artificial Intelligence
Machine Learning
Where ?
Model
Library, Framework for Machine learning
Trained
Model
Image classifier
AI for Mobile
?
Data
Server
Android & iOS ?
iOS
Android
MLKit
Google's Machine Learning SDK
Pre-trained models
Text recognition
Face detection
Image labelling
Barcode scanning
Landmark recognition
Language ID
iOS Barcode Sample
pod 'Firebase/Core'
pod 'Firebase/MLVision'
pod 'Firebase/MLVisionBarcodeModel'
Podfile
import Firebase
ViewController.swift
let format = VisionBarcodeFormat.all
let barcodeOptions = VisionBarcodeDetectorOptions(formats: format)
var vision = Vision.vision()
let barcodeDetector = vision.barcodeDetector(options: barcodeOptions)
Barcode detector
let visionImage = VisionImage(image: imageView.image!)
barcodeDetector.detect(in: visionImage) { features, error in
guard error == nil, let features = features, !features.isEmpty else {
print("No barcodes")
return
}
for barcode in features {
let displayValue = barcode.displayValue
let rawValue = barcode.rawValue
print("Barcode: \(displayValue) \(rawValue)")
self.label.text = rawValue
}
}
Run barcode detector
Demo
iOS
Custom models
A lightweight machine learning library and tools for mobile and embedded devices.
.tflite
ANDROID
iOS
Demo
ANDROID
Sample
Feature | On-device | Cloud |
---|---|---|
Text recognition | ✅ | ✅ |
Face detection | ✅ | |
Barcode scanning | ✅ | |
Image labeling | ✅ | ✅ |
Landmark recognition | ✅ | |
Language identification | ✅ | |
Smart Reply | ✅ | |
Custom model inference | ✅ |