How machines "see" our physical world

Jd Fiscus

Software Engineering Manager
- Full Stack Developer
Udacity Robotics Engineering Nanodegree
MIT IoT Bootcamp
AWS ML Certification (pending)
PyImageSearch Guru (pending)
- Computer Vision

@iamfiscus

Choose Your Sensors

WISELY

Navigation

Source: http://emanual.robotis.com/docs/en/platform/turtlebot3/navigation/

Human Senses for Machines

Examples from Nature

What is Computer Vision?

Source: https://www.qsrmagazine.com/pizza/dominos-new-platform-rewards-points-competitors-pizza

Case Study

Dominos

Amazon

Source: https://auto.ndtv.com/news/ces-2019-nvidia-drive-autopilot-level-2-is-worlds-first-commercially-available-autonomous-driving-so-1974578

Case Study

Use Case

Case Study

Training Data

Training Result

Case Study

Source: https://gurus.pyimagesearch.com

How does it work?

Why Now?

Trends

Manufacturing

Workers

Monitoring

Autonomous

Healthcare

Military

Possible

Manufacturing

12%

4.5bn

2023

Predictive Maintenance
Package Inspection
Reading Barcodes
Product/Components Assembly
Defect Reduction
3D Vision Inspection
Improving Safety
Track and Trace
Plain Text Reading
Handwriting Analysis

Source: https://www.prnewswire.com

Possible

Healthcare

47%

1.5bn

2023

Medical Imaging and Diagnosis
Treatment Suggestions
Assistance in Surgery
Autonomous Robotic Surgery
Helping the Visually Impaired
Treatment Plan Monitoring
Keeping Elders in Home
“Seeing” Mental Conditions
The Watchful Eye of AI
3D Anatomy Modeling

Source: https://www.prnewswire.com

Concerns

Governance

Monitoring

Ethics

Concerns

Governance

Ethics

Worldwide VS Company

Transparency
Disclosure
Privacy
Diversity
Bias
Trust
Accountability
Collective governance
Regulation
“Complementarity”

https://www.lawfareblog.com/principles-ai-governance-and-ethics-should-apply-all-technologies

Questions?

Resources

Contact

- http://twitter.com/iamfiscus

- me@iamfiscus.com

@iamfiscus