How machines "see" our physical world

Jd Fiscus

Jd Fiscus

• Software Engineering Manager
  • Full Stack Developer
• Udacity Robotics Engineering Nanodegree
• MIT IoT Bootcamp
• AWS ML Certification (pending)
• PyImageSearch Guru (pending)
  • Computer Vision

@iamfiscus

Choose Your Sensors

WISELY

Navigation

Source: http://emanual.robotis.com/docs/en/platform/turtlebot3/navigation/

Human Senses for Machines

Examples from Nature

What is Computer Vision?

Source: https://www.qsrmagazine.com/pizza/dominos-new-platform-rewards-points-competitors-pizza

Case Study

Dominos

Amazon

Source: https://auto.ndtv.com/news/ces-2019-nvidia-drive-autopilot-level-2-is-worlds-first-commercially-available-autonomous-driving-so-1974578

Case Study

Use Case

Case Study

Training Data

Training Result

Case Study

Source: https://gurus.pyimagesearch.com

How does it work?

Why Now?

Trends

Manufacturing

Workers

Monitoring

Autonomous

Healthcare

Military

Possible

Manufacturing

12%

4.5bn

2023

• Predictive Maintenance
• Package Inspection
• Reading Barcodes
• Product/Components Assembly
• Defect Reduction
• 3D Vision Inspection
• Improving Safety
• Track and Trace
• Plain Text Reading
• Handwriting Analysis

Source: https://www.prnewswire.com

Possible

Healthcare

47%

1.5bn

2023

• Medical Imaging and Diagnosis
• Treatment Suggestions
• Assistance in Surgery
• Autonomous Robotic Surgery
• Helping the Visually Impaired
• Treatment Plan Monitoring
• Keeping Elders in Home
• “Seeing” Mental Conditions
• The Watchful Eye of AI
• 3D Anatomy Modeling

Source: https://www.prnewswire.com

Concerns

Governance

Monitoring

Ethics

Concerns

Governance

Ethics

Worldwide VS Company

• Transparency
• Disclosure
• Privacy
• Diversity
• Bias
• Trust
• Accountability
• Collective governance
• Regulation
• “Complementarity”

https://www.lawfareblog.com/principles-ai-governance-and-ethics-should-apply-all-technologies

Questions?

Resources

Contact

- http://twitter.com/iamfiscus

- me@iamfiscus.com

@iamfiscus