russtedrake PRO
Roboticist at MIT and TRI
Russ Tedrake
Image credit: Boston Dynamics
Q: Autonomous or Driver-controlled?
DARPA Robotics Competition
2015
Robots are dancing and starting to do parkour, but...
what about loading the dishwasher?
(in robotics; in a few slides)
Input
Released in 2009
Something we couldn't have expected...
(Pre-)Training on ImageNet makes it easier to "learn" to recognize other objects
A sample annotated image from the COCO dataset
Example: Text completion
No extra "labeling" of the data required!
and the programmers never considered / tested!
"some interesting failure cases"
Put the plate in the dishwasher...
Example: Image + Text
Humans have put lots of captioned images on the web
...
Example: Dall-E 2
"A painting of a professor giving a talk at a robotics competition kickoff"
Input:
Output:
Example: Dall-E 2
"An FTC competition robot with green plants growing from its metal body"
Input:
Output:
Some of the big questions:
We need your ideas, better theories/algorithms/robots, even more scalable machine learning systems, ...
What can you do right now?
Work hard and good luck this season!
By russtedrake
Fall 2022 FTC Northeastern Region Kickoff (at NHS)