A brief tour
Artificial Intelligence
Nicolas Rochet - 2024
Participative activity
What words bring Artificial Intelligence to mind?
One definition ?
Study and design of intelligent agents
Better than random
Better than a human
Performances
Programs
4 définitions
'Act' like a humain being
'Act' rationally
'Think' rationally
'Think' like a humain being
The automation of activities that we associate with human thinking, activities such as decision making, problem sloving, learning, ...
Bellmann, 1978
The art of creating machines that perform functions that require intelligence when performed by people.
Kurzweil 1990
Computationnal Intelligence is the study of the design of intelligents agents .
Poole et al. 1998
The study of mental faculties through the use of computationnal models
Charniak & Mc Dermott, 1985
My definition
Set of theories and techniques that give machines the ability to perform tasks assigned to intelligent beings
Disciplines of AI
A brief history of AI
50-56
>2011
93-2011
87-93
80-87
74-80
56-74
Birth of
AI
1st winter
Gold age
2nd gold age
2nd winter
discrete
maturity
Rise of
deep learning
Turing's 'Blind test'
Are these creations made by a human or a machine?
Turing's 'Blind test'
Are these creations made by a human or a machine?
MACHINE
Turing's 'Blind test'
Are these creations made by a human or a machine?
HUMAIN
Self-portrait by Rembrandt
Turing's 'Blind test'
Are these creations made by a human or a machine?
MACHINE
Microsoft AI from the
project The Next Rembrandt
Turing's 'Blind test'
Are these creations made by a human or a machine?
MACHINE
Turing's 'Blind test'
Are these creations made by a human or a machine?
HUMAIN
Allen Ginsberg
That tree said
I don't like that white car under me,
it smells gasoline
That other tree next to it said
O you're always complaining
you're a neurotic
you can see by the way you're bent over
Source: http://botpoet.com/
Turing's 'Blind test'
Are these creations made by a human or a machine?
MACHINE
Generated by Racter
A crow is a bird, an eagle is a bird, a dove is a bird.
They all fly in the night and in the day. They fly when the sky is red and when the heaven is blue. They fly through the atmosphere. We cannot fly. We are not like a crow or an eagle or a dove.
We are not birds. But we can dream about them. You can.
Source: http://botpoet.com/
Some fields of application
Processing of
images and sounds
Natural
Language
Processing
Recommander
systems
Predictives
systems
Decision
making
Robotics
Optimisation
& planning
Recommander
Systems
Products / Services
Content
People
Events
...
Predictive
systems
Données
spatio-temporelles
Weather
Pollution
...
Traffic
Physiological data
Molécules
In industry
Breakdowns
Assisted
decision making
Assistance with
diagnostic
Anomaly detection
Profile
segmentation
Matching
Identify patterns & trends
...
Fleet of vehicles
Optimisation & planning
Games
Poker
Chess
Go
Shogi
Dota 2
Starcraft 2
Assembly line
Ressources management
Material
Humans
Supply chain
Optimisation et planning
AlphaZero from DeepMind
OpenAI Bot forDota 2
Image & sound
processing
Description
of visual scene
Object detection
Image colorisation
Pose detection
Style transfert
Image & film generation
Motion capture
Enhancement of photos
...
Image segmentation
Sound generation
Image classification
Image classification, detection & segmentation
Recognize and describe a visual scene
Computer vision + language model
Description of visual scene
colorisation
Modifying images/videos
Correct anomalies in the image
Image & video in painting
...
super resolution
Image resolution enhancement (super resolution)
Style transfer (2015)
Modify the style in an image/vidéo
Style transfert on video and simulated video (2019)
Modify an image/vidéo
... with very questionable intentions
Apply a perturbation to the image to manipulate it
... even potentially dangerous
Deep fake
these same methods can also detect deep fake
Retouching & editing images
Retouching with Open AI Glide
Customizable photo editing with StyleFlow
Image generation
Generative design (Dream Catcher)
Generate faces
(NVIDIA face generator)
Drawing of realistic images
Draw a realistic image from a sketch
... and videos
Change the light exposure of a video
(Google AI)
Video editing
Pose and motion capture
Motion capture - Radical
Motion capture in videos
realistic deformable simulations
Deforming simulations in real time
Generate virtual environments
Sound generation
MuseNet (Open AI) composes a song from a few notes
Song Daddy's Car composed by Sony's AI
... or copy a voice !
Copy a voice from 5 sec of recording!
Video generation
... to multimodal models
Multimodal input-output models
Audio
Image
Video
Text
Input
Audio
Image
Video
Text
Output
Models
Natural
Language
Processing
Voice generation
Speaker recognition
Automatic summary
Traduction
Subtitling
Text generation
Chat bots
...
Vocal recognition
Semantic analysis
Text writing
Voice generation
Multi-language voice synthesis
General Language models
New very "big" models based on the attention mechanism (post 2018)
Able to multi-task with relatively good performance:
question answering
summary
text generation
traduction
...
2017
2020
2019
2018
CoVE
BERT
ELMo
T5
General Language models
CVT
ULMFiT
GPT
CamenBERT
FlauBERT
ALBERT
RoBERTa
GPT-3
ELECTRA
XLNet
BART
GPT-4
Bard
2020
> 2023
...
LLama 3
... more ethical questions
Ethical questions arise concerning
Bias in data sets
Bias in models (training, evalutation)
...
Robotics
Robot Nao
Pediatric HAL patient simulator robot
Robotics
Surgical robot
Shademan et al., 2016
Kiva robots
Autonomous sailboat Vaimos
Map of some applications
INDUSTRY
BANK
RETAIL
MARKETING
MEDECINE
ARTS
MEDIA
TRANSPORTS
...
Predictive maintenance
Robots
Flow management
Credit scoring
Fraud detecttion
Automatic trading
Sentiment analysis
Discovery of treatments
Prediction of treatment succes
Traffic analysis
Generative design
Sound generation
Image generation
Ressources planning
Assisted diagnostic
Autonmous vehicules
Automatic summary
Text generation
Product recommendation
Content recommendation
Automatic captioning
Churn prediction
customer behavior prediction
The predominance of
Deep Learning
Deep learning
AI
The success of deep learning
3 main reasons
The rise of Big Data
The increase of the computing power of computers
Recent progress of research
... and it disaventages
Often limited to supervised learning
Often requires a lot of data
Zoom on Generative AI
What is Generative AI ?
In recent years, research has led to the development of AIs capable of generating realistic data.
Des images
videos
drawings
illustrations
realistic photos
...
Du texte
Code
paragraphs
questions / answers
Lists
summary
...
Large Language Models (LLM)
Des sons
voice
music
...
Very large neural network
Extensively trained on gigantic data sets ...
... to predict every next token in a text
The network learns complex representations (embeding)
Simplified example of text generation
Conception & Entraînement
"L'apprentissage automatique est une branche de l'IA
Good capacities of generalization
The trained network has learned generalizable representations
Simplified example of text generation
Inference
Token-by-token text generation
Re-training on specific data
Select a set of documents to give in context
fine tuning
Retrieval Augmented Generation (RAG)
+
En tant qu'expert de la data science programmant en python ...
context : prompt
AIs for text generation
Some fondation models (closed source)
Some open source fondation model
Falcon
Claude
Llama 3
Large Langage Model Meta AI
AIs for text generation
AIs for image generation
Their capacities
Inpainting
Outpainting
Image-to-image
Prompt-to-image
Modify the interior of an image
Extend the exterior of an image
Generate an image from an image
Generate an image from a text instruction
DALL-E
Stable diffusion
MidJourney
Groupe CompViz
Some of the best known
AIs for image generation
AIs for video generation
IAs for sound generation
Generate sound from a text instruction (prompt)
A tour of some tools for Machine Learning
Plateforms & comunities
Code frameworks
To build & deploy AI models
Classical
Machine Learning
Deep learning
Large Langage Models (LLM)
SaaS
A sample of solutions
...
...
Generative AI
Solutions + calcul providers
No-Code
Sovereign AI
...
...
To be called with an API
With a Graphical User Interface (GUI)
Demos
Pre-trained models & notebooks code
Using Spaces to build a prototype
Generate Music
Segment object and video
Perspectives
Towards AIs with multi-tasking capabilities
... but not as much as in the imagination
The progress made in AI in recent years has been impressive!
BUT we're still a long way from General Artificial Intelligence or Human Intelligence.
Extract from the movie
Ex Machina
Extract from the movie Her
Impacts and challenges of AI
Society
Organizations
People
Ecological damages
Job eliminations
Induce or reinforce inequalities
Invasion of privacy
risks
progress
Low awarness
Risk of technological dependance
Improvement
of working condition
Improvement of the standard of living
Human assistance
Solving systemic problems
Help science progress
Ethical Recommandation
The need for an ethical framework for AI
Consider AI as a companion to humans rather than a replacement
Designing and implementing a frugal use of IAs
Some initiatives
Project Tournesol
Responsible AI
Frugality
Principles