Carolina Cuesta-Lazaro
25th November 2021 - IAC-Deep
Impose symmetries!
CAT
2x2 Max
Pooling
Permutation Invariant function: Mean, Avg, Sum, Max ...
Neural Nets
Deep Sets Zaheer et al, NeurIPS'18
Node Level
Permutation Equivariance
Set Level
Permutation Invariance
Adjacency Matrix
Permutation Invariance:
Permutation Equivariance:
Input Graph (x, A)
Learned Graph (h, A)
Input Graph (x, A)
Learned Graph (h, A)
Node regression
/classification
Graph regression
/classification
Link prediction
CONVOLUTIONAL
MESSAGE PASSING
ATTENTIONAL
Image Credit + More Info https://arxiv.org/abs/2104.13478