2013

2019

MACHINE

PSYCHOLOGY

It is time to study machines like we study humans.

Artificial Neural Networks

Natural Neural Networks

Lex Fridman

Alcorn et al. at CVPR 2019

Our Work at IEEE Vis 2018

Lichtman Lab

Lichtman Lab

Interactive Proofreading

IEEE Vis 2014

Interactive Proofreading

Finding errors takes a long time

Guided Proofreading

CVPR 2018

Guided Proofreading

Guided Proofreading

CVPR 2019

ECCV 2020

Mitochondria

Use

for Alignment

Yahiya Hussain

Gianna Yang

MIDL 2020

Adolescent Brain Cognitive Development

The ABCD Study is the largest long-term study of brain development and child health in the United States.

> 10k children

> 30k scans

Loraine Franke

glTF

Graphics Layer Transmission Format

{
    "accessors": [
        {
            "bufferView": 0,
            "byteOffset": 0,
            "componentType": 5126,
            "count": HOWMANY,
            "type": "VEC3",
            "max": [MAX_X, MAX_Y, MAX_Z],
            "min": [MIN_X, MIN_Y, MIN_Z]
        },
        {
            "bufferView": 1,
            "byteOffset": 0,
            "componentType": 5123,
            "count": HOWMANY,
            "type": "SCALAR",
            "max": [MAX],
            "min": [MIN]
        }
    ], 
  
  
   // ...
}
{
    // ...
  
    "bufferViews": [
        {
            "buffer": 0,
          	"byteOffset": 0,
            "byteLength": HOWMANYBYTES,
            "target": 34962
        },
        {
            "buffer": 1,
            "byteOffset": 0,
            "byteLength": HOWMANYBYTES,
            "target": 34963
        }
    ],
    "buffers": [
        {
            "uri": "data:application/octet-stream;base64, ...."
        },
        {
            "uri": "data:application/octet-stream;base64, ...."
        }
    ]
  
   // ...
}

ELEMENT_ARRAY_BUFFER

ARRAY_BUFFER

Trako

Trako

$ pip install trako

$ ./trakofy -i DATA/example.vtp -o /tmp/test.tko

MICCAI 2020

1984

IEEE Vis 2018

77°

0.856

[0.2, 0.14, 0.6, 0.8]

2500+ networks

Jesse Freeman

Aswin Vasudevan

Alex Abel

Bau et al.

Network Dissection

+

Auto-Encoder to find patterns in sequential genome data

Interactive ROI selection

EuroVis 2020

Intelligent Annotation Framework

Two Artificial Neural Networks..

..work together for Quality control

Discriminator finds error pattern of Classifier

post-training optimization of GP acc.

from 0.5982 to 0.9087

easy

hard

XTK

Three.js

WebGL

limited

freedom

Complexity

Functionality

XTK

X.renderer3D

X.cube

Three.js

THREE.WebGLRenderer

THREE.Scene

THREE.TrackballControls

THREE.PerspectiveCamera

THREE.AmbientLight

THREE.DirectionalLight

WebGL

gl.viewport

gl.createShader

gl.shaderSource

gl.compileShader

gl.getShaderInfoLog

gl.createProgram

gl.attachShader

gl.linkProgram

gl.useProgram

gl.createBuffer

gl.bindBuffer

gl.BufferData

gl.getAttribLocation

gl.vertexAttribPointer

gl.enableVertexAttribArray

gl.clearColor

gl.clear

gl.drawArrays

 

THREE.Geometry

THREE.Material

THREE.Mesh

Thank you very much!

FNNDSC

By Daniel Haehn

FNNDSC

Machine Psychology at UMass Boston. See https://mpsych.org!

  • 484