MACHINE

PSYCHOLOGY

It is time to study machines like we study humans.

Artificial Neural Networks

Natural Neural Networks

Lex Fridman

Alcorn et al. at CVPR 2019

Our Work at IEEE Vis 2018

Lichtman Lab

Lichtman Lab

Interactive Proofreading

IEEE Vis 2014

Interactive Proofreading

Finding errors takes a long time

Guided Proofreading

CVPR 2018

Guided Proofreading

Guided Proofreading

CVPR 2019

Submitted to CVPR 2020

Mitochondria

Use

for Alignment

Yahiya Hussain

Adolescent Brain Cognitive Development

The ABCD Study is the largest long-term study of brain development and child health in the United States.

> 10k children

> 30k scans

Loraine Franke

glTF

Graphics Layer Transmission Format

{
    "accessors": [
        {
            "bufferView": 0,
            "byteOffset": 0,
            "componentType": 5126,
            "count": HOWMANY,
            "type": "VEC3",
            "max": [MAX_X, MAX_Y, MAX_Z],
            "min": [MIN_X, MIN_Y, MIN_Z]
        },
        {
            "bufferView": 1,
            "byteOffset": 0,
            "componentType": 5123,
            "count": HOWMANY,
            "type": "SCALAR",
            "max": [MAX],
            "min": [MIN]
        }
    ], 
  
  
   // ...
}
{
    // ...
  
    "bufferViews": [
        {
            "buffer": 0,
          	"byteOffset": 0,
            "byteLength": HOWMANYBYTES,
            "target": 34962
        },
        {
            "buffer": 1,
            "byteOffset": 0,
            "byteLength": HOWMANYBYTES,
            "target": 34963
        }
    ],
    "buffers": [
        {
            "uri": "data:application/octet-stream;base64, ...."
        },
        {
            "uri": "data:application/octet-stream;base64, ...."
        }
    ]
  
   // ...
}

ELEMENT_ARRAY_BUFFER

ARRAY_BUFFER

Trako

$ pip install trako

$ ./trakofy -i DATA/example.vtp -o /tmp/test.tko

1984

IEEE Vis 2018

77°

0.856

[0.2, 0.14, 0.6, 0.8]

2500+ networks

Jesse Freeman

Alex Abel

Bau et al.

Network Dissection

easy

hard

XTK

Three.js

WebGL

limited

freedom

Complexity

Functionality

XTK

X.renderer3D

X.cube

Three.js

THREE.WebGLRenderer

THREE.Scene

THREE.TrackballControls

THREE.PerspectiveCamera

THREE.AmbientLight

THREE.DirectionalLight

WebGL

gl.viewport

gl.createShader

gl.shaderSource

gl.compileShader

gl.getShaderInfoLog

gl.createProgram

gl.attachShader

gl.linkProgram

gl.useProgram

gl.createBuffer

gl.bindBuffer

gl.BufferData

gl.getAttribLocation

gl.vertexAttribPointer

gl.enableVertexAttribArray

gl.clearColor

gl.clear

gl.drawArrays

 

THREE.Geometry

THREE.Material

THREE.Mesh

Thank you!

AtScale

By Daniel Haehn

AtScale

Machine Psychology at UMass Boston. See https://mpsych.org!

  • 138

More from Daniel Haehn