ReRank

DeepSee

https://gtvault-my.sharepoint.com/personal/acoscia6_gatech_edu/_layouts/15/stream.aspx?id=%2Fpersonal%2Facoscia6_gatech_edu%2FDocuments%2FDocuments%2F2025_Coscia_Integrating_AI_Talk_UMB%2Emp4

Patrick Cozzi and Liz Dailey

https://www.youtube.com/watch?v=SQuH-xpdlbc&t=2123s

Updates coming!

https://cesium.com/blog/2024/12/12/cesium-orients-and-informs-fox-sports-football-fans/

https://bsiscoe.github.io/CS460student/04/

https://shkimmie-umb.github.io/CS460student/04/

https://thong2511.github.io/CS460Tom/04/

https://shecodes19.github.io/CS460student/04/

Next Tuesday via Zoom!

https://allyssaalewis.com/

Transformations

Translate

Rotate

Scale

Frame of Reference

World Frame

Frame of Reference

Object Frame

Frame of Reference

Object Frame

Frame of Reference

Eye Frame

Camera

(Eye)

cos(T) -sin(T) 0 0

sin(T) cos(T) 0 0

0 0 1 0

0 0 0 1

rotation around Z

cos(T/2)

sin(T/2) * 0

sin(T/2) * 1

Matrix

Quaternion

with angle T

cos(T) -sin(T) 0 0

sin(T) cos(T) 0 0

0 0 1 0

0 0 0 1

2, 2, 2

with T = Pi/2

2 Pi

Pi/2

1.5 Pi

-1

-2, 2, 2

cos(T/2)

sin(T/2) * 0

sin(T/2) * 1

Quaternion

~0.7

Pi/2 /2 == Pi/4

~0.7

Quaternion

~0.7

- 0

- ~0.7

Inverse

page 64, Gortler: 3D Computer Graphics

~0.7

Quaternion

~0.7

- 0

- ~0.7

Inverse

page 64, Gortler: 3D Computer Graphics

- 2

implement this in python and show that 0,-2,2,2 is the output!

~0.7

Quaternion

~0.7

- 0

- ~0.7

Inverse

page 64, Gortler: 3D Computer Graphics

- 2

implement this in python and show that 0,-2,2,2 is the output!

https://colab.research.google.com/drive/1qrFFqcQC0-q5MDEyJmN_cmEJPln2Npg3?usp=sharing

https://colab.research.google.com/drive/160WhGtQYlbRnh_3LwEvIf8fAZmecF0ll?usp=sharing

sin(T/2) * 0

sin(T/2) * 1

cos(T/2)

Quaternion

T is the angle

0 0 1 is the axis

var q = new THREE.Quaternion( x, y, z, w );

var q = new THREE.Quaternion( 1, 1, 1, 1 );

1 = sin( ? /2) * ?

1 = cos( ? /2)

2 Pi

Pi/2

1.5 Pi

-1

sin(T/2) * 0

sin(T/2) * 1

cos(T/2)

Quaternion

T is the angle

0 0 1 is the axis

var q = new THREE.Quaternion( x, y, z, w );

var q = new THREE.Quaternion( sin( T / 2 ) * x , 
                              sin( T / 2 ) * y , 
                              sin( T / 2 ) * z , 
                              cos( T / 2 ) );

2 Pi

Pi/2

1.5 Pi

-1


      function animate() {

        requestAnimationFrame( animate );

        for (var t in window.ALL_TORUSES) {


          t = ALL_TORUSES[t];

          var T = Math.PI / 2; // 180 degrees

          // around the y axis
          var x = Math.sin( T / 2 ) * 0; // = 0
          var y = Math.sin( T / 2 ) * 1;
          var z = Math.sin( T / 2 ) * 0; // = 0
          var w = Math.cos( T / 2 );

          var q = new THREE.Quaternion( x, y, z, w);

          t.quaternion.slerp( q, 0.01 );

        }


        // and here..
        controls.update();
        renderer.render( scene, camera );
        
      };

I almost failed highschool because of math!

var q = new THREE.Quaternion( sin( T / 2 ) * x , 
                              sin( T / 2 ) * y , 
                              sin( T / 2 ) * z , 
                              cos( T / 2 ) );

2 Pi

Pi/2

1.5 Pi

-1

90°

180°

270°

360°

180°

around Y-axis

T is the angle

x y z is the axis

T = Math.PI

0, 1, 0

var q = new THREE.Quaternion( Math.sin( Math.PI / 2 ) * 0 , 
                              Math.sin( Math.PI / 2 ) * 1 , 
                              Math.sin( Math.PI / 2 ) * 0 , 
                              Math.cos( Math.PI / 2 ) );

var q = new THREE.Quaternion( sin( T / 2 ) * x , 
                              sin( T / 2 ) * y , 
                              sin( T / 2 ) * z , 
                              cos( T / 2 ) );

2 Pi

Pi/2

1.5 Pi

-1

90°

180°

270°

360°

270°

around Z-axis

T is the angle

x y z is the axis

T = 1.5 * Math.PI

0, 0, 1

var q = new THREE.Quaternion( Math.sin( 1.5 * Math.PI / 2 ) * 0 , 
                              Math.sin( 1.5 * Math.PI / 2 ) * 0 , 
                              Math.sin( 1.5 * Math.PI / 2 ) * 1 , 
                              Math.cos( 1.5 * Math.PI / 2 ) );

var q = new THREE.Quaternion( sin( T / 2 ) * x , 
                              sin( T / 2 ) * y , 
                              sin( T / 2 ) * z , 
                              cos( T / 2 ) );

2 Pi

Pi/2

1.5 Pi

-1

90°

180°

270°

360°

90°

around X-axis

T is the angle

x y z is the axis

T = Math.PI / 2

1, 0, 0

var q = new THREE.Quaternion( Math.sin( Math.PI / 2 / 2 ) * 1 , 
                              Math.sin( Math.PI / 2 / 2 ) * 0 , 
                              Math.sin( Math.PI / 2 / 2 ) * 0 , 
                              Math.cos( Math.PI / 2 / 2 ) );

cos(T) -sin(T) 0 0

sin(T) cos(T) 0 0

0 0 1 0

0 0 0 1

2, 2, 2

with T = Pi/2

2 Pi

Pi/2

1.5 Pi

-1

-2, 2, 2

cos(T/2)

sin(T/2) * 0

sin(T/2) * 1

Quaternion

~0.7

Rigid Body Transformation

Quaternion

Translation Vector

Scaling

x, y, z

Euler Angles

Gimbal Lock

Quaternions fixes this!

Arcball

Trackball

Controls

OrbitControls

Arcball

Trackball

Controls

http://3dvision.princeton.edu/courses/COS598/2014sp/slides/lecture15_webgl/WebGLPresentation.pdf

Natural Feeling

Spins twice as fast

Completely path independent

Both:

Map 2D to 3D Sphere

esay to implement with Quaternions

Picking

or unprojecting from 2D to 3D

zNear

Ray

Position (x,y,z)

Invisible Plane

raycaster = THREE.Raycaster();
raycaster.setFromCamera(vp_coords_near, camera);
intersects = raycaster.intersectObject( invisiblePlane );

Raycasting

https://demos.goxtk.com/knee_atlas/

Click to select an object

https://www.lighthouse3d.com/tutorials/opengl-selection-tutorial/

Framebuffer (hidden)

gl.readPixels

(r, g, b, a)

Object Picking

How would you encode "2" as rgba?

https://www.lighthouse3d.com/tutorials/opengl-selection-tutorial/

Framebuffer (hidden)

( 1, 0, 0, 1 )

( 0, 1, 0, 1 )

( 1, 1, 0, 1 )

( 0, 0, 1, 1 )

( 0, 0, 0, 1 )

gl.readPixels

(r, g, b, a)

map to object ID

( 0, 1, 0, 1 )

Object Picking

Raycasting

More complex

Quick'n'Dirty

Very precise (Face picking)

Object precision

Occlusion not a problem

Objects can be hidden

Object Picking

Raycasting

More complex

Quick'n'Dirty

Very precise (Face picking)

Object precision

Occlusion not a problem

Objects can be hidden

raycaster = THREE.Raycaster();
raycaster.setFromCamera(vp_coords_near, camera);
intersects = raycaster.intersectObject( scene.children );

https://threejs.org/examples/webgl_interactive_cubes.html

https://threejs.org/examples/webgl_decals.html

https://www.lighthouse3d.com/tutorials/opengl-selection-tutorial/

Framebuffer (hidden)

( 1, 0, 0, 1 )

( 0, 1, 0, 1 )

( 1, 1, 0, 1 )

( 0, 0, 1, 1 )

( 0, 0, 0, 1 )

gl.readPixels

(r, g, b, a)

map to object ID

( 0, 1, 0, 1 )

Object Picking

Sir Isaac Newton 1666

https://en.wikipedia.org/wiki/RGBA_color_space

r g b a

alpha

0: fully transparent

....

255: fully opaque

0: minimum

....

255: maximum

red

green

blue

All image formats (PNG, JPEG, BMP...)

4 channels

r g b

0: minimum

....

255: maximum

red

green

blue

All image formats (PNG, JPEG, BMP...)

3 channels

0: minimum

....

255: maximum

grayscale

All image formats (PNG, JPEG, BMP...)

1 channel

r g b a

alpha

0: fully transparent

....

255: fully opaque

0: minimum

....

255: maximum

red

green

blue

Three.js

r g b a

alpha

0: fully transparent

....

1: fully opaque

0: minimum

....

1: maximum

red

green

blue

XTK or GLSL

https://thebookofshaders.com/06/

https://bgrins.github.io/TinyColor/

http://colorbrewer2.org/

#000000

#ffffff

minimum

maximum

Hex

#00000000

#ffffffff

minimum

maximum

Hex8

alpha

HSL

Hue

Saturation

Lightness

0/360°

180°

240°

65%

40%

100%

hsl(240, 65%, 40%)

rgb(36, 36, 168)

#2424a8

https://www.w3schools.com/colors/colors_hsl.asp

https://stackoverflow.com/a/65174304

Gamut

range of colors in an imaging system

r g b a

alpha

255

red

green

blue

255

1 byte

https://lessons.goxtk.com/10/

Let's do it!!!

https://tweakpane.github.io/docs/

connect XTK or Three.js with Tweakpane!

https://threejs.org/examples/?q=effects

$ python -m http.server

$ cd 05/

$ git pull

http://localhost:8000/

<script type="module">
  
// ...

  
import { AnaglyphEffect } from 'three/addons/effects/AnaglyphEffect.js';
  
let effect; 
 
// ...
 
effect = new AnaglyphEffect( renderer );
effect.setSize( window.innerWidth, window.innerHeight );

// ...

function animate() {

  // ...

  effect.render( scene, camera ); // replace renderer. with effect.

  // ...

}

</script>

submit your music

cs460.org/music

Lecture 15

By Daniel Haehn

Lecture 15

Slides for CS460 Computer Graphics at UMass Boston. See https://cs460.org!

Daniel Haehn PRO

Hi, I am a biomedical imaging and visualization researcher who investigates how computational methods can accelerate biological and medical research.

Lecture 15

More from Daniel Haehn