05.03.14
Carlo Beltrame 1
The Office of the Future – smart collaboration systems Carlo Beltrame
Ubiquitous Computing Seminar 2014
05.03.14
Carlo Beltrame 2
Vision
[Raskar1998]
05.03.14
Carlo Beltrame 3
Vision
[Raskar1998]
05.03.14
Carlo Beltrame 4
Vision – projectors
[Raskar1998]
05.03.14
Carlo Beltrame 5
Vision – projection surfaces
[Raskar1998]
05.03.14
Carlo Beltrame 6
Vision – projection turned off
[Raskar1998]
05.03.14
Carlo Beltrame 7
Vision – projection turned off
[Raskar1998]
05.03.14
Carlo Beltrame 8
Vision – uneven projection surface
[Raskar1998]
05.03.14
Carlo Beltrame 9
Vision – uneven projection surface
[Raskar1998]
05.03.14
Carlo Beltrame 10
Scene Capture
capture device
[Raskar1998]
05.03.14
Carlo Beltrame 11
Kinect
05.03.14
Carlo Beltrame 12
Kinect
150$
05.03.14
Carlo Beltrame 13
Kinect – RGB camera
RGB
camera
05.03.14
Carlo Beltrame 14
Kinect – depth sensor
IR
projector IR
camera
05.03.14
Carlo Beltrame 15
Kinect – microphone array
4-channel microphone array
05.03.14
Carlo Beltrame 16
Kinect – audio source angle
4-channel microphone array
α
05.03.14
Carlo Beltrame 17
RGB camera
05.03.14
Carlo Beltrame 18
RGB camera – frustum
05.03.14
Carlo Beltrame 19
RGB camera – widescreen capture
05.03.14
Carlo Beltrame 20
Scene Capture
Adapted from [Maimone2012a]
05.03.14
Carlo Beltrame 21
Scene Capture
05.03.14
Carlo Beltrame 22
Scene Capture – viewpoint change
05.03.14
Carlo Beltrame 23
Scene Capture – 360° camera
05.03.14
Carlo Beltrame 24
Scene Capture – 360° camera
05.03.14
Carlo Beltrame 25
Scene Capture – multiple cameras
05.03.14
Carlo Beltrame 26
Scene Capture – multiple cameras
05.03.14
Carlo Beltrame 27
Scene Capture – image stitching
05.03.14
Carlo Beltrame 28
Scene Capture – viewpoint change
05.03.14
Carlo Beltrame 29
Scene Capture
05.03.14
Carlo Beltrame 30
Scene Capture – continuous viewpoints
05.03.14
Carlo Beltrame 31
Scene Capture – 3D model
05.03.14
Carlo Beltrame 32
Scene Capture – projective textures
05.03.14
Carlo Beltrame 33
Depth sensor
IR
projector IR
camera
05.03.14
Carlo Beltrame 34
Depth sensor – structured light
IR
projector IR
camera
05.03.14
Carlo Beltrame 35
Depth sensor – time of flight
05.03.14
Carlo Beltrame 36
Depth sensor – result
[Maimone2012b]
05.03.14
Carlo Beltrame 37
Depth sensor – multiple sensors
05.03.14
Carlo Beltrame 38
Depth sensor – interference
[Maimone2012a]
05.03.14
Carlo Beltrame 39
Depth sensor – interference
[Maimone2012a]
05.03.14
Carlo Beltrame 40
Depth sensor – interference
[Maimone2012a]
05.03.14
Carlo Beltrame 41
3D reconstruction
05.03.14
Carlo Beltrame 42
3D reconstruction
05.03.14
Carlo Beltrame 43
3D reconstruction
05.03.14
Carlo Beltrame 44
3D reconstruction – KinectFusion
[Izadi2011]
05.03.14
Carlo Beltrame 45
3D reconstruction
05.03.14
Carlo Beltrame 46
Registration – without calibration
05.03.14
Carlo Beltrame 47
Registration – without calibration
05.03.14
Carlo Beltrame 48
Calibration – radial distortion
05.03.14
Carlo Beltrame 49
Calibration – extrinsic parameters
05.03.14
Carlo Beltrame 50
Calibration – extrinsic parameters
05.03.14
Carlo Beltrame 51
Registration
05.03.14
Carlo Beltrame 52
Registration
05.03.14
Carlo Beltrame 53
Registration
05.03.14
Carlo Beltrame 54
Registration
05.03.14
Carlo Beltrame 55
Registration
[Raskar1998]
05.03.14
Carlo Beltrame 56
Registration – merging in 2D
05.03.14
Carlo Beltrame 57
Transmission
05.03.14
Carlo Beltrame 58
Transmission
05.03.14
Carlo Beltrame 59
Transmission
05.03.14
Carlo Beltrame 60
Transmission – optical flow
05.03.14
Carlo Beltrame 61
Optical flow applied to 3D models
05.03.14
Carlo Beltrame 62
Rendering
05.03.14
Carlo Beltrame 63
Rendering – viewpoint change
05.03.14
Carlo Beltrame 64
Rendering
05.03.14
Carlo Beltrame 65
Rendering – head detection
05.03.14
Carlo Beltrame 66
Rendering – template matching
05.03.14
Carlo Beltrame 67
Rendering – multiple users
05.03.14
Carlo Beltrame 68
Rendering – multiple users
Look at me!
05.03.14
Carlo Beltrame 69
Rendering – multiple users
Look at me!
05.03.14
Carlo Beltrame 70
Projection
05.03.14
Carlo Beltrame 71
Projection
05.03.14
Carlo Beltrame 72
Projection
05.03.14
Carlo Beltrame 73
Projection – adapting to surface
05.03.14
Carlo Beltrame 74
Projection – adapting to surface
05.03.14
Carlo Beltrame 75
Projection – adapting to surface
05.03.14
Carlo Beltrame 76
Projection – adapting to surface
05.03.14
Carlo Beltrame 77
Projection – adapting to surface
05.03.14
Carlo Beltrame 78
Projection – adapting to surface
05.03.14
Carlo Beltrame 79
Implementations – MirageTable
[Benko2012]; image from http://www.engadget.com/
05.03.14
Carlo Beltrame 80
Implementations – Beamatron
[Wilson2012]
05.03.14
Carlo Beltrame 81
Implementations – multiple projectors
[Raskar1998, Raskar2003]
05.03.14
Carlo Beltrame 82
Implementations – autostereoscopic display
[Maimone2012a]; image from http://www.shortcourses.com/
05.03.14
Carlo Beltrame 83
Conclusion
[Raskar1998]
05.03.14
Carlo Beltrame 84
