Presentation is loading. Please wait.

Presentation is loading. Please wait.

Ishikawa-Namiki-Komuro Lab UNIVERSITY of TOKYO Alvaro Cassinelli Takahito Ito Masatoshi Ishikawa Untying space-time with the.

Similar presentations


Presentation on theme: "Ishikawa-Namiki-Komuro Lab UNIVERSITY of TOKYO Alvaro Cassinelli Takahito Ito Masatoshi Ishikawa Untying space-time with the."— Presentation transcript:

1 Ishikawa-Namiki-Komuro Lab UNIVERSITY of TOKYO Alvaro Cassinelli Takahito Ito Masatoshi Ishikawa Untying space-time with the

2 What? The KHRONOS PROJECTOR: a space-time warping machine for editing video, with a tangible, deformable screen interface. real time interactive non-planar Video Cube slices: (Pressure = Time) [click on image to launch video]

3 Why? Interactive sculpting space-time, or “interactive cubism” A step towards a spatialized visual language for video-based storytelling. 3D buffer editing tool with a tangible interface. … a commemoration of the Relativity Theory in its 100th anniversary

4 Interactive Cubism: static outcome interactive “extraction” of compelling cubist representations out of ordinary video footage

5 Francis Bacon Three Studies for Self-Portrait (1974) Khronos Projector Snapshots Three Projections of Monica Bressaglia(2005)

6 Marcel Duchamp Nude Descending a Staircase, 1911-12, ( “Cubo-Futurist” ) Khronos Projector Snapshot (Dressed) man walking the street

7 Interactive Cubism: dynamic outcome Recycling video as rough material for spatio- temporal sculpting The viewer walks a personal path on the image, driven by the choreography of visual elements. [click on image to launch video]

8 More examples: exploring gestures through gestures …develop a full body interface so that dancers/choreographers would be able to re-interact with a pre-recorded performance For each sequence, there are a few “space-time strokes” that adequately expose the particularities of the choreography… [click on image to launch video]

9 Highlighting Action with respect to Time (…or what’s like to be an X-men) [click on images to launch videos]

10 Semi-interactive cubism Mixing dimensions: space, time, but also color space, motion flow field, contour field (including higher-level/semantic dimensions based on face/gesture recognition, etc.) User control dimension-entanglement parameters A simple example: “chromatic time-arrow” luminance time pixel path in “lumino- temporal" space [click on image to launch video]

11 Relativity on a canvas: painting with a black hole in the tip of your finger (pressure  gravity) [click on image to launch video]

12 Towards a form of non-linear, spatialized visual narrative Consequence of broken spatial simultaneity (relativity principle) User can unfold different stories by walking different paths on the image. semantic features (abstract or concrete) become triggers for local time evolution trough observer interaction basis of a new language for interactive storytelling? [click on image to launch video]

13 How does it work: software Custom software (C++ and OpenGL) shape and displays video cube cutting surfaces (flat or 3D). Input from mouse, touch screen, graphic tablet or Vision Chip. [click on image to launch video]

14 Projector “Vision Chip” How does it work: installation Spandex-based Screen Infrared sources (LED arrays)

15 Position & Pressure detection mechanism Real-time analysis of specular & diffuse reflection

16 Vision Chip task center of gravity (up to a thousand images/sec) Area threshold X Y area Position Pressure (=Time!)

17 Sensitiveness to position and pressure (limited by commercial vision chip) Cheap interface System features (chip resolution: 48x32. Points super-resolved thanks to center of gravity computation) Interesting side effect: screen also works with light!

18 Where to go from here? Spatialized audio-track (for event’s annotation) Khronos Stereoscopic projector (use a single 3D texture with mixed frames) Khronos “live” (streamed video buffer) Develop the spandex-based tangible interface – Large, Full body interaction – Complex deformation patterns [click on image to launch video]

19 Thank you for your space-time! Contributors Monica Bressaglia, Nelson Balbela, Eric Augier, Roger P. Hangarter, Naoko Itoh and dancers from the "Mademoiselle Cinema" company. Special thanks Anchelee Davies, "Jeff" Schneider, Marco Cuturi, Philippe Pinel, Stephane Perrin, Gonzalo Frasca, Luc Foubert and Jussi Angesleva [click on image to launch video] The Khronos Projector: now in booth #2 www.k2.t.u-tokyo.ac.jp/members/alvaro/Khronos

20 Interesting links: S. Jaschko. Space-Time Correlations Focused in Film Objects and Interactive Video. Future Cinema.The Cinematic Imaginary after Film. Edited by Peter Weibel, MIT Press, (2003).Space-Time Correlations Focused in Film Objects and Interactive Video Levin, Golan. An Informal Catalogue of Slit-Scan Video Artworks, (2005).An Informal Catalogue of Slit-Scan Video Artworks


Download ppt "Ishikawa-Namiki-Komuro Lab UNIVERSITY of TOKYO Alvaro Cassinelli Takahito Ito Masatoshi Ishikawa Untying space-time with the."

Similar presentations


Ads by Google