UCSD Center for Hybrid Multicore Productivity Research

crca.ucsd.edu/sheldon crca.ucsd.edu/sheldon

Center for Research in Computing and the Arts Inventing new art forms by creating new technologies Director, Sheldon Brown Associate Director, Miller Puckette

Calit2 215,000 gross square feet Clean room including: Circuits laboratory Optical networking laboratory Rooftop "antenna garden" New Media Arts research labs: 200-seat auditorium Gallery, Black Box, High Def production, motion capture, Gamelab, spatialized audio, virtual reality, 3D fabrication

PI - Sheldon Brown, Director of CRCA Staff - Todd Margolis – CRCA Technical Director Erik Hill - Programmer Analyst Daniel Tracy - Programmer Analyst Kristen Kho – Programmer Analyst Robert Twomey - Programmer Analyst Potential Affiliated Faculty - Henrik Wann Jensen, Associate Professor CSE Bill Lin, Associate Professor, ECE Geoff Voelker - Professor CSE Scott Baden - Professor CSE Rajesh Gupta, Professor CSE Tom Defanti, Research Professor Calit2 Keith Marzullo - Professor CSE Larry Smarr - Professor CSE UCSD/CRCA/Calit2 CPMR Staff

UCSD CRCA/Calit2 Facilities IBM z10 mainframe with the San Diego Supercomputer Center 4 Blade QS20 Cell Cluster, QS22 Blade Cluster computer resources Experimental Game Lab - quad core PC's - Nvidia 280 and Quadro 5400 Larrabee development systems (forthcoming) 16 sided StarCAVE (immersive VR stereo surround environment) 200 Megapixel tiled display wall 55 screen tiled 3D Varrier screen display. 4K cinema technology - Sony SXRD Projector, JVC 4K projection, Zaxel 4K servers, JPEG2000 encoder/decoder, 10gb network streams, Prototype 4K and stereo display panel prototypes Spatialized Audio Research Lab - 26 Channel 3D sound lab Motion Capture/Computer Vision Research Lab - 24 channel VICON motion capture system, 3D laser scanning, structured light, multi-channel video. VR Development Lab - variety of interfaces and display types HD Production Environment - Studio and multibay editing Optiputer network environment - Global Lambda Infrastructure 3D Fabrication Lab - rapid prototyping and CNC machining tools

Visualization Labs Multi-screen, multi-user virtual reality environments accessing large database servers. Clustered, Multi- core computers drive innovative display and HCI.

Digital Cinema Auditorium ultra-high resolution cinema, 3-D sound; tele-presence conferencing; stereo imaging, Cine-Grid optical ultra-high bandwidth

Mutable Media Production Environments Networked Mainframe and Hybrid Multicore Blade Servers for interrelating the development of new forms of digital cinema and virtual worlds. Peking University the San Diego Supercomputer Center and CineGrid networks as project partners.

Leveraging global lambda networks to improve performance for extremely high bandwidth and time dependent applications such as cinema, teleconferencing and virtual reality.

WAAG, Amsterdam Calit2, UCSD Calit2 and NSF Optiputer Project Allow for High Speed Networks and Ultra-High Fidelity environments.

Experimental Game Lab: An Atelier / Technology Development Studio which creates hybrid forms of culture at the intersection of new media, public space, architecture and art. Underlying this work is the creation of digital technologies as a translational medium that allows for a mutable exchange of forms, sensibilities and gestures. Modeling, simulation and software are the common tools for shaping time and space.

Experimental Game Lab Technology Innovation Technology Innovation Procedural AssetsProcedural Assets Next Generation Computing Hybrid Multicore – Cell ProcessingHybrid Multicore – Cell Processing Multicore x86Multicore x86 Larrabee prototype developmentLarrabee prototype development Mainframe computing for Virtual WorldsMainframe computing for Virtual Worlds Heterogenous Forms Cinema, Media, Architecture, HCI, DisplaysCinema, Media, Architecture, HCI, Displays Development Processes Development Processes PrototypingPrototyping Integration of Modeling and VisionIntegration of Modeling and Vision Pedagogical ApproachesPedagogical Approaches Cultural Innovation Cultural Innovation Critical Engagement Critical Engagement New types of game narrativeNew types of game narrative How do games produce meaning?How do games produce meaning? Gaming is the defining cultural form of the 21 st century. We bring innovative, multi-disciplinary expertise to push forward the technological and expressive fronts. Visualization provides early testbeds for future forms of Gaming, which in turn create new opportunities of visualization research. Intersecting technologies of scientific visualization and the game industry through the creation of new forms of art. Games are cultural experiences that are also social structures – increasingly the situation for cultural forms.

Scalable City – exhibited at museums around the world Zacheta Gallery – Warsaw E3 – Los Angeles Ars Electronica –Austria India International Center – New Delhi Museum of Contemporary Art - Shanghai National Academy of Science, Wash. DC Siggraph San Diego Exploratorium – San Francisco Supercomputing 2007 Sao Paulo, Brazil Los Angeles Barnsdall Art Gallery Beall Center for Art and Technology Rio de Janeiro, Brazil Tokyo

Motion Capture and Computer Vision Integrates the human body into digital media with telepresence, computer vision, motion capture and experimental interfaces, extending the fidelity of the human computer interface. Motion Capture and Computer Vision Integrates the human body into digital media with telepresence, computer vision, motion capture and experimental interfaces, extending the fidelity of the human computer interface. The Audio Spatialization Lab 26 channel, real time spatialized audio The Audio Spatialization Lab 26 channel, real time spatialized audio Ultra High Fidelity Video and Audio Production Experimental Game Lab

XML metadata tags facilitate actions VICON Inc. supports development of computer vision asset creation.

CRCA FabLab Rapid Prototyping and CNC output of Virtual World Data Forms

Cultural forms destabilize every 18 months as their underlying technology base transforms. This leads to the instability of “mediums” as we used to know them. Culture is now a Moore’s law condition. Our media now consists of visualizations of data, algorithms and user interactions (social spaces). Culture = Data + Algorithms + Users Our media now consists of visualizations of data, algorithms and user interactions (social spaces). Culture = Data + Algorithms + Users The Cultural Landscape of the 21st century is radically different from the 20 th century in methods, use and meanings.

Next Generation Culture will develop out of the capabilities that Multicore Computing enables in relationships that we can create between these areas: Assets, Dynamics and Behavior Computation for Virtual worlds and games Multi-user, Extensible Virtual Worlds Future Cinema – 3D, Ultra-high Resolution Production Next Generation Culture will develop out of the capabilities that Multicore Computing enables in relationships that we can create between these areas: Assets, Dynamics and Behavior Computation for Virtual worlds and games Multi-user, Extensible Virtual Worlds Future Cinema – 3D, Ultra-high Resolution Production Initial proposed industry partners: IBM, Intel, Sony, Emergent Game Technologies, Zaxel Inc.