TOPS “Technology for Optical Pixel Streaming”

Slides:

Advertisements

Similar presentations

-Grids and the OptIPuter Software Architecture Andrew A. Chien Director, Center for Networked Systems SAIC Chair Professor, Computer Science and Engineering.

Advertisements

"The OptIPuter: an IP Over Lambda Testbed" Invited Talk NREN Workshop VII: Optical Network Testbeds (ONT) NASA Ames Research Center Mountain View, CA August.

Basic Principles of PACS Networking Emily Seto Medical Engineering/SIMS Center for Global eHealth Innovation April 29, 2004.

Resource Brokering: Your Ticket Into NetherLight Paola Grosso Jeroen van der Ham Cees de Laat UvA - AIR group.

StarPlane & LightHouse Cees de Laat SURFnet EU University of Amsterdam SARA TI TNONCF.

AHM Overview OptIPuter Overview Third All Hands Meeting OptIPuter Project San Diego Supercomputer Center University of California, San Diego January 26,

Electronic Visualization Laboratory, University of Illinois at Chicago Collaborative Visualization Architecture in Scalable Adaptive Graphics Environment.

Global Lambda Integrated Facility (GLIF) Kees Neggers SURFnet Internet2 Fall meeting Austin, TX, 27 September 2004.

Xingfu Wu Xingfu Wu and Valerie Taylor Department of Computer Science Texas A&M University iGrid 2005, Calit2, UCSD, Sep. 29,

Electronic visualization laboratory, university of illinois at chicago Status and Plans for EVL Software Components Jason Leigh, Luc Renambot Venkat Vishwanath,

Optical networking research in Amsterdam Paola Grosso UvA - AIR group.

May TNC2007 Network Description Language - Semantic Web for Hybrid Networks Network Description Language: Semantic Web for Hybrid Networks Paola.

May TERENA workshopStarPlane StarPlane: Application Specific Management of Photonic Networks Paola Grosso SNE group - UvA.

Oct RoN meetingiGrid2005: a lambda networking facility Paola Grosso AIR/ UvA.

Feb ON*VECTOR Photonics Workshop iGrid 2005 Cyber-Infrastructure iGrid2005 Cyber-infrastructure Paola Grosso GigaPort project UvA.

Accomplishments. Applications Earth Sciences SIO OptIPuter Visualization Cluster 10 node IBM PC Cluster driving two 9.2 million pixels IBM T221 displays.

Dutch Tier 1 SARA/NIKHEF & SURFnet Erik-Jan Bos Director of Network Services SURFnet, The Netherlands To/T1 networking meeting, Geneva, Switzerland July.

SURFnet and the LHC Erik-Jan Bos Director of Network Services, SURFnet Co-chair of GLIF TEC LHC T0/1 Network Meeting, Amsterdam January 21, 2005.

“How LambdaGrids are Transforming Science" Keynote iGrid2005 La Jolla, CA September 29, 2005 Dr. Larry Smarr Director, California Institute.

NORDUnet NORDUnet The Fibre Generation Lars Fischer CTO NORDUnet.

Telescience Project and bandwidth challenge on the TransPAC Toyokazu Akiyama Cybermedia Center, Osaka University.

OptIPuter Application-Centered Tools and Techniques Jason Leigh (EVL/UIC) Luc Renambot (EVL/UIC) Paul Wielinga (SARA) Tomohiro Kudoh (AIST) Xingfu Wu (Texas.

LambdaGRID the NREN (r)Evolution Kees Neggers Managing Director SURFnet Reykjavik, 26 August 2003.

Applications Requirements Working Group HENP Networking Meeting June 1-2, 2001 Participants Larry Price Steven Wallace (co-ch)

Date donald smits center for information technology Centre of Information Technology RUG Robert Janz Centre of Information Technology University.

Electronic visualization laboratory, university of illinois at chicago A Case for UDP Offload Engines in LambdaGrids Venkatram Vishwanath, Jason Leigh.

High-quality Internet for higher education and research GigaPort  Overview SURFnet6 Niels den Otter SURFnet EVN-NREN Meeting Amsterdam October 12, 2005.

Chicago/National/International OptIPuter Infrastructure Tom DeFanti OptIPuter Co-PI Distinguished Professor of Computer Science Director, Electronic Visualization.

Dutch Tier Hardware Farm size –now: 150 dual nodes + scavenging 200 nodes –buildup to ~1500 up-to-date nodes in 2007 Network –now: 2 Gbit/s internatl.

Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project Philip Papadopoulos Larry Smarr Joseph Ford Shaya.

GigaPort NG Network SURFnet6 and NetherLight Kees Neggers SURFnet Amsterdam October 12, 2004.

GLIF Infrastructure Kees Neggers SURFnet SC2004 Pittsburgh, PA 12 November 2004.

BiG Grid at HTC Philips Research Jaap van den Herik BiG Grid and Tilburg University.

Techs in Paradise 2004, Honolulu / Lambda Networking BOF / Jan 27 NetherLight day-to-day experience APAN lambda networking BOF Erik Radius Manager Network.

Advanced IT to Support Digital Libraries Research and Academic Computing & Telecommunications Divisions UITS.

University of Illinois at Chicago Electronic Visualization Laboratory (EVL) SuperDuperNetworking Transforming Supercomputing …from the point of view of.

NL Service Challenge Plans Kors Bos, Sander Klous, Davide Salomoni (NIKHEF) Pieter de Boer, Mark van de Sanden, Huub Stoffers, Ron Trompert, Jules Wolfrat.

HEPix April 2006 NIKHEF site report What’s new at NIKHEF’s infrastructure and Ramping up the LCG tier-1 Wim Heubers / NIKHEF (+SARA)

O AK R IDGE N ATIONAL L ABORATORY U.S. D EPARTMENT OF E NERGY Probe Plans and Status SciDAC Kickoff July, 2001 Dan Million Randy Burris ORNL, Center for.

TOPS “Technology for Optical Pixel Streaming” Paul Wielinga Division Manager High Performance Networking SARA Computing and Networking Services

Advances Toward Economic and Efficient Terabit LANs and WANs Cees de Laat Advanced Internet Research Group (AIRG) University of Amsterdam.

GigaPort NG Network SURFnet6 and NetherLight Erik-Jan Bos Director of Network Services, SURFnet GDB Meeting, SARA&NIKHEF, Amsterdam October 13, 2004.

The OptIPuter Project Tom DeFanti, Jason Leigh, Maxine Brown, Tom Moher, Oliver Yu, Bob Grossman, Luc Renambot Electronic Visualization Laboratory, Department.

Electronic Visualization Laboratory, University of Illinois at Chicago Pacific Research Platform Scalable Visualization and Virtual-Reality Team

IWarp Based Remote Interactive Scientific Visualization CENIC 2008 Oakland, CA Scott A. Friedman UCLA Academic Technology Services Research Computing Technologies.

WHAT SURF DOES FOR RESEARCH SURF’s Science Engagement TNC15 June 18, 2015 Sylvia Kuijpers (SURFnet)

University of Illinois at Chicago Lambda Grids and The OptIPuter Tom DeFanti.

NSF International Research Network Connections (IRNC) Program: TransLight/StarLight Maxine D. Brown and Thomas A. DeFanti Electronic Visualization Laboratory.

DutchGrid KNMI KUN Delft Leiden VU ASTRON WCW Utrecht Telin Amsterdam Many organizations in the Netherlands are very active in Grid usage and development,

“OptIPuter: From the End User Lab to Global Digital Assets" Panel UC Research Cyberinfrastructure Meeting October 10, 2005 Dr. Larry Smarr.

Optical/Photonic Networking and Grid Integration Cees de Laat Advanced Internet Research Group (AIRG) UvA.

J. Templon Nikhef Amsterdam Physics Data Processing Group Large Scale Computing Jeff Templon Nikhef Jamboree, Utrecht, 10 december 2012.

May 17, 2010 Michal Krsek CESNET Use of high speed photonic networks for effective use of very high quality media production.

TransLight/StarLight, GLIF and OptIPuter

Grid Optical Burst Switched Networks

NL Service Challenge Plans

SURFnet6: the Dutch hybrid network initiative

Title Subtitle.

A. Rama Bharathi Regd. No: 08931F0040 III M.C.A

StarPlane: Application Specific Management of Photonic Networks

DEISA : integrating HPC infrastructures in Europe Prof

The SURFnet Project Bram Peeters, Manager Network Services

Using High-Resolution Visualization over Optical Networks

Agenda Global Lambda Integrated Facility (GLIF) Function of GOLE’s

Global Lambda Integrated Facility

TOPS “Technology for Optical Pixel Streaming”

Optical SIG, SD Telecom Council

The OptIPortal, a Scalable Visualization, Storage, and Computing Termination Device for High Bandwidth Campus Bridging Presentation by Larry Smarr to.

Optical Networking Activities in NetherLight

Presentation transcript:

TOPS “Technology for Optical Pixel Streaming” Courtesy EVL Paul Wielinga Division Manager High Performance Networking SARA Computing and Networking Services wielinga@sara.nl

iGrid2005 - GLVF OptIPuter panel Outline About SARA Rationale for adapting OptIPuter concept TOPS Demonstration US117b at iGrid2005 (Preliminary) Results Other demo’s SARA is involved in iGrid2005 - GLVF OptIPuter panel

SARA Computing and Networking Services SARA: National e-Science Support Center Home of Dutch Supercomputing infrastructure SURFnet NOC SURFnet6 major core node NetherLight (sister site of StarLight) Amsterdam LightHouse OptIPuter affiliate international partner LHC Tier-1 site Proposed LOFAR storage site SARA is independent and not-for-profit iGrid2005 - GLVF OptIPuter panel

Teraflops, Terabytes, Terabits, Terapixels @SARA STK tape library SGI Altix 3700 Linux Nationaal Rekencluster IBM Cluster 1600 CAVE Pool of national resources SGI Origin 3800 Netherlight Tiled-panel display SURFnet 6 iGrid2005 - GLVF OptIPuter panel

iGrid2005 - GLVF OptIPuter panel Why we adopt OptIPuter Science pull: Petabytes of complex data explored and analyzed by nationally and internationally dispersed scientists, in many teams SARA’s mission as e-Science Support Center ~PBytes/sec LHC Tier-1 site (with NIKHEF) Brain Activity Analysis Univ Utrecht Life Sciences LOFAR iGrid2005 - GLVF OptIPuter panel

Why we adopt OptIPuter (2) Technology push: SURFnet6 – Hybrid Optical and Packet Switching Network 5 Photonic RIngs Light Path Provisioning for all universities and research institutions in NL iGrid2005 - GLVF OptIPuter panel

TOPS Technology for Optical Pixel Streaming Use OptIPuter concept to split visualization from display Render images from very large data sets on central visualization cluster Use high speed (lambda) networks to stream pixels to ultra-high resolution tiled panel displays Adapt the idea of video streaming: constant stream of pixels from renderer to display Use lossy protocols for long distance connectivity: High performance TCP hard to achieve, UDP performance trivial Light weight application Possibly incorporated in SAGE (EVL and UCSD)? iGrid2005 - GLVF OptIPuter panel

iGrid2005 - GLVF OptIPuter panel DEMO US117b – GLVF TOPS Very large 2D and 3D datasets located at SARA in Amsterdam Render cluster (29 nodes) at SARA 20 Gbps connectivity between cluster and NetherLight, via University of Amsterdam switch 2 * 10 Gbps lambda between Amsterdam and San Diego (SURFnet, CaveWave, WANPHY Amsterdam-SD) UCSD LambdaVision display at iGrid: 100 Megapixel Tiled Display 1 Frame = 100 Mpixel*24 bits = 2.4 Gbits Uncompressed and compressed mode Streaming pixels from Amsterdam to San Diego iGrid2005 - GLVF OptIPuter panel

iGrid2005 - GLVF OptIPuter panel Preliminary results First demoslot, 1 10 Gbps available Sustained bandwidth used between rendering and display 9.2 Gbps Second demoslot, 2 * 10 Gbps Sustained bandwidth 5,3 + 6,2 = 11,5 Gbps iGrid2005 - GLVF OptIPuter panel

iGrid2005 - GLVF OptIPuter panel Final results Third demoslot, 2 times 10 Gbps available Sustained bandwidth used between rendering and display 18 Gbps Peak bandwidth of 19.5 Gbps! New world record of transatlantic bandwidth usage by one single application visualizing scientific content iGrid2005 - GLVF OptIPuter panel

iGrid2005 - GLVF OptIPuter panel Preliminary results Limitation was MTU size – not whole path was jumbo-frame enabled Display cluster had 100% cpu load due to small MTU size Large UDP packet loss (upto 50%) Noticable difference in latency (visible) between CaveWave (with 4 switches) and direct WANPHY connection Later today: new trial with jumbo frames enabled Expect higher framerate and bandwidth usage of 15 Gbps or more iGrid2005 - GLVF OptIPuter panel

iGrid2005 - GLVF OptIPuter panel iGrid2005 demonstrations US117b: GLVF – Unreliable Stream of Images (TOPS) SARA participation in other demo’s: US117a: SAGE (EVL) computing support in Amsterdam NL102: Dead Cat (UvA) – Visualization support (Amsterdam) US106: 10 Gb line-speed security (NORTEL) – Networking and computing support (Amsterdam) iGrid2005 - GLVF OptIPuter panel

iGrid2005 - GLVF OptIPuter panel Credits Bram Stolk (SARA) Jeroen Akershoek (SARA) Ronald van der Pol (SARA) Pieter de Boer (SARA) Hanno Pet (SARA) University of Amsterdam (Paola Grosso et al.) SURFnet (Dennis Paus et al.) Jason Leigh, Luc Renambot, Lance Long and colleagues at EVL and UCSD iGrid2005 networking and LambdaVision crews iGrid2005 - GLVF OptIPuter panel

Thank You