Digital Asset Management Systems & Application Jim DeRoest, Director Streaming Media Technologies www.digitalwell.org.

Slides:



Advertisements
Similar presentations
Jim DeRoest Director, e-Science Initiatives Pacific Northwest Gigapop Director, Technology Initiatives ResearchChannel, U Washington
Advertisements

Putting the Pieces Together Grace Agnew Slide User Description Rights Holder Authentication Rights Video Object Permission Administration.
UW MediaWeb Project Jim DeRoest Director Streaming Media Technologies, ResearchChannel Assistant Director, UW Computing & Communications
Digital Music and Audio Projects at Indiana University Jon Dunn Digital Library Program Indiana University August 16, 2001.
ViDe Video-on-Demand Initiatives Mairéad Martin, University of Tennessee April 25, 2002.
Advanced Applications Streaming Video Streaming Video Over Internet2 Networks Bring Public Television Resources to Campus.
Evolving the LINKS What is eLinks? eLinks is a tool for sharing video and other assets, and for collaborative production, among Public TV stations.
DigitalWell Where We Are Now Jim DeRoest March 2004.
MOVING IMAGE COLLECTIONS A Window to the Worlds Moving Images Grace Agnew – March 2004.
Evolving the LINKS Evolving the Links Wisconsin Public Television University of Wisconsin-Extension Tina Hauser March 23, 2004.
SURA/ViDe 5th Annual Digital Video Workshop GCATT Atlanta, Georgia March 26, 2003 The ViDe Guide to Streaming Media.
Desktop iHDTV Jim DeRoest. iHDTV Efforts ResearchChannel Hrs MPEG2 SD 5.6mbps SDI/HD 19.2mbps 270mbps Realism to K20 NextGen Networks.
Beyond the Google Book: the Future of the Digital Library Cory Snavely Library IT Core Services manager University of Michigan April 20, 2010.
A Community Approach to Preservation: Experiences with Social Science Data ASIST Summit 2010 Jonathan Crabtree April 9, 2010.
National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Data Grids for Collection Federation Reagan W. Moore University.
Preserving and Sharing Digital Data Greg Colati, Director, Archives and Special Collections May 11, 2012.
Birtel Network Te chnologies 2010 WebTV.
New Jersey Digital Video Initiative 1 A Collaborative Project Between &
Digital Collections: Storage and Access Jon Dunn Assistant Director for Technology IU Digital Library Program
1 SMETE.ORG and the National SMETE Digital Library Brandon Muramatsu Project Director, SMETE.ORG
OCLC Digital Archive Overview Judith Cobb LIPA Meeting July 2006.
Exploratorium.edu on Internet2 Deb Hunt Internet Librarian Annual Conference Deb Hunt Internet Librarian Annual Conference
Goals for RUcore o Flexible, extensible cyberinfrastructure for Rutgers University o Integrating platform for legacy information systems o Support preservation.
Tom Lewis Director, Academic & Collaborative Applications University of Washington.
WMS: Democratizing Data
Internet Resources Discovery (IRD) IBM DB2 Digital Library Thanks to Zvika Michnik and Avital Greenberg.
An Overlay Multicast Infrastructure for Live/Stored Video Streaming Visual Communication Laboratory Department of Computer Science National Tsing Hua University.
DigitalWell Digital Asset Management Systems & Applications Jim DeRoest, Director Streaming Media Technologies
New Jersey Digital Video Initiative 1 Grant partners.
An Introduction to DuraCloud Carissa Smith, Partner Specialist Michele Kimpton, Project Director Bill Branan, Lead Software Developer Andrew Woods, Lead.
1 NETE4631 Communicating with the Cloud and Using Media and Streaming Lecture Notes #14.
JMU Online Video Collection Background and Technical Processes for the VIVA Multimedia Collections Task Force Jeff Clark, Grover Saunders James Madison.
APAN / QuestNET 2004 Cairns Uncompressed HD Video / ip.
Jim DeRoest Director, Streaming Media Technologies ResearchChannel, University of Washington Director, e-Science Initiatives Pacific Northwest Gigapop.
Design Windows Media Services Infrastructure. Module 7: Design Windows Media Services Infrastructure Design Windows Media Services for live streaming.
DuraCloud A service provided by Sandy Payette and Michele Kimpton.
SobekCM’s Community Ecosystems & Socio-Technical Practices Presented by Mark V. Sullivan June 10 th, 2014 Sobek image created by Jeff Dahl and is shared.
DuraCloud Managing durable data in the cloud Michele Kimpton, Director DuraSpace.
ResearchChannel: Think Forward. Think Success. Michael Wellings, Director, Engineering San Diego.
Challenges of Digital Media Preservation Karen Cariani, Director Media Library and Archives Dave MacCarn, Chief Technologist.
The Global Video Grid: DigitalWell Update & Plan For SRB Integration Myke Smith, Manager Streaming Media Technologies University of Washington / ResearchChannel.
Towards Total Integration: Broadcast, Computing & Networking Jim DeRoest, Director Streaming Media Technologies.
Michał Kwiatek IT-ISWorking meeting 10 October Media Archive File storage and conversion process.
Multimedia and the Institutional Network Greg Newton-Ingham Agora Project Manager - UEA.
An On-Demand Media Repository. Agenda What is Pacific Lighthouse? (Wilke) CENIC/UW/Internet2 Connections (Evans) Other partners (Wilke) Technology (DeRoest)
Jim DeRoest Director Streaming Media Technologies.
Streaming Media A technique for transferring data on the Internet so it can be processed as a steady and continuous stream.
Mingfei Yan Program manager Windows Azure Media Services.
Streaming Architectures for Very Large Collections Jim DeRoest Director Streaming Media Technologies, ResearchChannel Assistant Director, University Computing.
Millman—Nov 04—1 An Update on Digital Libraries David Millman Director of Research & Development Academic Information Systems Columbia University
DuraCloud Open technologies and services for managing durable data in the cloud Michele Kimpton, CBO DuraSpace.
April 14, 2005MIT Libraries Visiting Committee Libraries Strategic Plan Theme III Work to shape the future MacKenzie Smith Associate Director for Technology.
Video Technologies Overview for ISC May 5, 2004 Kent Percival Manager, CCS Development.
Storage Why is storage an issue? Space requirements Persistence Accessibility Needs depend on purpose of storage Capture/encoding Access/delivery Preservation.
Al Cornish, Systems Librarian Washington State University Libraries Preserving Access to Multimedia Collections.
Digital Asset Management: Solutions for Campus Collections Myke Smith Manager, Streaming Media Technologies ResearchChannel.
Kaltura Presentation Kaltura’s Video Solutions for Education Jeffrey Newman Education Account Executive.
An Introduction.  Introduction  Logging in from D1  Raison d'être  RSS and Podcasting  DragonDrop is…  What does it do?  Upload  Available Output.
Streaming Media. What is Streaming Media The delivery of audio, video and other multimedia content across the internet using streaming media servers.
Internet2 Applications & Engineering Ted Hanss Director, Applications Development.
The world’s libraries. Connected. CONTENTdm ® Digital Collection Management Solutions Learn what to consider when outsourcing your library’s digitization.
The world’s libraries. Connected. The Benefits of CONTENTdm Hosting Services OCLC’s Digital Lifecycle Webinar Series April 9, 2013.
ResearchChannel Amy Philipson Asst Vice Provost, Executive Director
TV Broadcasting What to look for Architecture TV Broadcasting Solution
Video Streaming and Hosting
Live Global Sports Events
Intelligent Archiving for Media & Entertainment
Carnegie Mellon University Libraries
Performance and Scalability Issues of Multimedia Digital Library
UKERNA and Streaming Media
Presentation transcript:

Digital Asset Management Systems & Application Jim DeRoest, Director Streaming Media Technologies

Development Original focus broadcast-streaming integration. –ResearchChannel, UWTV, KEXP –Automation: encode, ingest, metadata, schedule, deliver –Scalable standard def, high def, uncompressed streams –Support commodity bit rates and formats Focus expanded to include institutional collections –High-quality and accessible resources to research information. –Educational outreach –Interoperate with other digital repositories Why quality matters … Original focus broadcast-streaming integration. –ResearchChannel, UWTV, KEXP –Automation: encode, ingest, metadata, schedule, deliver –Scalable standard def, high def, uncompressed streams –Support commodity bit rates and formats Focus expanded to include institutional collections –High-quality and accessible resources to research information. –Educational outreach –Interoperate with other digital repositories Why quality matters …

Hours Viewed Increases 200% since Jan 2002 Breakout by Bandwidth Hours Viewed Increases 200% since Jan 2002 Breakout by Bandwidth Webcast and Video OnDemand

Average Viewing Time Duration longer for VOD, higher bandwidths

DigitalWell Project Digital Asset Management System –Hierarchical, clustered infrastructure - Scaling –Pluggable components – Tech Evolution –Interoperation – Auth, Metadata, API –Preservation –Rights – Higher Education Digital Asset Management System –Hierarchical, clustered infrastructure - Scaling –Pluggable components – Tech Evolution –Interoperation – Auth, Metadata, API –Preservation –Rights – Higher Education

What We Built Hardware –Clustered servers – encode, stream, … –NAS Online Storage 12TB Isilon IQ Multi-node, load balancing, single mount point –SAN Nearline Storage STK Silos – 9840 (20GB/cart), 9940 (200GB/cart) –Mirrored architecture Hardware –Clustered servers – encode, stream, … –NAS Online Storage 12TB Isilon IQ Multi-node, load balancing, single mount point –SAN Nearline Storage STK Silos – 9840 (20GB/cart), 9940 (200GB/cart) –Mirrored architecture

What We Built Software –HSM: HPSS, UW Karc (bucket service) –Metadata: MS SQL –Web: IIS –Encoding: Flipfactory, Virage –Streaming: WM, Real, Quicktime, MP3, VideoCharger (MPEG2 5.6mbps,19.2mbps), UW HDCAM/SDTI 270mbps –Multicast: Amnis –DigitalWell State & Redirector Service Software –HSM: HPSS, UW Karc (bucket service) –Metadata: MS SQL –Web: IIS –Encoding: Flipfactory, Virage –Streaming: WM, Real, Quicktime, MP3, VideoCharger (MPEG2 5.6mbps,19.2mbps), UW HDCAM/SDTI 270mbps –Multicast: Amnis –DigitalWell State & Redirector Service

Backend Diagram Insert diagram image - mass store system

Interoperability Metadata –Dublin Core, MPEG7, Custom –OAI, possibly METS –API migration to OKI –LDAP Collection Service – LC/AMIA MIC Access Controls –Pubcookie, Institutional Groups –Shibboleth under development Preservation –OAIS? Metadata –Dublin Core, MPEG7, Custom –OAI, possibly METS –API migration to OKI –LDAP Collection Service – LC/AMIA MIC Access Controls –Pubcookie, Institutional Groups –Shibboleth under development Preservation –OAIS?

Application: Broadcast ResearchChannel, UWTV –Automated Encoding Dub time Mav70 capture 50mbps i-frame MPEG2 Transcode farm – Flipfactory, Virage hrs of standard def 5.6mbps MPEG2 –Broadcast Scheduling Integration Protrack, DW metadata -> Dynamic web schedule Integrated with DW On-Demand library –Standard def MPEG2 multicast International rebroadcast support – ResearchChannel, UWTV –Automated Encoding Dub time Mav70 capture 50mbps i-frame MPEG2 Transcode farm – Flipfactory, Virage hrs of standard def 5.6mbps MPEG2 –Broadcast Scheduling Integration Protrack, DW metadata -> Dynamic web schedule Integrated with DW On-Demand library –Standard def MPEG2 multicast International rebroadcast support –

Application: KEXP Digital Audio Infrastructure Live Broadcast Stream –Uncompressed 1.4mbps –Commodity bit rates Archived Live Broadcast –2 weeks, all formats Realtime Broadcast Playlist –Dynamic web update integrated with DJ console –Archived with live broadcast Digital Audio Infrastructure Live Broadcast Stream –Uncompressed 1.4mbps –Commodity bit rates Archived Live Broadcast –2 weeks, all formats Realtime Broadcast Playlist –Dynamic web update integrated with DJ console –Archived with live broadcast

Institutional Collections Agnostic to data type –Text, docs, photos, video, audio, dataset, … Collection Admin Tool –Metadata profile support –Custom metadata Interoperation: D-Space, ContentDM, … Integration with Catalyst teaching tools Available to UW campus summer qtr 2003 Agnostic to data type –Text, docs, photos, video, audio, dataset, … Collection Admin Tool –Metadata profile support –Custom metadata Interoperation: D-Space, ContentDM, … Integration with Catalyst teaching tools Available to UW campus summer qtr 2003

Outreach & Collaborations Pacific Lighthouse –CENIC, UW, I2 K20 –High quality audio/video to K20 –Content Partners: Densho, Conversations with History, Jason Project, Exploratorium, Cell Systems Initiative, ResearchChannel, KEXP Pacific Lighthouse –CENIC, UW, I2 K20 –High quality audio/video to K20 –Content Partners: Densho, Conversations with History, Jason Project, Exploratorium, Cell Systems Initiative, ResearchChannel, KEXP

Collaboration Moving Image Collections –NSDL, Library of Congress, AMIA –Video collection directory and union catalog – Viewing the Future –NSDL MERIT Michigan Teachers Network –Audio Video Metadata for K12 Multi University Research Library –Computer Science Lecture Collection – Convergence Consortium –CPB, PBS, education collaboration –MARS project – Metadata profile for PBS – Moving Image Collections –NSDL, Library of Congress, AMIA –Video collection directory and union catalog – Viewing the Future –NSDL MERIT Michigan Teachers Network –Audio Video Metadata for K12 Multi University Research Library –Computer Science Lecture Collection – Convergence Consortium –CPB, PBS, education collaboration –MARS project – Metadata profile for PBS –

Projects & Experiments 1.5mbps uncompressed HD over IP 270mbps HD/SDTI live, on-demand 270mbps standard def I2 multicast Desktop HD – 19.2mbps ATSC MPEG2 Interested? –I2 ResearchChannel working group 1.5mbps uncompressed HD over IP 270mbps HD/SDTI live, on-demand 270mbps standard def I2 multicast Desktop HD – 19.2mbps ATSC MPEG2 Interested? –I2 ResearchChannel working group

iGrid Video Across the Atlantic International Partnerships

iGrid Demo