Presentation is loading. Please wait.

Presentation is loading. Please wait.

TERENA Networking Conference 2000 Limerick, June 3-6, 2000 David Shotton, Thomas Boudier, John Pybus, Danny Torbica and Jamie Shotton Image Bioinformatics.

Similar presentations

Presentation on theme: "TERENA Networking Conference 2000 Limerick, June 3-6, 2000 David Shotton, Thomas Boudier, John Pybus, Danny Torbica and Jamie Shotton Image Bioinformatics."— Presentation transcript:


2 TERENA Networking Conference 2000 Limerick, June 3-6, 2000 David Shotton, Thomas Boudier, John Pybus, Danny Torbica and Jamie Shotton Image Bioinformatics Laboratory Department of Zoology, University of Oxford E-mail: The development of VIDOS: a Web-based video editing, customization and repurposing service

3 Personal computing at present l Desktop-centred l Requires multiple individual copies of all applications, and multiple backup facilities l Hardware and software become rapidly outdated and are expensive to replace l Problems with application and version incompatibility between colleagues l Limited use of the network for co-operative computing over long distances l Network bandwidth inadequate for real-time viewing of videos or high quality video conferencing l Use of mass-produced standardized media entities

4 The new paradigm for personal computing l Network-centred l Single copy of most recent version of application on powerful central server l Simple and cost-effective l Enhances inter-personal co-operation CENTRALNETWORKEDSERVERS l Requires advanced infrastructure with high bandwidth network l Permits effective use of central databases and archives l Real-time video viewing possible l Permits customization of personal versions of media entities

5 Two examples of network-centred computing l The BioImage Database, an on-line database for multi-dimensional images and videos of biological specimens l VIDOS, a Web-based video editing, customization and repurposing service

6 Outline of my presentation l The VIDOS prototype l Current VIDOS developments l A VIDOS demonstration l The future of VIDOS: Improving the user interface and spatial editing – the J-Video player Integration with IVANA for semantic content analysis Continuing the VIDOS service as part of VideoWorks for the Grid Integration with video databases The SONGBIRD project for semantics and ontology generation

7 The VIDOS prototype

8 Schematic diagram of the prototype VIDOS system

9 VIDOS a Web-based video customization system l Edit a digital video spatially and temporally over the Web l Adapts the video content, size, format and compression quality to its intended purpose, or to match the capabilities of ones PC l The video may be in a VIDOS-enabled database or anywhere else on the Web, including the users own Web server l VIDOS gives the user basic video editing capabilities without the need to purchase expensive video editing software l By reducing the size of digital video files, VIDOS can improve efficiency by speeding network transfers, reducing bandwidth bottlenecks, and minimizing disc storage

10 Terena Networking Conference Lisbon, 22-25 May 2000 VIDOS - a system for editing and customizing videos over the Web David M. Shotton and Thomas Boudier Session 6A, Coming soon to a monitor near you Chair: Egon Verharen Department of Zoology University of Oxford, UK Conference presentation

11 Journal publication Boudier and Shotton (2000) Computer Networks 34: 931-944

12 The current development of VIDOS

13 The limitations of the VIDOS prototype l Underlying lack of flexibility in the software implementation l Limited video format and codec choice, determined by the outdated underlying Silicon Graphics digital media library employed for video format trans-coding l User interface showed only first and last frames, making temporal editing difficult on videos with scene changes l Inability to splice together different video clips

14 The VIDOS second phase - objectives l To rewrite VIDOS from scratch, to provide a more efficient and extendable software implementation and overcome the limitations of the prototype To enhance VIDOS functionality by expanding the choice of video output formats, and by updating the choice of codecs to include those using the most modern compression algorithms To enhance the user interface for temporal editing To permit the splicing together of separate video clips to create a single new output video file l To launch a VIDOS service for academia via the VIDOS web site

15 The VIDOS Home Page

16 The VIDOS second phase –architecture The VIDOS hardware configuration: l A VIDOS Web server – VIDOS slave processor farm topology The VIDOS Web server: l To undertake user authentication l To serve Web pages and Java applets, and receive parameters l To commission jobs for the slave processors to implement l To control the video filestore and send customized videos to users An expandable farm of slave processors: l To undertake individual video conversion tasks

17 Current VIDOS architecture

18 VIDOS functionality

19 The GALLOP test video Credits Photographer: Eaduard Muybridge, 1878 Racehorse: Annie, a Californian thoroughbred Jockey: unknown Preview video details: Highly compressed AVI preview Zoom factor 50% Compressed file size: 420 Kb Original video details: QuickTime Format M-JPEG compressed Compression quality 0.6 One stride of 15 frames repeated six 90 frames at 30 fps File size: 3,731 Kb

20 The VIDOS input video selection interface

21 The VIDOS output format selection interface

22 The VIDOS spatio-temporal editing interface


24 The VIDOS conversion request interface



27 The final VIDOS- customized video Customized video: Selected area: Jockey and horses head and shoulders only, 50% zoom Selected time: first 45 frames only (three strides) at 10 fps Selected output format: AVI format, Indeo compressed at quality 0.3 File size 91 Kbytes Compressed file approximately 41 times smaller than original Original video: QuickTime format, M-JPEG compressed at quality 0.6, 90 frames (6 strides) at 30 fps File size 3,731 Kbytes

28 Lets try a demo ! Start VIDOS

29 The benefits of VIDOS l For individuals and academic institutions, VIDOS provides: enhanced download times and reduced video storage requirements, free video editing, customization and format conversion facilities, reduced hardware and software costs, and enhanced personal and corporate efficiency l For distributed organizations (e.g. a university with regional campuses): a system for distributed client-based video editing from a centralized server l In education and training: the ability to select and repurpose video clips from a central resource for inclusion in live lectures or computer-based training programs l For academic video databases and video content providers: added value by enabling users to edit and customize selected videos particularly powerful if coupled with a Query-by-Content system

30 Registration of VIDOS Users l We are now seeking VIDOS Users who, as well as using VIDOS for their own productive work, can evaluate VIDOS and advise us on functionality enhancements l If you would like to register as a VIDOS User, please log on to, and complete the Registration Form that you will find under the Registration button. l You will then be sent a password that will give you unrestricted access to VIDOS from any computer

31 Functional developments of VIDOS Further developments of VIDOS functionality will require a break from our previous philosophy of enabling VIDOS to run on any modern browser platform, and will instead require that users first install from the Sun Web site the latest versions of Java and Java Media Framework. This will enable us: l To further enhance the functionality of VIDOS for temporal editing of videos, by incorporating J-Video, our new Java video player that uses Java Media Framework and permits the splicing together of separate video clips IVANA (Interactive Video ANalysis Application) for semantic content analysis l To integrate VIDOS with our other video tools

32 CTL-mediated target cell death

33 The J-Video java video player



36 IVANA for semantic content analysis

37 Semantic content analysis classes Video A temporal sequence of scenes Segment A distinct sequence of video frames FrameA single video frame Character Animate characters (e.g. cells, racing drivers) ObjectInanimate objects (e.g. pipettes, racing cars) BackgroundRegion of image not occupied by objects, etc. EventAn instantaneous or extended happening involving one or more characters or objects SoundAn item on the video soundtrack Area of interestA geometric area enclosing items of interest AnnotationA textual label relating to a character or object InsertA separate image, animation or movie insert

38 Query by Content using VANQUIS l We now plan to combine J-Video for client video manipulation, IVANA (Interactive Video ANalysis Application) for interactive video content analysis, and our alternative VAMPORT (Video Analysis and Metadata Production by Object Recognition and Tracking) system for automated analysis of simple videos, with VideoStore, our semantic content metadata database, and a Query by Content interface, to create VANQUIS (Video Analysis and QUery Interface System) l This will enables users to make such queries as: Find me a sequence showing Lord Jenkins Find me the times of all target cell deaths that occur in the upper left corner of the screen Which CTL are serial killers? Show me them at work!

39 The future of VIDOS as part of VideoWorks for the Grid, an Oxord University e-Science Centre testbed project

40 The VIDEOWORKS partnership l VideoWorks for the Grid is a new umbrella project for these video e-services, launched in the context of the current UK Grid initiatives l It is the first testbed project of the Oxford e-Science Centre l Our VideoWorks industrial partners are IBM Virage Telestream Square Box Systems, and The International DOI Foundation

41 Functionality of VideoWorks l Central to the video e-services within VideoWorks will be the on-line video editing and customization services of VIDOS l The same Java software structure and server-slave protocols as presently developed for VIDOS will be expanded for VideoWorks l We will use VANQUIS for interactive video semantic content analysis l VANQUIS semantic metadata will be stored a VideoStore database modelled upon the BioImage Database l We will use Telestreams FlipFactory for efficient video transcoding Virages VideoLogger for automated structural video analysis IBMs Video Charger for streaming preview videos for editing and analysis

42 The Video- Works for the Grid system

43 Links from VideoWorks to video databases l Links will be made to major academic video databases such as BioImage and the British Film and Video Councils MAAS Media Online l User of these databases can upload videos of interest to VideoWorks either for semantic content analysis using VANQUIS or for editing and customization using VIDOS, before downloading l After semantic content analysis, the semantic content metadata stored within VideoStore will be available for subsequent query by content using the VANQUIS query interface. Videos located by QbC may also be customized using VIDOS before downloading

44 From image to knowledge: the state of the art of image bioinformatics Shotton, D. M. (Nov 2000) Microscopy and Analysis 80: 23-25. In that paper I said that harvesting knowledge from digital videos would require five components: a searchable image database - The BioImage Database an automatic video content analysis system for simple videos - VAMPORT an interactive video analysis system - IVANA a query by content system – VANQUIS a web-based video customization system - VIDOS Combined together, these form a unique and powerful combination to facilitate the conversion of raw video data into knowledge. VideoWorks is the realization of that vision.

45 Thomas Boudier My research assistant 1997-1999 Author of the VIDOS prototype John Pybus VIDOS Research and Development Programmer Has written VIDOS 3.0 John Pybus VIDOS Research and Development Programmer Has written VIDOS 3.0 Danny Torbica VIDOS Project Development Manager Mac expert and Webmaster Danny Torbica VIDOS Project Development Manager Mac expert and Webmaster Jamie Shotton Computer Science Student and VIDOS Java Programmer Has written our Java video player and semantic content analysis module Jamie Shotton Computer Science Student and VIDOS Java Programmer Has written our Java video player and semantic content analysis module

Download ppt "TERENA Networking Conference 2000 Limerick, June 3-6, 2000 David Shotton, Thomas Boudier, John Pybus, Danny Torbica and Jamie Shotton Image Bioinformatics."

Similar presentations

Ads by Google