1. multimedia archiving on the Web
IST
multimedia archiving on the Web
Geneva, April 2004
23 April 2004
InDiCo, MF

2. Background Digital publishing in Academia 1991 Archives (text, images)
E-Journals (text, images, some video)
2000 DB’s (citations, OAI’s)
Conferences (slides, audio, some video)
2002 Integration starting…
2003? Lectures (text, slides, multimedia)
2004? Conference/lecture archives?
? 3G mobile access? :)
23 April 2004
InDiCo, MF

3. Digital Research Community, I
Information Providers
Authors
Organizers
Preprint
repositories
Multimedia Repositories
Events (conferences,…)
Databases
Information Managers
Databases
Processing
Multimedia scan
Editors and Publishers
Citation Discovery
Personal Folders
Web GUI
DIGITAL COMMUNITY
Quality Control Tools
Multi-layering (annotations, …)
3rd Generation Porting
Reviewers
Cognitive Filtering
Social Filtering
Search Engines
Information Retreival Assistance
Searchers
Readers
23 April 2004
InDiCo, MF
Information End-Users

4. Digital Research Community, II
Integrated User Interface
Quality
Control Tools
Personal
Folder
Filtering
Assisted
Search
Archives
Cite index
Journal
iM2
iConference
News DB DB DB DB DB
Open Archive
InDiCo proper
DataBase
Core Module
23 April 2004
InDiCo, MF

5. Indico proper: Overall architecture
Advanced Search
Torii.info
Filtering
OAI
Streaming
Recording
iConference
iM2
XML
Audio recognition
Video segmentation
fs/rpc
Conference
Web
Management
INDICO
( make-a-conference )
Submission
23 April 2004
InDiCo, MF

6. Development lines M2 search [TNO (audio)-UvA (video)]
Make-a-Conf (INDICO) [CERN]
M2 archive/DB (metadata) [CERN-SISSA]
Communication protocols [CERN-SISSA]
Filtering [UNIUD]
GUI-Torii integration [SISSA]
Search [TNO (clustering and cross-linking)]
23 April 2004
InDiCo, MF

7. InDiCo archiving goals
Provide repositories for conferences and multimedia files
Integrate with conference organization tool
Apply analysis tools to the material
Provide access to the repositories and to their content via search & filtering facilities at the Torii level.
23 April 2004
InDiCo, MF

8. iM2 – Archive of lectures, seminars, talks - I
Features implemented:
Long term storage, OAI provider (unique id etc)
Category based (customizable disciplines)
Versions aware (original document revisions kept)
Archive basic functions (submit etc) and own search engine.
In addition to multimedia files, can store also announces of future broadcasted talks.
On demand streaming and automatic recording from the web.
Automatic presentation building (Real-SMIL with author input) …
23 April 2004
InDiCo, MF

9. iM2 – Archive of lectures, seminars, talks - II…
Search in audio speech using the M2AS module (multiple formats).
Storyboard of video using the M2VS module (mpeg2).
Documentatation updated, help online.
Current phase: Filling with content from CERN and the WEB. Testing audio and video scan with more formats.
23 April 2004
InDiCo, MF

10. iM2 interface
23 April 2004
InDiCo, MF

11. iConference – Archive of conference metadata
Features implemented:
Long term, OAI provider (unique id etc).
Category based.
Single version (no need to keep conference revisions).
Lists past and future conferences.
Conference metadata has sessions, schedule, contributions (talks, posters, etc), general enough for most academic conferences.
Contributions are archived externally (in iM2 or other archives).
Interface familiar with iM2.
Current phase: filling with content from CERN – then MaKaC submissions (in test stage) , e.g. later this year CHEP, as a good start!
To be licensed under LGPL. ?
23 April 2004
InDiCo, MF

12. iConference interface
23 April 2004
InDiCo, MF

13. Hardware
Linux file server, 3TB redundant disk, 3yrs assistance, for iM2 and iConference.
Separate Linux processing server, for Audio analysis (two cpu) (to replace the current test server soon).
Separate Windows server for Video segmentation.
All gigabit connected.
Video SISSA: Multimedia room installed, beginning to record events (up to now with (rare) human assistance).
Quicktime streaming server for SISSA events.
23 April 2004
InDiCo, MF

14. Problems encountered Varying conference requirements:
very discipline dependent, may imply customization (thus Open Source)
Proceedings archival:
until superseded… arXiv? Or an other simple archive?
Synchronization:
between live conference and archived copy: need more test.
Multimedia:
formats: solved with choice of mpeg2 storage + ad-hoc transformation
production: hardware not standard yet. No TeX here :(
streaming: protocols are still evolving too much.
Documentation:
no standard UML tools to work cooperatively
word processors, don’t match with CVS.
Web Browsers/SMIL viewers:
still too little respect for standards.
23 April 2004
InDiCo, MF

15. Technologies used Mostly Open Source (our personal rating)
Building blocks:
iM2/iConference: Java, Apache (), Tomcat. ()
MaKaC: Phyton
Development tools: Emacs, CVS, NetBeans (), Together ()
Web presentation layer:
iM2/iConference: Echo () (obj. oriented, browser independent)
MaKaC: taglib
Torii search wrapper: php ()
OAICat for OpenArchive server ()
Database layer:
MySQL ()
DBmaintainer (DB version control, developed by us)
Persistence: Torque () or ZopeDB
Audio/Video conversion and streaming : open source libs: ffmpeg, etc.
23 April 2004
InDiCo, MF