NTT Information Sharing Platform Laboratories / Humboldt University Berlin Yoshitsugu Tsuchiya Wataru Takita NTT Information Sharing Platform Laboratories NTT DoCoMo Corporation Olaf Kath Frank Stoinski Humboldt University Berlin, Dept. of Computer Science Authoring, Composition, and Delivery of Interactive Contents by the use of Multimedia Contents Mill

NTT Information Sharing Platform Laboratories / Humboldt University Berlin Table of Contents 1. Business model and requirements for multimedia content services - {Networked, Broadcasting, Published}Content Providers - Consumer, Retailer, and Content fabricator 2. System support for retailing services - Distributed content authoring and fabrication support - Content brokerage - Content delivery 3. Content delivery support by Multimedia Contents Mill - QoS information mapping - Network configuration, adaptive stream control 4. Implementation of content delivery functions - System structure 5. Conclusion

NTT Information Sharing Platform Laboratories / Humboldt University Berlin Trend and requirement in multimedia services (1) Consumers participation in multimedia contents creation - Former “Consumer” and “User” roles are beginning to provide contents and values in the multimedia services. - “Peer-to-peer” contents sharing demands an environment for the re-use (fabrication) of contents. - Community-oriented contents sharing is key for the market expansion. (2) Participation of market with low initial cost - Contents provider/ creator prefer environment for low-barrier and quick participation in the market. (3) Mediator for rights and commission is needed - Peer-to-peer contents sharing requires a mediating role to resolve rights and payment problems.

NTT Information Sharing Platform Laboratories / Humboldt University Berlin Business model for multimedia contents services (1) - Content delivery Consumer Content fabricator Retailer (as ASP) Content provider (broadcasted / packaged content) Content provider (networked content) -Provision of broadcasting/package contents - Contents usage fee - Viewing of advertisement - Contents usage fee - Viewing of advertisement -Application service for content composition -Commission for content composition -Content composition -Commission for application services -Application service for content registration -Marketing information -Contents registration -Commission for application services -Application service for content creation -Data storage and delivery -Marketing information -Dealing/ transaction agency -Contents creation -Contents registration -Commission for application services -Commission for content composition

NTT Information Sharing Platform Laboratories / Humboldt University Berlin - Content delivery Consumer Content fabricator Retailer (as ASP) Content provider (broadcasted / packaged content) Content provider (networked content) -Provision of broadcasting/package contents - Contents usage fee - Viewing of advertisement - Contents usage fee - Viewing of advertisement -Application service for content composition -Commission for content composition -Content composition -Commission for application services -Application service for content registration -Marketing information -Contents registration -Commission for application services -Application service for content creation -Data storage and delivery -Marketing information -Dealing/ transaction agency -Contents creation -Contents registration -Commission for application services -Commission for content composition (TINA Consumer / Retailer) (TINA Retailer / Network Service Provider) (TINA Content Provider) (TINA Consumer) Business model for multimedia contents services (1)

NTT Information Sharing Platform Laboratories / Humboldt University Berlin ◆ Retailer - Supports content sharing among (a) networked content, (b) broadcasted content, and (c) packaged content. - Mediates commercial rights of content by management of application services (e.g. license key management, usage restriction) - Provides application services as ASP (application service provider) for the authoring, registration, storage, and delivery of multimedia data. ◆ Content fabricator - Fabricate existing contents in order to put additional values - Provide own data to the consumer, which is stored in their storage equipments. Business model for multimedia contents services (2)

NTT Information Sharing Platform Laboratories / Humboldt University Berlin System support for retailing services ◆ Distributed multimedia authoring / fabrication support ・ Content authoring, storage, and registration support ・ Content fabrication support ◆ Multimedia content brokerage ・ Supporting system for registration, search, and catalog management for distributed multimedia data ・ Data sharing functionalities for the consumers (information referencing and storage management) ◆ Multimedia content delivery ・ Service provision by the combination of networked, broadcasted, and packaged contents ・ Data delivery and network control /configuration ・ Control for the Consumer premises equipment

NTT Information Sharing Platform Laboratories / Humboldt University Berlin Media Meta Data Repository Media Repository Retailer Content Delivery Scheduler Content Provider Media Manager retrieve media manager by media key use media manager to access media content fabricator use registered media meta data for composition reference media by media key Content brokerage by meta data repository -Supports registration, storage, searching, catalog management, and re-use (fabrication) of distributed multimedia data.

NTT Information Sharing Platform Laboratories / Humboldt University Berlin Table of Contents 1. Business model and requirements for multimedia content services - {Networked, Broadcasting, Published}Content Providers - Consumer, Retailer, and Content fabricator 2. System support for retailing services - Distributed content authoring and fabrication support - Content brokerage - Content delivery 3. Content delivery support by Multimedia Contents Mill - QoS information mapping - Network configuration, adaptive stream control 4. Implementation of content delivery functions - System structure 5. Conclusion

NTT Information Sharing Platform Laboratories / Humboldt University Berlin MediaClip 1 (Motion picture) Fade-in / out Application service QoS MediaClip 2 (text and still picture) MediaClip 3 (motion picture) Synchronized playing time QoS Multimedia stream Multimedia stream QoS XML description of application service QoS Multimedia stream “Frame rate should be at least 30 [fps]” “Scene change gap should be within XX [sec]” Synchronization gap should be within XX [sec]” -Application service QoS is described using XML tags, indicating visual presentation quality, demanded by the content creators.

NTT Information Sharing Platform Laboratories / Humboldt University Berlin Application service QoS Network Service QoS (e.g. for ATM) Control information for app. level communication - Data transmission rate - Stream buffer size - Data transmission schedule - Priority control - Service class (CBR, VBR,…) - Cell rate （ Peak / Sustainable) - Maximum burst size (MBS), - Peak-to-Peak cell delay variation - Maximum cell transmission delay - Cell loss rate(CLR) - Traffic policing ／ Shaping parameter QoS info mapping Repository Mapping of QoS information - Image size - Image precision, color palette information - Compression rate - Frames per second - Delay ／ synchronization gap tolerance - Frame loss rate tolerance QoS information conversion using Multimedia Contents Mill

NTT Information Sharing Platform Laboratories / Humboldt University Berlin Table of Contents 1. Business model and requirements for multimedia content services - {Networked, Broadcasting, Published}Content Providers - Consumer, Retailer, and Content fabricator 2. System support for retailing services - Distributed content authoring and fabrication support - Content brokerage - Content delivery 3. Content delivery support by Multimedia Contents Mill - QoS information mapping - Network configuration, adaptive stream control 4. Implementation of content delivery functions - System structure 5. Conclusion

NTT Information Sharing Platform Laboratories / Humboldt University Berlin (11) Notification of server status Media Data Consumer / Content Fabricator Terminal Profile ・ Computing capability ・ Network Device Information ・ Multimedia Device Information Retailor (ASP) Communication network Data Library Data Library Network Interface （ (4) Service initialization / Terminal profile registration (5) Output of Network control information Networked Content Provider (12) Acquisition of network status information (6) Configuration / control of network resources XML document ・ Media Information ・ Presentation Control ・ QoS information (8) Receive of data stream (9) Visualization (1) Contents registration (2) Contents Deployment (13) Transferring rate control Contents Server Media Encoder Contents Deployment (7) Transmission of data stream (10) Notification of presentation quality Player Application Media Decoder Stream Control (3) Extraction of Application QoS Contents Registration QoS information mapping Implementation of stream delivery system

NTT Information Sharing Platform Laboratories / Humboldt University Berlin Summary Conclusion A business model with Consumer, Content Provider, Retailer, and Content Fabricator, in the trend of community-oriented multimedia communications. Extraction of necessary functionalities (content authoring ASP, brokerage, delivery) for multimedia contents sharing services. Multimedia Contents Mill, a functionality to control multimedia streams, by obtaining necessary information from application-level requirements embedded in multimedia data. Future works Brush-up of business model and formation, by marketing experiences. Detailed design of content authoring /fabricating applications. Mapping logics for QoS conversion, with implementation-oriented performance evaluation.