Presentation on theme: "Mark Sandler Making Metadata Work, 23 June 2014. Semantic Media – Problem Area TV Productions Music / Radio Productions Film Productions Photo Productions."— Presentation transcript:
Mark Sandler Making Metadata Work, 23 June 2014
Semantic Media – Problem Area TV Productions Music / Radio Productions Film Productions Photo Productions Consumer: How to find relevant content in large media collections? Producer: How to monetize, how to subvert piracy? Source of images: Google
Navigation in Content Collections: Previous Approaches Automatic annotations often not as detailed and robust as needed Reason: Metadata does not incorporate relevant external information Reason: Automatic methods have no access to knowledge only available during production, so at best does partial reverse engineering User interfaces are not as rich as needed
Semantic Media - Concept 1: Annotation As Part of Production Workflow Employing knowledge of the production process leads to simplified and hence more robust (automatic/assisted) metadata generation procedures Integrating additional information usually discarded after production allows for richer annotations Resulting novel workflow systems facilitate automation and assist content producers as well consumers throughout the content life-cycle
Semantic Media - Concept 1: Example Source of image: Wikipedia Metadata: Where was this picture taken? What is in it? What’s the weather like?
Semantic Media - Concept 1: Example Metadata: Who are the actors (in this episode)? What are the story lines? Find the scene with crying.
Semantic Media - Concept 2: Incorporating Global Knowledge Using Linked Data Technology Managing and exposing enhanced metadata using semantic web and linked data technology allows for uniting various sources of information and thus improving the user experience with richer interfaces
Semantic Media - Concept 2: Example BBC Music website Structured Wikipedia Data + Improved User Experience = More about this later…
Catfishsmooth: Linked Data Demo Originally by Kurt Jacobsen See also
Linked Open Data in Sept 2011
Goals of the Semantic Media Project Encourage leading researchers to develop roadmaps guiding the direction of future research efforts and grant applications Encourage substantial grant applications: UK & EU Creating a forum for researchers / developers Encouraging interdisciplinary research bringing together specialists across the entire ICT sector Sparking new collaborations between researchers (including industry partners) by funding mini-projects, student exchanges and internships
Funding - Opportunities and Examples Exchange of students across working groups and internships / placements Construction of ontologies appropriate for 3D+t content description (sound, video, objects) Capturing of motion information in a film/tv set to capture scene-descriptive metadata to associate with the primary media stream (i.e. video) Fusion of metadata from disparate sources to build a composite metadata stream associated with a single media stream, propagating through the value chain from producer to consumer, e.g: Metadata from several musical instruments to create a composite harmony stream Motion metadata streams from several actors in a scene to create a composite action stream Combining rights-related metadata (e.g. using MPEG Value Chain Ontology ), user generated and other tags downstream from creation Application of temporal logic on (time-structured) media metadata streams  Use of capture-at-source metadata to enhance the production workflow Ethnographic studies of metadata-enhanced production tools to assess their fitness for purpose
Large-Scale capture of Producer-Defined Musical Semantics Project Partners: Birmingham City University Queen Mary Univ of London Birmingham Conservatoire Aims Capture semantics behind parameters in audio production software Map low-level parameters to high-level concepts (timbre, ‘bright’, ‘warm’) Create infrastructure to semantically annotate produced music (for meta-data based retrieval and research purposes) Technology: Develop several audio plugins, which capture/ output parameter settings using semantic web data structures Analyse audio and map parameters to perceptual entities
SemanticNews: enriching publishing of news stories Project Partners: University of Southampton University of Sheffield BBC Aims Contextualise broadcast news and discussion around it by identifying concepts and linking them to additional information available as linked open data Demonstrator running at the BBC using ‘BBC Question Time programme’ data Technology: Named Entity Recognition in BBC subtitles, BBC programme data and surrounding Twitter discussions Linking to external authorities (dbpedia) Visualisation
Semantic Linking of Information, Content and Metadata for Early Music (SLICKMEM) Project Partners: Goldsmiths College City University BBC Oxford eResearch Centre Aims Link data/meta data from several information sources about early music Early Music Online (JISC project) Electronic Corpus of Lute Music (AHRC) External sources (e.g. dbpedia) Create unifying ontology for all available data Extract Music Features from scanned score data to support content-based search Link musically similar section using similarity ontology
Tawny Overtone Project Partners: University of Newcastle University of Manchester Aims Overtone: a fully programmable music composition and synthesis environment Tawny-OWL: a programmable, interactive environment for the definition of Semantic Web data schemes (ontologies) Goal: Integrate Tawny and Overtone to generate ontologies appropriate to capture the semantics behind an Overtone ‘music programme’
Second Screen - a fingerprinting driven semantic music recommendation service Project Partners: Queen Mary Univ. of London MPEG Aims Use finger-printing technology to identify a music recording off-the-air using a smartphone/tablet Use ID to retrieve wide range of artist metadata from multiple internet data sources Provide an interface to discover more information about the song/artist/related artist/genres
Ongoing Projects Computational Analysis of the Live Music Archive (CALMA) Project Partners: University of Manchester Queen Mary Univ. of London Oxford e-Research Centre The Internet Archive Content-based analysis (tempo, key, etc) of freely available music content and publication of results as linked data. MUSIC - Metadata Used in Semantic Indexes and Charts Project Partners: University of Northampton Queen Mary Univ. of London Academic Rights Press Merging the Academic Charts Online music meta-data service with linked open data services. WhatTheySaid Project Partners: University of Southampton University College London BBC Automatic generation of timelines from speech data, which summarize main concepts and statements made
Upcoming Projects Semantic Linking of BBC Radio (SLoBR) - Programme Data and Early Music Project Partners: Oxford e-Research Centre BBC Goldsmiths College City University Building a live-demonstrator at the BBC that enriches/contextualizes BBC Radio 3 programme data with EMO/ECOLM information POWkist – Visualising Cultural Heritage Linked Datasets Project Partners: University of Aberdeen Northumbria University Enriched visualization of digitized cultural heritage data (prisoner of war diaries) by integrating linked open data. Dot.rural Digital Economy Hub An Argument Workbench - extracting structured arguments from social media Project Partners: University of Aberdeen University of Sheffield DebateGraph Extraction and semantic representation of discussion threads and arguments from comments to articles and news.
Getting involved Join our mailing list for announcements and discussions Have an idea for a feasibility study and put it on our idea-wiki Help organizing meetings (maybe focused on a specific subfield) Help documenting the research landscape by participating in the landscape-wiki Participate in future meetings, sandpits, tutorials, as well as collaborative grants and paper submissions Help identifying people who might be interested in this network and invite them (or tell us) Check our website: semanticmedia.org.uk and contact (sebastian ewert)