Benchmarking Textual Annotation Tools for the Semantic Web

Slides:

Advertisements

Similar presentations

Applied Testing and Technology Specialists in Software Testing.

Advertisements

Workshop on Knowledge Technologies within the 6th Framework MayA. Gómez-Pérez Certifying Knowledge and Knowledge Technologies ( based on Sig3 activities.

Definition of a good standard A good standard is a characterised by agreement via negotiation, approval and recognition by a standardisation body, applicability,

1 OOA-HR Workshop, 11 October 2006 Semantic Metadata Extraction using GATE Diana Maynard Natural Language Processing Group University of Sheffield, UK.

UKLeaP – Reflections A practical look at using the standards in proof of concept models of interoperability Kirstie Coolin Application Developer e-Portfolios.

Funded by: European Commission – 6th Framework Project Reference: IST WP6 review presentation GATE ontology QuestIO - Question-based Interface.

Data Mining and Text Analytics GATE, by Joel Bywater.

1 14. Interoperability Database interoperability --- Is the problem of making the data and queries of one database system usable to the users of another.

02/04/09Danica Damljanović1 Natural Language Interfaces to conceptual models: usability and performance Danica Damljanović

Ontology-based Annotation Sergey Sosnovsky

Annotation for the Semantic Web Yihong Ding A PhD Research Area Background Study.

Low-cost semantics-enhanced web browsing with Magpie Enrico Motta Knowledge Media Institute The Open University, UK.

DARPA Agent Markup Language Ashish Jain University of Colorado at Boulder.

A Tool to Support Ontology Creation Based on Incremental Mini-Ontology Merging Zonghui Lian Data Extraction Research Group Supported by.

Design II Due today: Homework #3 Next Class: Pressman 14; User Manual Questions? / Quiz Review Team Status Reports Designing for the Web (WebE) cont. Bio.

PRIVACY, TRUST, and SECURITY Bharat Bhargava (moderator)

Use Case Modelling Visual Annotator for studying ICU Notes Bacchus Beale.

Text mining and the Semantic Web Dr Diana Maynard NLP Group Department of Computer Science University of Sheffield.

Ontology-based Information Extraction for Business Intelligence

Building an Ontological Base for Experimental Evaluation of Semantic Web Applications Peter Bartalos, Michal Barla, Gyorgy Frivolt, Michal Tvarožek, Anton.

Towards a semantic extraction of named entities Diana Maynard, Kalina Bontcheva, Hamish Cunningham University of Sheffield, UK.

A centre of expertise in digital information managementwww.ukoln.ac.uk QA For Web Sites: Approaches To Testing Brian Kelly UKOLN University of Bath Bath,

SemanticWeb.org – Requirements Analysis v0.1.

Air Quality Cluster Earth Science Information Partners Goals 1. Serve as facilitator and advisor.

Break Out Session on Infrastructure and Technology: A Report Vipul Kashyap AOS Workshop, Rome, 15 November 2001

Survey of Semantic Annotation Platforms

Machine Learning Approach for Ontology Mapping using Multiple Concept Similarity Measures IEEE/ACIS International Conference on Computer and Information.

Benchmarking in WP 2.1. Sep 28th, 2004 © R. García-Castro, A. Gómez-Pérez Raúl García-Castro Asunción Gómez-Pérez September 28th, 2004 Benchmarking.

Event-Based Model for Reconciling Digital Entries Thesis Proposal Ahmet Fatih Mustacoglu 10/3/20151Ahmet.

The PrestoSpace Project Valentin Tablan. 2 Sheffield NLP Group, January 24 th 2006 Project Mission The 20th Century was the first with an audiovisual.

1 Technologies for (semi-) automatic metadata creation Diana Maynard.

Themes Architecture Content Metadata Interoperability Standards Knowledge Organisation Systems Use and Users Legal and Economic Issues The Future.

Benchmarking Methodology. Sep 27th, 2004 © R. García-Castro, A. Gómez-Pérez Raúl García-Castro Asunción Gómez-Pérez September 27th, 2004 Benchmarking.

University of Sheffield NLP Teamware: A Collaborative, Web-based Annotation Environment Kalina Bontcheva, Milan Agatonovic University of Sheffield.

Semantic Technologies & GATE NSWI Jan Dědek.

© Copyright 2008 STI INNSBRUCK Semantic Annotation Semantic Web Lecture Dieter Fensel.

Requirement for Enterprise Directory Services A Customer Influenced Perspective TOG DCE Program Group ® Brian Breton Gradient Technologies, Inc.

1 Language Technologies (1) Diana Maynard University of Sheffield, UK ACAI 05 ADVANCED COURSE ON KNOWLEDGE DISCOVERY.

Benchmarking ontology-based annotation tools for the Semantic Web Diana Maynard University of Sheffield, UK.

© 2007 Mobile VCE. © 2007 Mobile VCE Core 5: User Interactions Service Architecture Eamonn O’Neill Academic Coordinator.

STORYFIGHTER: A Common Sense Storytelling Game Chian Chuu and Hana Kim MAS.964 Final Project December 12, 2002.

ICCS 2008, CracowJune 23-25, Towards Large Scale Semantic Annotation Built on MapReduce Architecture Michal Laclavík, Martin Šeleng, Ladislav Hluchý.

CIMI Survey results 1 Presented by Nicholas Oughtibridge.

Combining GATE and UIMA Ian Roberts. University of Sheffield NLP 2 Overview Introduction to UIMA Comparison with GATE Mapping annotations between GATE.

1 Language Technologies (2) Valentin Tablan University of Sheffield, UK ACAI 05 ADVANCED COURSE ON KNOWLEDGE DISCOVERY.

What is WiMax? Worldwide Interoperability for Microwave Access.

Be.wi-ol.de User-friendly ontology design Nikolai Dahlem Universität Oldenburg.

Wolf Siberski1 Semantic Web Framework Requirements Analysis (D 1.2.2) Wolf Siberski.

Internet 2 and DoDHE: Research Issues From The iSchool Perspective Mike Eisenberg Dean and Professor The Information School University of Washington, Oct.

Postgraduate : JIA-BEY LIU Adviser : CHIA-HUI WANG Co-adviser : LI-TIEN WANG, LUNG-LUNG LIU.

The Market System and the Circular Flow Chapter 2.

5/29/2001Y. D. Wu & M. Liu1 Content Management for Digital Library May 29, 2001.

Session 1: Technology Development August 15 NSF Workshop.

Using Human Language Technology for Automatic Annotation and Indexing of Digital Library Content Kalina Bontcheva, Diana Maynard, Hamish Cunningham, Horacio.

A Semi-Automated Digital Preservation System based on Semantic Web Services Jane Hunter Sharmin Choudhury DSTC PTY LTD, Brisbane, Australia Slides by Ananta.

Comparison of VPS Hosting and Cloud Hosting Features.

Multi-Source Information Extraction Valentin Tablan University of Sheffield.

TextCrowd – Collaborative semantic enrichment of text-based datasets

GATE Mímir: Answering Questions Google Can't

RichAnnotator: Annotating rich (XML-like) documents

Defining scope and functionality

and Jose-Norberto Mazón University of Alicante

By Diana Alhajjeah الإدارة المالية By Diana Alhajjeah

Interoperability with Existing PS-PS Instances

Jena HBase: A Distributed, Scalable, Efficient RDF Triple Store

Jena HBase: A Distributed, Scalable, Efficient RDF Triple Store

Hierarchical, Perceptron-like Learning for OBIE

What will your design log look like?

Building an annotated Corpus

Presentation transcript:

Benchmarking Textual Annotation Tools for the Semantic Web Diana Maynard University of Sheffield, UK Motivation Criteria for benchmarking should include not just performance but also scalability usability flexibility interoperability in order for users to make an informed decision about the best product for their needs. Requirements User Manual Annotator Annotation Consumer Corpus Developer System Usability ++ + Flexibility Performance - Scalability Interoperability Requirements for different users Results Tradeoffs: 1. Scalability vs response time 2. Performance vs coverage User Manual Annotator Annotation Consumer Corpus Developer System GATE ++ KIM MnM - Magpie + OntoMat Suitable tools for different users Tools Magpie KIM OntoMat GATE MnM