Chapter 6. Inference beyond the index 2007 년 1 월 30 일 부산대학교 인공지능연구실 김민호 Text : FINDING OUT ABOUT Page. 182 ~ 251.

Slides:



Advertisements
Similar presentations
Relevance Feedback Limitations –Must yield result within at most 3-4 iterations –Users will likely terminate the process sooner –User may get irritated.
Advertisements

Query Languages. Information Retrieval Concerned with the: Representation of Storage of Organization of, and Access to Information items.
UCLA : GSE&IS : Department of Information StudiesJF : 276lec1.ppt : 5/2/2015 : 1 I N F S I N F O R M A T I O N R E T R I E V A L S Y S T E M S Week.
Prof. Carolina Ruiz Computer Science Department Bioinformatics and Computational Biology Program WPI WELCOME TO BCB4003/CS4803 BCB503/CS583 BIOLOGICAL.
Web Mining Research: A Survey Authors: Raymond Kosala & Hendrik Blockeel Presenter: Ryan Patterson April 23rd 2014 CS332 Data Mining pg 01.
Search Engines and Information Retrieval
A Probabilistic Framework for Information Integration and Retrieval on the Semantic Web by Livia Predoiu, Heiner Stuckenschmidt Institute of Computer Science,
T.Sharon - A.Frank 1 Internet Resources Discovery (IRD) Classic Information Retrieval (IR)
Basic IR: Queries Query is statement of user’s information need. Index is designed to map queries to likely to be relevant documents. Query type, content,
WebMiningResearch ASurvey Web Mining Research: A Survey Raymond Kosala and Hendrik Blockeel ACM SIGKDD, July 2000 Presented by Shan Huang, 4/24/2007.
© Franz J. Kurfess Knowledge Retrieval 1 CPE/CSC 580: Knowledge Management Dr. Franz J. Kurfess Computer Science Department Cal Poly.
Information Retrieval Concerned with the: Representation of Storage of Organization of, and Access to Information items.
Gimme’ The Context: Context- driven Automatic Semantic Annotation with CPANKOW Philipp Cimiano et al.
Chapter 2Modeling 資工 4B 陳建勳. Introduction.  Traditional information retrieval systems usually adopt index terms to index and retrieve documents.
Reference Collections: Task Characteristics. TREC Collection Text REtrieval Conference (TREC) –sponsored by NIST and DARPA (1992-?) Comparing approaches.
A Mobile World Wide Web Search Engine Wen-Chen Hu Department of Computer Science University of North Dakota Grand Forks, ND
Web Information Retrieval and Extraction Chia-Hui Chang, Associate Professor National Central University, Taiwan Sep. 16, 2005.
1 Information Retrieval and Web Search Introduction.
WebMiningResearchASurvey Web Mining Research: A Survey Raymond Kosala and Hendrik Blockeel ACM SIGKDD, July 2000 Presented by Shan Huang, 4/24/2007 Revised.
Semantics For the Semantic Web: The Implicit, the Formal and The Powerful Amit Sheth, Cartic Ramakrishnan, Christopher Thomas CS751 Spring 2005 Presenter:
Information retrieval Finding relevant data using irrelevant keys Example: database of photographic images sorted by number, date. DBMS: Well structured.
© 2001 Franz J. Kurfess Knowledge Retrieval 1 CPE/CSC 580: Knowledge Management Dr. Franz J. Kurfess Computer Science Department Cal Poly.
Information Retrieval
Semantic Web Technologies Lecture # 2 Faculty of Computer Science, IBA.
Improving Data Discovery in Metadata Repositories through Semantic Search Chad Berkley 1, Shawn Bowers 2, Matt Jones 1, Mark Schildhauer 1, Josh Madin.
Search Engines and Information Retrieval Chapter 1.
Survey of Semantic Annotation Platforms
Learning Object Metadata Mining Masoud Makrehchi Supervisor: Prof. Mohamed Kamel.
LIS510 lecture 3 Thomas Krichel information storage & retrieval this area is now more know as information retrieval when I dealt with it I.
Master Thesis Defense Jan Fiedler 04/17/98
Knowledge Representation and Indexing Using the Unified Medical Language System Kenneth Baclawski* Joseph “Jay” Cigna* Mieczyslaw M. Kokar* Peter Major.
1 University of Qom Information Retrieval Course Web Search (Link Analysis) Based on:
1 Information Retrieval, Search, and Mining Introduction.
WebMining Web Mining By- Pawan Singh Piyush Arora Pooja Mansharamani Pramod Singh Praveen Kumar 1.
Information Retrieval Evaluation and the Retrieval Process.
1 Information Retrieval Acknowledgements: Dr Mounia Lalmas (QMW) Dr Joemon Jose (Glasgow)
IL Step 3: Using Bibliographic Databases Information Literacy 1.
Research Paper Recommender System Monica D ă g ă diţ ă.
Introduction to Digital Libraries hussein suleman uct cs honours 2003.
Search Engine Architecture
Collocations and Information Management Applications Gregor Erbach Saarland University Saarbrücken.
CS315-Web Search & Data Mining. A Semester in 50 minutes or less The Web History Key technologies and developments Its future Information Retrieval (IR)
Personalized Interaction With Semantic Information Portals Eric Schwarzkopf DFKI
Mining real world data Web data. World Wide Web Hypertext documents –Text –Links Web –billions of documents –authored by millions of diverse people –edited.
CiteSight: Contextual Citation Recommendation with Differential Search Avishay Livne 1, Vivek Gokuladas 2, Jaime Teevan 3, Susan Dumais 3, Eytan Adar 1.
Introduction to Information Retrieval Aj. Khuanlux MitsophonsiriCS.426 INFORMATION RETRIEVAL.
Digital Libraries1 David Rashty. Digital Libraries2 “A library is an arsenal of liberty” Anonymous.
Information Retrieval
Reference Collections: Collection Characteristics.
I NFORMATION R ETRIEVAL AND W EB S EARCH Jianping Fan Department of Computer Science UNC-Charlotte 1.
Announcements Intro to Legal Research on Wednesday Keep track of your searching to document on the search log…for each search instance: – what database.
CIS750 – Seminar in Advanced Topics in Computer Science Advanced topics in databases – Multimedia Databases V. Megalooikonomou Link mining ( based on slides.
Semantic search-based image annotation Petra Budíková, FI MU CEMI meeting, Plzeň,
1 CS 430 / INFO 430: Information Retrieval Lecture 20 Web Search 2.
Information Organization: Overview
Visual Information Retrieval
DATA MINING Introductory and Advanced Topics Part III – Web Mining
Information Retrieval and Web Search
Search Engine Architecture
Information Retrieval and Web Search
Information Retrieval and Web Search
Data Warehousing and Data Mining
Text Categorization Document classification categorizes documents into one or more classes which is useful in Information Retrieval (IR). IR is the task.
CSE 635 Multimedia Information Retrieval
Networked Information Resources
Introduction to Information Retrieval
Search Engine Architecture
Information Organization: Overview
Information Retrieval and Web Search
Topic: Semantic Text Mining
Presentation transcript:

Chapter 6. Inference beyond the index 2007 년 1 월 30 일 부산대학교 인공지능연구실 김민호 Text : FINDING OUT ABOUT Page. 182 ~ 251

Introduce(1/4) - Knowledge representation  AI is primary contribution to computer science!  Related to:  Programming language’s “abstract data types”  Database (logical!) modeling -eg, ‘ontology’ building

Introduce(2/4) - Traditionally (GOFAI) serving deductive goals  Valid inference Man (x) -> Mortal(x) Man(Socrates) Mortal(Socrates)  Expressiveness  Even first-order logic offers tradeoffs wrt/propositional

Introduce(3/4) - Machine learning: inductive sources of knowledge  Data-mining  Statistical analysis of large datasets  Searching for patterns  Inferring semantics (meaning) from syntactic cues  from word statistics  from bibliographic citations  Even from capitalization -Proper names → Global reference!

Introduce(4/4) - Exploiting other (non-index) information

Subsection  6.1 Citation: Interdocument Links  6.2 Hypertext, Intradocument Links  6.3 Keyword Structures  6.4 Social Relations among Authors  6.5 Modes of Inference  6.6 Deep Interfaces  6.7 FOA(The Law)  6.8 FOA(Evolution)  6.9 Text-Based Inteligence

6.1 Citation: Interdocument Links  Citation is a pointer, from a document to a document.  how accurately do we know the location of the citation in the citing paper?  how precisely is its pointer into the cited paper?

6.1 Citation: Interdocument Links  Document similarity based on shared bibliographies  Coupling  Overlap between two document’s bibliographis  Co-citation  Degree to which two documents are both referenced by other document’s bibliographies

6.1 Citation: Interdocument Links

 Common law depends on rule of precedence  Stare decisis  Prior decisions applied to new factual situations  Hierarchical local jurisdictions limit interpretation  Dialectic debate (rationale, justice, change, etc.)  NB: Same corpus used by both adversaries  References to history of O(10 year)

6.1 Citation: Interdocument Links  Unambiguous

6.1 Citation: Interdocument Links  Eigen-structure of citation graphs  Authority: analogous to bibliometric ‘impact’  Hubs: Pull together authorities  Citation-expanded hitlist

Summary  Writings do not exist in isolation  Author explicit references to other’s documents provides excellent evidence concerning the ARGUMENTS they each make

Google’s Page rank  Simulate stationary distribution of Markov process with incremental update of page weight

Hierarchic structure  Visualizing references

Pedagogical structure  Prerequisite lattice  Reading-level analysis – against well – tested vocabularies  Level of coverage

Argument relationships

thesaurus  BT/NT/RT relations  aot / AI “ontologies”

WordNet

Classification taxonomies  Institutionalized  Myopic discipline focus

Neural networks - basics Query Retrieval Relevance Feedback

Construction of initial NNet

Query: “Case-based approach to the law”  Morphological processing of tokens  High-frequency “noise” words elided

SAS in IR  Initial query may refer to many “features”  Descriptive keywords are only one type  Retrieval becomes a process of completion

Type of relation less important than fact of association

Initial retrieval

Most highly ranked document

Goal document

3rd-order transitive associations

4th-order transitive associations

Swanson's Arrowsmith