1. Advanced Methods of IR An Overview
Elena Demidova
SS 2014
Elena Demidova: Advanced Methods of Information Retrieval
1/2/2019

2. Plan for this semester
Introduction to keyword search for structured data ( )
Advanced indexing (by Avishek Anand) ( )
Top-k query processing (by Avishek Anand) ( )
Keyword query interpretation over structured data ( )
Query refinement with ontologies and users ( )
Diversification of query interpretations and search results ( )
Schema mapping techniques ( )
Linked Open Data and federated search ( )
Collaborative evaluation and search (by Sergej Zerr) ( )
Applications to temporal Information Retrieval (by Nattiya Kanhabua) ( )
Example applications I ( ) - student talks
Example applications II ( ) - student talks
2019/1/2

3. L1: Introduction
See the slides from: Yi Chen et. al. “Keyword-based Search and Exploration on Databases.”
This week exercise session: home reading
„Making Database Systems Usable.“ H.V. Jagadish, Adriane Chapman, Aaron Elkiss, Magesh Jayapandian, Yunyao Li, Arnab Nandi, and Cong Yu. In SIGMOD,
Elena Demidova: Advanced Methods of Information Retrieval

4. L2: Advanced indexing (by Avishek Anand)
Inverted indexing basics revisited
Indexing static collections
Dictionaries
Forward Index
Inverted index organisation
Scalable indexing
Indexing dynamic collections
Elena Demidova: Advanced Methods of Information Retrieval

5. L3: Top-k query processing (by Avishek Anand)
Query processing over document-id ordered lists
Document-at-a-time vs term-at-a-time processing
WAND processing
Top-K processing
Fagin’s top-k
TA, NRA and CA
Supporting advanced queries - phrases, proximity-aware, temporal queries
Elena Demidova: Advanced Methods of Information Retrieval

6. L4: Keyword query interpretation
K=“hanks cruise 2001”
σ hanks  name(Actor):hanks σ 2001  year(Movie):2001
σ cruise  name(Actor):cruise +
T= σ?  name (Actor) ⋈ Acts ⋈ σ?  year (Movie) ⋈ Acts ⋈ σ?  name (Actor) =
Q = σ hanks  name (Actor) ⋈ Acts ⋈ σ2001  year(Movie) ⋈ Acts ⋈ σ cruise name (Actor)
Elena Demidova: Advanced Methods of Information Retrieval

7. L5: Query refinement with ontologies and users
E. Demidova, X. Zhou, and W. Nejdl Efficient query construction for large scale data.
In Proc. of ACM SIGIR
Elena Demidova: Advanced Methods of Information Retrieval

8. L6: Diversification of query interpretations & results
Keyword query:
CONSIDERATION CHRISTOPHER GUEST
Relevance Ranking
Result Overview (Diversification) 1
A director CHRISTOPHER GUEST of a movie
CONSIDERATION
A director CHRISTOPHER GUEST of a movie CONSIDERATION 2
A director CHRISTOPHER
GUEST
An actor GUEST 3
An actor CHRISTOPHER
GUEST in a movie CONSIDERATION
As character
CHRISTOPHER
Relevance ranking vs. result overview
E. Demidova, P. Fankhauser, X. Zhou, and W. Nejdl DivQ: diversification for keyword search over structured databases. In Proc.of ACM SIGIR
Elena Demidova: Advanced Methods of Information Retrieval

9. L7: Schema mapping techniques
E. Demidova, I. Oelze, and W. Nejdl Aligning freebase with the YAGO ontology.
In Proc. of CIKM
Elena Demidova: Advanced Methods of Information Retrieval

10. L8: Linked Open Data and federated search
Elena Demidova: Advanced Methods of Information Retrieval

11. L9: Collaborative evaluation & search (by Sergej Zerr)
Often we need more than one hand
Sometimes more than one brain
“Why the Many Are Smarter Than the Few and
How Collective Wisdom Shapes Business,
Economies, Societies and Nations”
James Suroewicki
Sergej Zerr: Collaborative evaluation & search 11 11

12. L10: Applications to temporal IR (by Nattiya Kanhabua)
August 6-10, 2012
L10: Applications to temporal IR (by Nattiya Kanhabua)
Support analysis of future-related information in news and Web
Extract temporal expressions, i.e., future mentions from news articles
Summarize and aggregate results using clustering and time-aware ranking methods
Yahoo! Time Explorer
The 6th Russian Summer School in IR (RuSSIR'2012)

13. L11 / L12 Example applications
2019/1/2
Yi Chen et. al. “Keyword Search on Structured and Semi-Structured Data, SIGMOD 2009
L11 / L12 Example applications
It‘s your turn!

14. Questions? The Rules Literature: Attendance: strongly recommended
The basics of keyword search in databases: the book
Jeffrey Xu Yu, Lu Qin, Lijun Chang. Keyword Search in Databases. Synthesis Lectures on Data Management. Morgan & Claypool Publishers
Advanced state-of-the-art techniques: papers (pointers will be provided incrementally during the course)
Attendance: strongly recommended
Exercise sessions: paper reading, programming assignments, …
-> starting next week; today: home reading
Student talks:
20 minutes talk, overview over 2-3 papers
can be shared by a group of 2 students
Oral exam (30 minutes) in July
Questions?
Elena Demidova: Advanced Methods of Information Retrieval