Advanced Methods of IR An Overview Elena Demidova SS 2014 Elena Demidova: Advanced Methods of Information Retrieval 1/2/2019

Plan for this semester Introduction to keyword search for structured data (10.04.2014) Advanced indexing (by Avishek Anand) (17.04.2014) Top-k query processing (by Avishek Anand) (24.04.2014) Keyword query interpretation over structured data (08.05.2014) Query refinement with ontologies and users (15.05.2014) Diversification of query interpretations and search results (22.05.2014) Schema mapping techniques (05.06.2014) Linked Open Data and federated search (12.06.2014) Collaborative evaluation and search (by Sergej Zerr) (19.06.2014) Applications to temporal Information Retrieval (by Nattiya Kanhabua) (26.06.2014) Example applications I (03.07.2014) - student talks Example applications II (10.07.2014) - student talks 2019/1/2

L1: Introduction See the slides from: Yi Chen et. al. “Keyword-based Search and Exploration on Databases.” Tutorial @ICDE2011 http://www.cse.unsw.edu.au/~weiw/project/ICDE11_KWS_tutorial_with_refs.pdf This week exercise session: home reading „Making Database Systems Usable.“ H.V. Jagadish, Adriane Chapman, Aaron Elkiss, Magesh Jayapandian, Yunyao Li, Arnab Nandi, and Cong Yu. In SIGMOD, 2007. http://www.eecs.umich.edu/db/usable/usability.pdf Elena Demidova: Advanced Methods of Information Retrieval 02.01.2019

L2: Advanced indexing (by Avishek Anand) Inverted indexing basics revisited Indexing static collections Dictionaries Forward Index Inverted index organisation Scalable indexing Indexing dynamic collections Elena Demidova: Advanced Methods of Information Retrieval 02.01.2019

L3: Top-k query processing (by Avishek Anand) Query processing over document-id ordered lists Document-at-a-time vs term-at-a-time processing WAND processing Top-K processing Fagin’s top-k TA, NRA and CA Supporting advanced queries - phrases, proximity-aware, temporal queries Elena Demidova: Advanced Methods of Information Retrieval 02.01.2019

L4: Keyword query interpretation K=“hanks cruise 2001” σ hanks  name(Actor):hanks σ 2001  year(Movie):2001 σ cruise  name(Actor):cruise + T= σ?  name (Actor) ⋈ Acts ⋈ σ?  year (Movie) ⋈ Acts ⋈ σ?  name (Actor) = Q = σ hanks  name (Actor) ⋈ Acts ⋈ σ2001  year(Movie) ⋈ Acts ⋈ σ cruise name (Actor) Elena Demidova: Advanced Methods of Information Retrieval 02.01.2019

L5: Query refinement with ontologies and users E. Demidova, X. Zhou, and W. Nejdl. 2013. Efficient query construction for large scale data. In Proc. of ACM SIGIR 2013. http://doi.acm.org/10.1145/2484028.2484078 Elena Demidova: Advanced Methods of Information Retrieval 02.01.2019

L6: Diversification of query interpretations & results Keyword query: CONSIDERATION CHRISTOPHER GUEST Relevance Ranking Result Overview (Diversification) 1 A director CHRISTOPHER GUEST of a movie CONSIDERATION A director CHRISTOPHER GUEST of a movie CONSIDERATION 2 A director CHRISTOPHER GUEST An actor GUEST 3 An actor CHRISTOPHER GUEST in a movie CONSIDERATION As character CHRISTOPHER Relevance ranking vs. result overview E. Demidova, P. Fankhauser, X. Zhou, and W. Nejdl. 2010. DivQ: diversification for keyword search over structured databases. In Proc.of ACM SIGIR 2010. http://doi.acm.org/10.1145/1835449.1835506 Elena Demidova: Advanced Methods of Information Retrieval 02.01.2019

L7: Schema mapping techniques E. Demidova, I. Oelze, and W. Nejdl. 2013. Aligning freebase with the YAGO ontology. In Proc. of CIKM 2013. http://doi.acm.org/10.1145/2505515.2505546 Elena Demidova: Advanced Methods of Information Retrieval 02.01.2019

L8: Linked Open Data and federated search http://blog.law.cornell.edu/voxpop/files/2013/01/lod-cloud_2010.png Elena Demidova: Advanced Methods of Information Retrieval 02.01.2019

L9: Collaborative evaluation & search (by Sergej Zerr) Often we need more than one hand Sometimes more than one brain “Why the Many Are Smarter Than the Few and How Collective Wisdom Shapes Business, Economies, Societies and Nations” James Suroewicki Sergej Zerr: Collaborative evaluation & search 11 11

L10: Applications to temporal IR (by Nattiya Kanhabua) August 6-10, 2012 L10: Applications to temporal IR (by Nattiya Kanhabua) Support analysis of future-related information in news and Web Extract temporal expressions, i.e., future mentions from news articles Summarize and aggregate results using clustering and time-aware ranking methods http://www.recordedfuture.com/ Yahoo! Time Explorer The 6th Russian Summer School in IR (RuSSIR'2012)

L11 / L12 Example applications 2019/1/2 Yi Chen et. al. “Keyword Search on Structured and Semi-Structured Data, SIGMOD 2009 L11 / L12 Example applications It‘s your turn! http://xseek.asu.edu/

Questions? The Rules Literature: Attendance: strongly recommended The basics of keyword search in databases: the book Jeffrey Xu Yu, Lu Qin, Lijun Chang. Keyword Search in Databases. Synthesis Lectures on Data Management. Morgan & Claypool Publishers. 2009. Advanced state-of-the-art techniques: papers (pointers will be provided incrementally during the course) Attendance: strongly recommended Exercise sessions: paper reading, programming assignments, … -> starting next week; today: home reading Student talks: 20 minutes talk, overview over 2-3 papers can be shared by a group of 2 students Oral exam (30 minutes) in July Questions? Elena Demidova: Advanced Methods of Information Retrieval 02.01.2019