1. Università di AnconaCoopIS01 September 6, 20011 C OOPERATION S TRATEGIES FOR I NFORMATION I NTEGRATION Maurizio Panti, Luca Spalazzi, Loris Penserini {panti,spalazzi,pense}@inform.unian.it Istituto di Informatica - Università degli studi di Ancona

2. Università di AnconaCoopIS01 September 6, 20012 Talk Overview Motivations and Goals Local strategies Cooperation strategies the choice of partners the choice of queries the choice of answers Discussion

3. Università di AnconaCoopIS01 September 6, 20013 Motivation Information systems are collections of information sources and information consumers : Distributed Heterogeneous at physical level at logical level at conceptual level (names and schemas) Dynamic changes of information sources or their schemas changes of information consumers or their needs

4. Università di AnconaCoopIS01 September 6, 20014 Goal Rewriting a consumers query into queries to specific information sources when we have a distributed, heterogeneous, and strongly dynamic information system.

5. Università di AnconaCoopIS01 September 6, 20015 Usually query rewriting and information integration systems adopt the Mediator Architecture: [TSIMMIS, Squirrel, WHIPS, Carnot, SIMS, Information Manifold, Infomaster] dynamic sources: systems are overloaded with expensive updating operations; dynamic consumers: systems do not perform user profiling. Related Work

6. Università di AnconaCoopIS01 September 6, 20016 wrapper a description logic as data modelling and query language [e.g. C-Classic] source query processing is based on rewriting query using views over the local source [adapted by Beeri, Levy, Rousset] Information Source

7. Università di AnconaCoopIS01 September 6, 20017 Mediator mediator Thesaurus Mediated Schema mediated schema a description logic as data modelling and query language [e.g. C-Classic] query processing is based on rewriting query using views over the distributed sources [adapted by Beeri, Levy, Rousset]

8. Università di AnconaCoopIS01 September 6, 20018 Retrieval: Conjunction of concepts that are maximally contained in the query Rewriting: Composition of rewriting of retrieved concepts query: Q = pub.(ai db) pub.acm Rewriting query using views T journal type.{Trans} acm_trans acm ai agents db pub.(journal db) J= pub.ai K= pub.(agents db) I= pub..acm_journal acm_journal K= pub.(agen ts db ) pub.(ai db) H J = pub.(ai db journal) I= pub..acm_journal pub.acm retrieved concepts: {K, (H J)} { I } rewrite: (view(K)view(I))U(view(H)view(J)view(I))

9. Università di AnconaCoopIS01 September 6, 20019 #id pub … ….. #id pub … ….. Mediator M rewrite: (view(K)view(I))U(view(H)view(J)view(I)) Query Execution #id pub … ….. rewrite: (view(K)view(I))U(view(H)view(J)view(I)) data: #id pub … …..

10. Università di AnconaCoopIS01 September 6, 200110 Local Failures In query rewriting: the mediator is not able to rewrite (some or all the components) of the input query. In query execution: the mediator is not able to execute (some or all the components) of the rewrited query.

11. Università di AnconaCoopIS01 September 6, 200111 Cooperation Strategies mediator Thesaurus Mediated Schema all the mediators partner mediator source new mediators succeeding mediators failing mediators all the sources new sources succeeding sources failing sources original whole single component selected concepts whole single component rewriting whole single component query answer rewriting data

12. Università di AnconaCoopIS01 September 6, 200112 Cooperation with Mediators Asking for Rewriting Mediator M Mediator N W1 W2 W3 1: request 3: query 4: data 2: rewrite

13. Università di AnconaCoopIS01 September 6, 200113 Mediator M Mediator N W1 W2 W3 1: request 2: query 3: data 4: data Cooperation with Mediators Asking for Data

14. Università di AnconaCoopIS01 September 6, 200114 Cooperation with Sources Mediator M Mediator N W1 W2 W3 2: rewrite 3: data 1: request

15. Università di AnconaCoopIS01 September 6, 200115 Strategy Comparison m: number of mediators s: number of sources s: number of sources that cooperate with N i

16. Università di AnconaCoopIS01 September 6, 200116 Strategy Comparison Sol N (view(Q)) Sol N (Q) Sol N (Q)

17. Università di AnconaCoopIS01 September 6, 200117 Conclusion 1 st scenario (s m+s) mediators can be used for user profiling, mediators can be used to solve name heterogeneity and integrate data, in order to solve schema heterogeneity, for a mediator the most efficient and effective strategy is to directly cooperate with sources, in order to update its schemas, for a mediator a lazy approach can be not appropriate.

18. Università di AnconaCoopIS01 September 6, 200118 Conclusion 2 nd scenario (s >> m+s) mediators can be used for user profiling, the most efficient strategy is the cooperation with other mediators, cooperation with wrappers is useful only when mediators are not able to rewrite a given query, in order to update its schemas, for a mediator a lazy approach is appropriate.

19. Università di AnconaCoopIS01 September 6, 200119

20. Università di AnconaCoopIS01 September 6, 200120 Ms Mediated Schema

21. Università di AnconaCoopIS01 September 6, 200121 Rewriting query using views Composition of rewriting of retrieved concepts view( pub.(ai db) pub.acm ) = = view( pub.(ai db) ) view( pub.acm ) = (view(K)view(I))U(view(H)view(J)view(I)) = …...

22. Università di AnconaCoopIS01 September 6, 200122 Rewriting query using views ={ ( pub. keyword.{Agents} pub.db pub.acm_trans), ( pub. keyword.{Agents} pub.db pub. type.{Trans} pub. publisher.{ACM}), ( pub.agents pub.db pub.acm_trans), ( pub.agents pub.db pub. type.{Trans} pub. publisher.{ACM}), ( pub.journal pub.db pub. keyword.{AI} pub.acm_trans), … } =( view(K) view(I) ) U ( view(H) view(J) view(I) )

23. Università di AnconaCoopIS01 September 6, 200123 Local Failure in Query Rewriting query: Q= pub.(aidb) affiliation.{Stanford} T journal type.{Trans} acm_trans acm ai agents db pub.(journal db) J= pub.ai K= pub.(agents db) I= pub..acm_journal acm_journal affiliation.{Stanford} K= pub.(agen ts db ) pub.(ai db) H J = pub.(ai db journal) retrieved concepts: {K, (H J)} Ø rewrite : failure

24. Università di AnconaCoopIS01 September 6, 200124 Local Failure in Query Execution no answer #id pub … ….. #id pub … ….. Mediator M rewrite: (view(K)view(I))U(view(H)view(J)view(I)) data: failure

25. Università di AnconaCoopIS01 September 6, 200125 T acm_tods acm pub.acm_tod s pub.acm_tocl acm_tocl Mediator N query: pub.acm Mediator M Cooperation with Mediators Asking for Rewriting rewrite:{view( pub.acm _ tocl),view( pub.acm _ tods)} pub.acm_tod s pub.acm_tocl pub.ac m pub.acm_tod s pub.acm_tocl retrieved concepts : { pub.acm_tocl, pub.acm_tods}

26. Università di AnconaCoopIS01 September 6, 200126 Mediator M Cooperation with Mediators Asking for Rewriting rewrite:{view( pub.acm _ tocl),view( pub.acm _ tods)} data: #id pub … …..

27. Università di AnconaCoopIS01 September 6, 200127 T acm_tods acm pub.acm_tod s pub.acm_tocl acm_tocl Mediator N query: pub.acm Mediator M pub.acm_tod s pub.acm_tocl pub.ac m pub.acm_tod s pub.acm_tocl Cooperation with Mediators Asking for Data retrieved concepts : { pub.acm_tocl, pub.acm_tods} rewrite : {view( pub.acm _ tocl),view( pub.acm _ tods)}

28. Università di AnconaCoopIS01 September 6, 200128 T acm_tods acm pub.acm_tod s pub.acm_tocl acm_tocl Mediator N pub.acm_tod s pub.acm_tocl pub.ac m pub.acm_tod s pub.acm_tocl Cooperation with Mediators Asking for Data rewrite : {view( pub.acm _ tocl),view( pub.acm _ tods)} data: #id pub … …..

29. Università di AnconaCoopIS01 September 6, 200129 T acm_tods acm pub.acm_tod s pub.acm_tocl acm_tocl Mediator N pub.acm_tod s pub.acm_tocl pub.ac m pub.acm_tod s pub.acm_tocl Cooperation with Mediators Asking for Data rewrite : {view( pub.acm _ tocl),view( pub.acm _ tods)} data: #id pub … ….. query: pub.acm Mediator M rewrite:{view( pub.acm_tocl),view( pub.acm_tods)} data: #id pub … …..

30. Università di AnconaCoopIS01 September 6, 200130 Cooperation with Sources query: pub.acm Mediator M retrieved:{ pub.acm_ccs, pub.acm_jacm, pub.acm_tods} rewrite:{view( pub.acm_ccs),view( pub.acm_jacm), view( pub.acm_tods)} data: Mediator M #id pub … …..

31. Università di AnconaCoopIS01 September 6, 200131 Redundancy C n (M)mediated schema of M after n interactions with N C(N)mediated schema of N

32. Università di AnconaCoopIS01 September 6, 200132 Recall C n (M)mediated schema of M after n interactions with S 1, … S n information need of a consumer (a view of S 1, … S n )

33. Università di AnconaCoopIS01 September 6, 200133 Precision C n (M)mediated schema of M after n interactions with S 1, … S n information need of a consumer (a view of S 1, … S n )

34. Università di AnconaCoopIS01 September 6, 200134 Ns Mediated Schema

35. Università di AnconaCoopIS01 September 6, 200135 Ms Mediated Schema (updated)

36. Università di AnconaCoopIS01 September 6, 200136 Ms Mediated Schema (updated)

37. Università di AnconaCoopIS01 September 6, 200137 Ms Mediated Schema (updated)

38. Università di AnconaCoopIS01 September 6, 200138 Cooperation with Mediators Theorem. C n (M)mediated schema of M after n interactions with N C(N)mediated schema of N redundancy:

39. Università di AnconaCoopIS01 September 6, 200139 Cooperation with Mediators Theorem. C n (M)mediated schema of M after n interactions with N information need of a consumer (a view of S 1, … S n ) recall: precision:

40. Università di AnconaCoopIS01 September 6, 200140 Cooperation with Sources Theorem. C n (M)mediated schema of M after n interactions with S 1, … S n information need of a consumer (a view of S 1, … S n ) recall: precision: