Presentation is loading. Please wait.

Presentation is loading. Please wait.

EVALUATING THE TEMPORAL COHERENCE OF ARCHIVED PAGES SCOTT G. AINSWORTH MICHAEL L. NELSON OLD DOMINION UNIVERSITY IIPC 2015 APRIL 27 – MAY 1, 2015 STANFORD.

Published byTheodore Beasley Modified over 9 years ago

Similar presentations

Presentation on theme: "EVALUATING THE TEMPORAL COHERENCE OF ARCHIVED PAGES SCOTT G. AINSWORTH MICHAEL L. NELSON OLD DOMINION UNIVERSITY IIPC 2015 APRIL 27 – MAY 1, 2015 STANFORD."— Presentation transcript:

1 EVALUATING THE TEMPORAL COHERENCE OF ARCHIVED PAGES SCOTT G. AINSWORTH MICHAEL L. NELSON OLD DOMINION UNIVERSITY IIPC 2015 APRIL 27 – MAY 1, 2015 STANFORD UNIVERSITY HERBERT VAN DE SOMPEL LOS ALAMOS NATIONAL LABORATORY

2 HE WENT TO VIEW AN ARCHIVED PAGE. YOU WON’T BELIEVE WHAT HE SAW NEXT… SCOTT G. AINSWORTH MICHAEL L. NELSON OLD DOMINION UNIVERSITY IIPC 2015 APRIL 27 – MAY 1, 2015 STANFORD UNIVERSITY HERBERT VAN DE SOMPEL LOS ALAMOS NATIONAL LABORATORY

3 2015 IIPC General Assembly CONTENTS  Motivation  Composite Mementos  Coherence Framework  Temporal Coherence  Future Work  Conclusion 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 3

4 2015 IIPC General Assembly RESEARCH TO DATE 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 4 How to crawl a site to maximize coherence Ben Saad et al., JCDL 2011, TPDL 2011 Detecting, visualizing temporal defects Spaniol et al., WICOW 2009, IWAW 2009, VLDB 2009

5 2015 IIPC General Assembly RESEARCH TO DATE: @WEBSCIDL 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 5 How much of the web is archived? Ainsworth et al., JCDL 2011 Are the archives stable? Brunelle et al., JCDL 2013 Temporal drift while browsing in an archive? Ainsworth et al., JCDL 2013 Are the missing resources important? Brunelle et al., JCDL 2014 Are the present resources correct?

6 2015 IIPC General Assembly AS PRESENTED BY IA 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 6 http://web.archive.org/web/20041209190926/http://www.wunderground.org/cgi-bin/findWeather/getForecast?query=50593http://web.archive.org/web/20041209190926/http://www.wunderground.org/cgi-bin/findWeather/getForecast?query=50593 (now 404, but that's a different story…)

7 2015 IIPC General Assembly NOT ALL 2004-12-09T19:09:26 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 7

8 2015 IIPC General Assembly CLEAR OR CLOUDY? 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 8

9 2015 IIPC General Assembly QUESTIONS How prevalent is temporal incoherence? Can temporal coherence be improved by using multiple archives? Can temporal coherence be improved by introducing memento selection heuristics? 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 9

10 2015 IIPC General Assembly CONTENTS  Motivation  Composite Memento  Coherence Framework  Temporal Coherence  Future Work  Conclusion 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 10

11 2015 IIPC General Assembly COMPOSITE MEMENTO PRESENTATIONSTRUCTURE 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 11

12 2015 IIPC General Assembly CONTENTS  Motivation  Composite Memento  Coherence Framework  Temporal Coherence  Future Work  Conclusion 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 12

13 2015 IIPC General Assembly COHERENCE STATES Prima Facie Coherent Evidence that the memento existed in its archived state when the root was acquired. Prima Facie Violative Evidence … did not exist... Possibly Coherent Evidence … might have existed... Probably Violative Evidence … probably did not exist... 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 13

14 2015 IIPC General Assembly CONSIDER THIS PAGE… 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 14

15 2015 IIPC General Assembly WITH THESE RESPONSE HEADERS 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 15 HTTP/1.1 200 OK Server: Tengine/2.0.3 Date: Mon, 27 Apr 2015 22:03:32 GMT Content-Type: image/jpeg Content-Length: 15632 Connection: keep-alive Memento-Datetime: Tue, 07 Feb 2006 00:58:23 GMT Link: X-Archive-Orig-server: Apache/1.3.26 (Unix) ApacheJServ/1.1.2 PHP/4.3.4 X-Archive-Orig-etag: "4978-3d10-3e4d822e" X-Archive-Orig-content-length: 15632 X-Archive-Orig-accept-ranges: bytes X-Archive-Orig-date: Tue, 07 Feb 2006 00:58:20 GMT X-Archive-Orig-content-type: image/jpeg X-Archive-Orig-last-modified: Fri, 14 Feb 2003 23:56:30 GMT X-Archive-Orig-connection: close

16 2015 IIPC General Assembly PRIMA FACIE COHERENT 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 16 Bracket Pattern: Memento-Datetime + Last-Modified (yes, Last-Modified is sometimes wrong, but many of those cases can be detected)

17 2015 IIPC General Assembly PRIMA FACIE COHERENT 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 17 Equal Pattern: simultaneous capture (with an optionally tunable “bubble of simultaneity”)

18 2015 IIPC General Assembly PRIMA FACIE VIOLATIVE 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 18 Closest memento created and acquired after the root was acquired

19 2015 IIPC General Assembly POSSIBLY COHERENT 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 19 Closest (or only) memento captured before the root

20 2015 IIPC General Assembly PROBABLY VIOLATIVE 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 20 Closest (or only) memento captured after the root but no Last-Modified (possibly indicating a dynamically generated representations) (for both PC & PV, you could do content comparison if there are 2 mementos that straddle the root page)

21 2015 IIPC General Assembly CONTENTS  Motivation  Composite Memento  Coherence Framework  Temporal Coherence  Future Work  Conclusion 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 21

22 2015 IIPC General Assembly TEMPORAL COHERENCE 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 22

23 2015 IIPC General Assembly TEMPORAL COHERENCE 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 23 2005-05- 14 01:36:08 +9 days +18 days +7 months +2.1 years

24 2015 IIPC General Assembly EMBEDDED RESOURCES ResourceMemento-DatetimeDeltaResource Memento- Datetime Delta http://www.cs.odu.edu2005-05-14 01:36:08spacer.gif2005-06-01 16:23:1018.6 d mm_menu.js2005-05-23 02:39:129.0 djimcheng.gif2005-06-01 16:37:3918.6 d style.css2005-05-23 02:39:399.0 djsmith.gif2005-06-01 16:58:5018.6 d gfx-logo-odu-crown.gif2005-05-23 02:39:399.0 drmenu_1st_featured_alumni.png2005-06-01 21:21:4518.8 d ddmenu_ddown.js2005-05-23 02:39:439.0 dhmenu_college_...-new.png2005-12-21 20:14:257.3 mo university.js2005-05-23 02:39:569.0 drmenu_1st_upcoming_news.png2005-12-21 20:15:147.3 mo rmenu_1st_about.png2005-06-01 13:40:2518.5 drmenu_1st_upcoming_events.png2005-12-21 21:01:127.3 mo rmenu_bottom_229.gif2005-06-01 14:07:2918.5 dlmenu_1st_resources.png2005-12-28 17:47:417.5 mo shadow-bl.gif2005-06-01 14:55:5318.6 dbullet_blue_triangle.gif2005-12-28 19:43:487.5 mo ecsbdg.jpg2005-06-01 14:56:1718.6 dlogo-cs.gif2005-12-28 19:54:297.5 mo shadow-br.gif2005-06-01 15:18:1818.6 drmenu_1st_featured_student.png2007-06-12 02:36:072.1 years gfx-btn-go-dblue.gif2005-06-01 15:34:1918.6 dshadow-b.gif2007-06-21 02:35:172.1 years shadow-tr.gif2005-06-01 15:55:5718.6 dshadow-r.gif404 Not Found header-right1.gif2005-06-01 16:06:1618.6 d 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 24 Embedded Resources26 Mean Delta125.9 days Standard Deviation207.7 days Minimum Delta9.0 days Maximum Delta2.1 years

25 2015 IIPC General Assembly REPRESENTING COHERENCE 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 25

26 2015 IIPC General Assembly REPRESENTING COHERENCE 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 26

27 2015 IIPC General Assembly REPRESENTING COHERENCE 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 27

28 2015 IIPC General Assembly REPRESENTING COHERENCE 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 28

29 2015 IIPC General Assembly REPRESENTING COHERENCE 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 29

30 2015 IIPC General Assembly THE FULL CHART 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 30 2005-03-10 media.gif

31 2015 IIPC General Assembly EXPERIMENT: DATA SET 4,000 sample URI-Rs (data set from JCDL 2011) Single and Multiple Archives Two Heuristics: Minimum distance (current default Wayback behavior) choose closest Memento-Datetime Bracket (proposed here) use combination of Memento-Datetime + Last-Modified Download all TimeMaps Download all root mementos Download all embedded resources 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 31

32 2015 IIPC General Assembly EXPERIMENT: SAMPLING For each root URI-R TimeMap, choose a single memento per month Extract embedded URI-Rs Download TimeMaps for embedded URI-Rs Download heuristically best URI-Ms Repeat recursively 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 32

33 2015 IIPC General Assembly ROOT URI-R STATISTICS 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 33 Root URI-Rs archived2,756 68.9% In multiple archives1,180 29.5% Mean archives per URI-R1.58 Mean mementos per URI-R124.57 200 OK82,425 93.6% 503 Service Unavailable 4,444 5.0% 404 Not found 583 0.7% 403 Forbidden 388 0.4% Others 214 0.3% URI-M Status Archival Data

34 2015 IIPC General Assembly EMBEDDED URI-R STATISTICS 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 34 Embedded URI-Rs1,623,127 per root URI-M 19.7 Embedded URI-Ms available1,332,993 93.6% per root URI-M 15.1 Not archived312,641 83.9% 404 Not found 44,852 12.0% 403 Forbidden 6,116 1.6% 503 Service Unavailable 5,442 1.5% Others 3,508 0.9% URI-M Failure Reasons Archival Data

35 2015 IIPC General Assembly COMPOSITE MEMENTO (ROOT) COMPLETENESS & COHERENCE 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 35 Description MinDist Single MinDist Multi Bracket Single Bracket Multi Mean Complete76.1%80.2%76.2%80.3% Mean Missing23.9%19.8%23.8%19.7% Completeness (and Missing) Description MinDist Single MinDist Multi Bracket Single Bracket Multi Mean Prima Facie Coherent41.0%40.9%54.7%54.6% Mean Possibly Coherent27.3%28.7%12.8%14.2% Mean Probably Violative2.5%5.3%2.5%5.3% Mean Prima Facie Violative5.3% 6.2% Coherence At least 5% of pages can be shown to have temporal violations! Multiple archives: +completeness, -coherence?

36 2015 IIPC General Assembly EMBEDDED MEMENTO COHERENCE 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 36 Description MinDist Single MinDist Multi Bracket Single Bracket Multi Prima Facie Coherent622,565621,447864,736859,625 Possibly Coherent497,405466,046244,104215,585 Probably Violative104,37653,734104,33953,694 Prima Facie Violative100,760103,662114,062117,469 Totals 1,325,1061,244,8891,327,2411,246,373 Description MinDist Single MinDist Multi Bracket Single Bracket Multi Prima Facie Coherent47.0%49.9%65.2%69.0% Possibly Coherent37.5%37.4%18.4%17.3% Probably Violative7.9%4.3%7.9%4.3% Prima Facie Violative7.6%8.3%8.6%9.4% At least 7% of embedded resources are used violatively!

37 2015 IIPC General Assembly CONTENTS  Motivation  Related work  Preliminary work  Temporal Coherence  Future work  Conclusion 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 37

38 2015 IIPC General Assembly MINOR OR MAJOR VIOLATIONS? This is a temporal violation. But is it meaningful? How to judge? Most archives transform HTML Not all archives support export of original file How to measure similarity on binary files? early results: very few cases of equivalent binaries 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 38

39 2015 IIPC General Assembly HOW TO CONVEY COHERENCE? 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 39 How to scale to > 100 embedded mementos? How to convey coherence & contributing archive?

40 2015 IIPC General Assembly POLICIES & HEURISTICS Tradeoffs: Fast: minimize distance Accurate: maximize coherence Complete: query all (not just top k) archives in order to maximize completeness 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 40

41 2015 IIPC General Assembly CONTENTS  Motivation  Composite Memento  Coherence Framework  Temporal Coherence  Future Work  Conclusion 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 41

42 2015 IIPC General Assembly CONCLUSION Defined four classes of temporal coherence for describing relationship between root & embedded mementos Prima Facie {Coherent|Violative} Possibly Coherent / Probably Violative Determine classes using a combination of HTTP metadata, primarily Memento-Datetime & Last-Modified At least 5% of IA pages have 1 or more temporal violations Using multiple archives increases completeness, but with a possible loss of coherence Determining semantic impact of violations and UI issues (status, policy choices) are areas of future research 4/27/15Scott G. Ainsworth Michael L. Nelson Herbert Van de Sampel 42

Download ppt "EVALUATING THE TEMPORAL COHERENCE OF ARCHIVED PAGES SCOTT G. AINSWORTH MICHAEL L. NELSON OLD DOMINION UNIVERSITY IIPC 2015 APRIL 27 – MAY 1, 2015 STANFORD."

Similar presentations

HTTP HyperText Transfer Protocol. HTTP Uses TCP as its underlying transport protocol Uses port 80 Stateless protocol (i.e. HTTP Server maintains no information.

HTTP HyperText Transfer Protocol. HTTP Uses TCP as its underlying transport protocol Uses port 80 Stateless protocol (i.e. HTTP Server maintains no information.
HTTP – HyperText Transfer Protocol

HTTP – HyperText Transfer Protocol
Prototypes of pro-active approaches to support the archiving of web references for scholarly communications Richard Wincewicz 1, Peter Burnhill 1 & Herbert.

Prototypes of pro-active approaches to support the archiving of web references for scholarly communications Richard Wincewicz 1, Peter Burnhill 1 & Herbert.
Unexpected Protocol Implications Elliot Jaffe with Dror Feitelson, Scott Kirkpatrick Networking Seminar Artzi 2008.

Unexpected Protocol Implications Elliot Jaffe with Dror Feitelson, Scott Kirkpatrick Networking Seminar Artzi 2008.
11 WARC standard revision workshop Clément Oury IIPC General Assembly open workshops Stanford, April 28th, 2015 IIPC General Assembly – Stanford – April.

11 WARC standard revision workshop Clément Oury IIPC General Assembly open workshops Stanford, April 28th, 2015 IIPC General Assembly – Stanford – April.
Navigating and Browsing 3D Models in 3DLIB Hesham Anan, Kurt Maly, Mohammad Zubair Computer Science Dept. Old Dominion University, Norfolk, VA, 23529 (anan,

Navigating and Browsing 3D Models in 3DLIB Hesham Anan, Kurt Maly, Mohammad Zubair Computer Science Dept. Old Dominion University, Norfolk, VA, (anan,
Web Server Design Week 5 Old Dominion University Department of Computer Science CS 495/595 Spring 2010 Martin Klein 2/10/10.

Web Server Design Week 5 Old Dominion University Department of Computer Science CS 495/595 Spring 2010 Martin Klein 2/10/10.
Interpreting logs and reports IIPC GA 2014 Crawl engineers and operators workshop Bert Wendland/BnF.

Interpreting logs and reports IIPC GA 2014 Crawl engineers and operators workshop Bert Wendland/BnF.
1 HTML and CGI Scripting CSC8304 – Computing Environments for Bioinformatics - Lecture 10.

1 HTML and CGI Scripting CSC8304 – Computing Environments for Bioinformatics - Lecture 10.
Krerk Piromsopa. Web Caching Krerk Piromsopa. Department of Computer Engineering. Chulalongkorn University.

Krerk Piromsopa. Web Caching Krerk Piromsopa. Department of Computer Engineering. Chulalongkorn University.
CP476 Internet Computing Lecture 5 : HTTP, WWW and URL 1 Lecture 5. WWW, HTTP and URL Objective: to review the concepts of WWW to understand how HTTP works.

CP476 Internet Computing Lecture 5 : HTTP, WWW and URL 1 Lecture 5. WWW, HTTP and URL Objective: to review the concepts of WWW to understand how HTTP works.
TCP/IP Protocol Suite 1 Chapter 22 Upon completion you will be able to: World Wide Web: HTTP Understand the components of a browser and a server Understand.

TCP/IP Protocol Suite 1 Chapter 22 Upon completion you will be able to: World Wide Web: HTTP Understand the components of a browser and a server Understand.
Memento Update CNI Task Force Meeting, Spring 2011 1 Memento Herbert Van de Sompel Robert Sanderson Michael L. Nelson Giant Leaps.

Memento Update CNI Task Force Meeting, Spring Memento Herbert Van de Sompel Robert Sanderson Michael L. Nelson Giant Leaps.
Archival HTTP Redirection Retrieval Policies Temporal Web Analytics Workshop 2013, Rio De Janiro Ahmed AlSum, Michael L. Nelson Old Dominion University.

Archival HTTP Redirection Retrieval Policies Temporal Web Analytics Workshop 2013, Rio De Janiro Ahmed AlSum, Michael L. Nelson Old Dominion University.
Addressing Incompleteness and Noise in Evolving Web Snapshots KJDB2007 Masashi Toyoda IIS, University of Tokyo.

Addressing Incompleteness and Noise in Evolving Web Snapshots KJDB2007 Masashi Toyoda IIS, University of Tokyo.
OAI-PMH for Resource Harvesting Tutorial OAI4, October 20 th 2005, CERN, Geneva, Switzerland OAIResource Software Her This work supported in part by the.

OAI-PMH for Resource Harvesting Tutorial OAI4, October 20 th 2005, CERN, Geneva, Switzerland OAIResource Software Her This work supported in part by the.
TEMPORAL SPREAD IN ARCHIVED COMPOSITE RESOURCES (WORK IN PROGRESS) SCOTT G. AINSWORTH MICHAEL L. NELSON OLD DOMINION UNIVERSITY COMPUTER SCIENCE WADL 2013.

TEMPORAL SPREAD IN ARCHIVED COMPOSITE RESOURCES (WORK IN PROGRESS) SCOTT G. AINSWORTH MICHAEL L. NELSON OLD DOMINION UNIVERSITY COMPUTER SCIENCE WADL 2013.
Scott Ainsworth, Ahmed AlSum, Hany SalahEldeen, Michele C. Weigle, Michael L. Nelson Old Dominion University, USA {sainswor, aalsum, hany, mweigle,

Scott Ainsworth, Ahmed AlSum, Hany SalahEldeen, Michele C. Weigle, Michael L. Nelson Old Dominion University, USA {sainswor, aalsum, hany, mweigle,
Crawl RSS Kristinn Sigurðsson National and University Library of Iceland IIPC GA 2014 – Paris.

Crawl RSS Kristinn Sigurðsson National and University Library of Iceland IIPC GA 2014 – Paris.
80 million tiny images: a large dataset for non-parametric object and scene recognition CS 4763 Multimedia Systems Spring 2008.

80 million tiny images: a large dataset for non-parametric object and scene recognition CS 4763 Multimedia Systems Spring 2008.

Similar presentations

Ads by Google