1. The Deep Web March 2, 2016 1

2. What is the Deep Web Aka the Invisible Web – Contents from thousands of specialized, searchable databases – Contents from web pages that search engines cannot index 2

3. 3 Searching the (regular) Internet > 170 million web sites made up of billions of web pages/documents >4.5 billion queries/searches per month Payment schemes – Pay for inclusion: $ fees for a business to be included in index – Pay for position: sites are ranked – Pay per click: Keywords auctioned to advertisersclick – Pay per action: Advertisers pay only when a click results in an action.action

4. 4 Payment schemes: Consequences Results may be from sites which can pay to be listed: Results may not be most appropriate. Nonprofit sites are listed but not given priority Searches result in pop up advertisements Must use more than one search tool Deep web sites aren’t included in the indexes of search tools

5. Google vs. the Deep Web Search engines need static and stable links to pages in order to index them Google indexes 20% of the web missing 80% of internet content Google does not typically index – Proprietary sites Proprietary sites – Sites with scripts Sites with scripts – Dynamic sites Dynamic sites – Sites blocked by search engine policy Sites blocked by search engine policy – Sites with special formats Sites with special formats – Searchable databases Searchable databases 5

6. How big is the Deep Web? 550 billion documents 500x the content of the surface Web Internet search tool = searches 20% of available content. Deep web is not Internet2Internet2 6

7. Why use the Deep Web? Higher quality sources – Selected and organized by subject experts Dynamic display Customized data sets Some data is visual, and not word searchable 7

8. What’s in the Deep Web? Searchable databasesdatabases Downloadable files & spreadsheets Downloadable files Image and multi-media filesmulti-media Data sets Various file formats such as.pdf,.xls,.mdb,formats Lots of government informationgovernment 8

9. Deep Web Collections Web Lens : http://www.weblens.org/scholar.html Info Mine: http://infomine.ucr.edu/ Internet Archive: http://www.archive.org/index.php 9

10. How to Keep Track of the Deep Web Subscribe to: – Listserv Listserv – Information Sources BlogBlog – Discussion Board Discussion Board Read: – The Periodical LiteraturePeriodical Consult: – Librarians – Faculty – Colleagues 10

11. Deep Web Sites for English/British Lit 1.Middle English Dictionary http://quod.lib.umich.edu/m/med/ http://quod.lib.umich.edu/m/med/ 2.University of VA E-Text English Language Resources http://etext.lib.virginia.edu/collections/langu ages/english/ http://etext.lib.virginia.edu/collections/langu ages/english/ 3.The New Chaucer Society http://artsci.wustl.edu/~chaucer/ http://artsci.wustl.edu/~chaucer/ 11

12. Deep Web Sites for English/British Lit 4.The Internet Public Library Online Literary Criticism Collection http://www.ipl.org/div/litcrit http://www.ipl.org/div/litcrit 5.Romanticism on the Net http://www.ron.umontreal.ca/ http://www.ron.umontreal.ca/ 6.The Brontë Sisters Web http://www.lang.nagoya-u.ac.jp/~matsuoka/Bronte.html http://www.lang.nagoya-u.ac.jp/~matsuoka/Bronte.html 12

13. Deep Web Sites for English/British Lit 7.Mr. William Shakespeare and the Internet http://shakespeare.palomar.edu http://shakespeare.palomar.edu 8.The Voice of the Shuttle http://vos.ucsb.edu http://vos.ucsb.edu 9.The Victorian Web http://www.victorianweb.org/ http://www.victorianweb.org/ 13

14. Deep Web Sites for English/British Lit 10.The Rossetti Archive http://www.rossettiarchive.org/ http://www.rossettiarchive.org/ 11.Introductory Guide to Critical Theory http://www.cla.purdue.edu/academic/engl/the ory/ http://www.cla.purdue.edu/academic/engl/the ory/ 12.Anglo-Saxon England Guide to Online Resources http://www.the- orb.net/encyclop/early/pre1000/asindex.html http://www.the- orb.net/encyclop/early/pre1000/asindex.html 14

15. Deep Web Sites for English/British Lit 13.Representative Poetry Online http://rpo.library.utoronto.ca/display/index.c fm http://rpo.library.utoronto.ca/display/index.c fm 14.The Poetry Archive URL:http://www.poetryarchive.org URL:http://www.poetryarchive.org 15.Open Source Shakespeare www.opensourceshakespeare.org/ www.opensourceshakespeare.org/ 15

16. Deep Web Sites for English/British Lit 16.Blake Digital Text Project www.english.uga.edu/~wblake/home1.html www.english.uga.edu/~wblake/home1.html 17.The Blake Archive www.blakearchive.org/ www.blakearchive.org/ 16

17. Deep Web Exercise Working as a group: – Annotate the links on slides 11-16. Post your annotations, comments, searching tips, to the British Lit Deep Web Wiki. Connect to the Research Wikis link from the library’s homepage: www.cabrini.edu/librarywww.cabrini.edu/library 17