Presentation is loading. Please wait.

Presentation is loading. Please wait.

The BHL way to content William Ulate BHL Technical Director Global BHL Coordinator Leiden, Netherlands February 14, 2013.

Similar presentations

Presentation on theme: "The BHL way to content William Ulate BHL Technical Director Global BHL Coordinator Leiden, Netherlands February 14, 2013."— Presentation transcript:

1 The BHL way to content William Ulate BHL Technical Director Global BHL Coordinator Leiden, Netherlands February 14, 2013

2 What is BHL? The Biodiversity Heritage Library is a consortium of natural history and botanical libraries that cooperate to digitize and make accessible the legacy literature of biodiversity held in their collections and to make that literature available for open access and responsible use as a part of a global “biodiversity commons.” The Biodiversity Heritage Library is a consortium of natural history and botanical libraries that cooperate to digitize and make accessible the legacy literature of biodiversity held in their collections and to make that literature available for open access and responsible use as a part of a global “biodiversity commons.”

3 Extensive

4 Global…

5 New Partners and Geographies

6 Dear Sir / Madam Can i just congratulate you on an absolutely brilliant online resource. I am compiling a report on an invasive hydromedusae and could not believe the ease and efficiency of this web page which genuinely saved me weeks of my life Research that previously took months now takes only a few hours La plus grande #bibliotheque #botanique & #zoologique online The largest online botanical & zoological #library #BHL The freeing of knowledge may lead to new discoveries and changes in the way the natural world is perceived

7 More Online Content

8 San Francisco Woods Hole London Alexandria Beijing Global Replication & Serving Replicated Data Center Portal Application


10 > 390,000 views in 10 months > 1200 sets > 60,000+ images


12 The Art of Life project: describing and providing access to natural history illustrations from the Biodiversity Heritage Library (BHL) TitleStictospiza formosa TypeIllustrations DatePublication: 1898 AgentAuthor: Arthur G. Butler (1844-1925) Illustrator: F.W. Frohawk (1861-1946) DescriptionA pair of finches with green and yellow bodies resting on reeds SubjectsScientific name: Amandava formosa (Latham, 1790) Vernacular Name: Green Avadavat or Green Munia Accepted Name: Amandava formosa (Latham, 1790) Birds, finches Inscriptionsbottom center: Green Amaduvade Waxbill (Stictospiza formosa) Source Butler, Arthur Gardiner. Foreign finches in captivity. Hull and London: Brumby and Clarke, limited,1889 (2nd edition). This image comes from the Biodiversity Heritage Library, and is available online at Heritage RightsPublic domain ElementDefinitionExamplesRepea t Agentsperson or corporate entity involved in the creation, design, production, or publication of a visual resource. Curtis,John 1791 1862 publisher Y CopyrightThe copyright status of the visual resource. Creative Commons Attribution-NonCommercial 2.0 Generic (CC BY-NC 2.0) nc/2.0/deed.en N DateDate or range of dates associated with the creation or publication of the visual resource. 1945 1955 Y DescriptionA free-text note about content of the image, including comments, description, or interpretation, that gives additional information not recorded in other categories. This illustration shows a scale, coloured illustration of Sepsis annulipes (now known as Encita annulipes) beside the Trifolium ochroleucum plant. Several dissections from Sepsis cylindrica Fab. (all these details are provided on the next page of this book and the subsequent page). Y InscriptionsAll marks, caption, or written words added to the object at the time of production or in its subsequent history, including signatures, dates, dedications, texts, and colophons, as well as marks, such as the stamps of silversmiths, publishers, or printers. bottom Radula of L. souleyetianum on a more reduced scale Y SourceA citation for the book, journal or resource that hosts the visual resource Butler, Arthur Gardiner. Foreign finches in captivity. HullBrumby and Clarke, limited,1889 (2nd edition). N SubjectTerms or phrases that describe, identify, or interpret the visual resource. Carl Linnaeus Plant: Picea abies Plant: Picea abies Plant: Norway spruce Y TitleThe title or identifying phrase given to an Image Sepsis annulipes Orangutan Y TypeIdentifies a general category for the visual resource maps forestry maps Y Example of illustration described using Art of Life schema Art of Life schema elements required in Red We welcome your feedback on the schema!




16 Where are we? Scientific Name Extraction – Improved algorithm (Thanks uBio!) Articles – Extended BHL data model to store article metadata – Content and Process to harvest data from BioStor in place Create user interfaces for adding article metadata and associated files – Functional requirements defined – Process flow for adding article metadata and associated files – Implement UI changes Change BHL UI to accommodate article search Change BHL UI to accommodate article display (TOC)

17 Scientific Name Extraction TaxonFinder algorithm in production since 2008 – More than 100 million candidate name strings – More than 1.5 million unique, verified names – Available through UI, APIs, Data Exports & Internet Archive New collaboration with Global Names – Improved algorithm, better precision & recall – More data with TaxonFinder and Neti Neti!

18 Taxon Names BEFORE Name Instances 101,591,803 101,288,804 Unique Names 7,498,554 7,464,924 Verified Names 1,905,507 1,902,803 EOL Names 63,130,350 62,963,582 EOL Pages 13,579,868 13,532,684 AFTER Name Instances 151,222,182 150,066,425 Unique Names 29,246,382 29,091,767 Verified Names 10,153,165 10,109,540 EOL Names 87,791,695 87,135,089 EOL Pages 15,466,713 15,342,867

19 Article-level metadata Chapter-level metadataTreatment-level metadata

20 Part-level metadata Disambiguating and locating structural components in the corpus Done by automated and crowdsourced means – Thanks Rod Page! Welcome others! Greatly increases semantic value of the dataset Addressing important – makes data addressable and thus linkable

21 Articles in the BHL UI

22 Images

23 PDF Generator

24 Support citation reconciliation.............. L. Sp. Pl. 2: 971. 1753 Linneaus, C. Species Plantarum, vol. 2 p. 971. 1753 Linné, Carl von. Sp. Pl. Vol. 2 Page 971. 1753 Caroli Linnaei, Species Plantarum exhibentes plantas rite cognitas, ad genera relatas, cum Differentis Specificis, Nominibus Trivialibus, Synonymis Selectis, Locis Natalibus, secundum SYSTEMA SEXUALE digestas.. 2:971. 1753 Zea mays

25 Citations Providers

26 What we’d like to do Improve OCR Rekeying Tables of Contents Researching candidate Scientific Names Image identification & extraction – – Currently funded by NEH ^Challenges framed as games

27 2007 Name Finding Study >35% OCR error rate for names only 1Insert Space8n->v 2Omit Space9l->i 3e->c10r->i 4u->I11u->ii 5u->n12h->l 6i->l13h->ii 7c->e14e->o Top OCR errors 35.16% Of the 3,003 names, 1,056 were incorrectly transcribed by OCR. Wei, et al. An Evaluation of Taxonomic Name Recognition (TNR) in the Biodiversity Heritage Library. Proceedings of TDWG. 2008.

28 Abbild ungen und Beschreibungen der Fische Syriens, nebst einer neuen Classification und Characteristik sämmtlicher Gattungen der i JOH. JAKOB HECKEL, Inipectoi am k. k. Hof-Natur.-iUenkabinete in Wien, mehr, yelelirt. UeHtllMeii. MIfglivd. STUTTGART. E. Schweizerbart' sehe Verlagshandlung, 1843.

29 Older material Great deal of material is pre-1923 Irregular fonts – blackletter Multiple languages on same page – English text with Latin scientific names Changes in geographic names Changes in scientific names

30 *E.xvi � c � piteI von c. cXx.WptdvonfnrWmn bu � fbe;bcn.5 am cix bIa � S &3rn~ 41X a � m cv(f b1air � 'o � et ert oiensr � ; � ', : � hlrfc � c wa ff � 4am.diug bist a 6aiw~s ff oJrJtwt nof bL4ecImt& blfafra mem b t wag `wr 4 cn wiu 4 e8t5m.ed bvUratflb ck wuo, ma144'*4I bttE5rmbebt =rt3'kn am4ra tif vrmr Waff C * t6rmnli an `tn � ciblatGteaM w ?ffoaifrn w4wmeu nu weib e, wpiteI voE5teiri ct c ober gtUcr cit cm` 91 cLi biar J ' >bSciatl � Oiff ;Bruet wacfttc n qmcx b1a bl: bt5c lttmtt bb9 lkr w.llr#e iti ncn xoa ff cu :r trtuft *e t � B Rn " � trv W1Rt' ?Cm c blas waIwutr Ober � ci ti 1V Ces ' wt gbtiemwwajfu tpctt, afferain 9 c: b � titbfof � r f eran m rs bra wlg auig4;f aer � m *mc vrt blatcabtfm wfru an'deg~m rt blas Iaum bwWt � run f ncmai b14ianf tJobrrfan ebrut4net vnber Brwt Ober awawi*m.crriii btafwfm uww c on$ 'it ttu wttkc 5,10 $ m~C fca trc* cx u W � e � &mcyfbq4 Mabtt mmw rc a iiu bc Jcn ncI.end.*, blat s. a\ u: � rprd3 rw4ftf wm c ii,+ ttCC tn wa frr9fr orfab fcfbt enb c optiti bt -r9 ceDa ttDcn i34M sn Sem i

31 Expanding scope Manuscripts, field notebooks –mostly handwritten, often with drawings Global expansion means dealing with non- Western script systems and a whole new set of OCR problems – Arabic materials from Bibliotheca Alexandria in Egypt

32 Images

33 OCR Improvements Gaming Transcription

34 OCR Improvements Transcription Purposeful Gaming Crowdsource Markup

35 Transcribe Bentham A collaboration of the University of London Computer Centre, UCL Library Services and UCL Learning and Media Services with consultation from the UCL Centre for Digital Humanities Volunteer users can log-in and transcribe previously unstudied and unpublished manuscripts from the Bentham Papers collection in UCL Library's Special Collections in the Transcription Desk.UCL Library's Special Collections Transcription Desk Since launch, volunteers from around the world have transcribed several thousand Bentham manuscripts to an extremely high standard. Results and findings:

36 Transcribe Bentham Who were the volunteers?

37 Transcribe Bentham Age ranges


39 Purposeful Gaming SpaceClimateHumanitiesNatureBiology

40 Purposeful Gaming DIGITALKOOT Joint project run by the National Library of Finland and Microtask to index the library's enormous archives so that they are searchable on the Internet for easier access to the Finnish cultural heritage.National Library of FinlandMicrotask Launched on Feb 8 2011, nearly 110 000 participants completed over 8 million word fixing tasks by Nov 29 2012 DigiTalkoot enabled volunteers to participate in this fixing work by playing games.

41 OCR Improvements German text interpreted by the OCR process as: “unb auf ben ©elnrgen be6 fublic{)en”

42 OCR Improvements Different resulting texts from parsing the phrase: “und auf den Gebirgen des südlichen Deutschlands” (“and on the mountains of southern Germany”) IA OCROCR 2 Transcription 1 Transcription 2 1 unbund Ok 2 denbenden Ok 3 ©elnrgen©ebirgenBebirgenGebirgenX 4 be6desde5desChk 5 fublic{)enfublichenFüdlichenSüdlichenX 6 £)eittfc{)(anb6DeutfchlanbsDeutfchlandsDeutschlandsX

43 Purposeful Gaming

44 Crowdsource Markup Display textSpecies Profile Model category General/summaryTaxonBiology Geographic rangeDistribution Habitat Food sources and feeding behaviorTrophicStrategy Physical description (general)Description Physical description (detailed morphology)DiagnosticDescription

45 Thank you William Ulate Global BHL Project Manager / Technical Director Missouri Botanical Garden Skype: william_ulate_r

Download ppt "The BHL way to content William Ulate BHL Technical Director Global BHL Coordinator Leiden, Netherlands February 14, 2013."

Similar presentations

Ads by Google