1. Ontology-based Information Extraction with a Cognitive Agent Peter Lindes 1, Deryle Lonsdale, David Embley Brigham Young University AAAI 2015 1 Now at University of Michigan © 2015 Peter Lindes 1/22/2015AAAI 2015 - IE with a Cognitive Agent1

2. The Problem 1/22/2015AAAI 2015 - IE with a Cognitive Agent2

3. Goals and Strategies OntoSoar project goals – Extract genealogy facts from family history books – Project extracted information onto a conceptual model to populate a searchable database Strategies – Use ideas from Embodied Construction Grammar – Use the Soar cognitive architecture – Integrate several levels of knowledge Long term goals – Build computational models of human language processing – Apply these models to real-world applications 1/22/2015AAAI 2015 - IE with a Cognitive Agent3

4. Example 1 1/22/2015AAAI 2015 - IE with a Cognitive Agent4

5. A Simple Ontology 1/22/2015AAAI 2015 - IE with a Cognitive Agent5 Charles Christopher Lathrop has 1865 1817 born on died on

6. Example2 1/22/2015AAAI 2015 - IE with a Cognitive Agent6

7. A More Complex Ontology 1/22/2015AAAI 2015 - IE with a Cognitive Agent7 Myra Harwood Jonathan Squires J. Wilbur Squires Feb. 13, 1874

8. The Solution 1/22/2015AAAI 2015 - IE with a Cognitive Agent8 Thus, intelligence is the ability to bring to bear all the knowledge that one has in service of one’s goals. Newell (1990), p. 90 Page Layout * Text Analysis Syntax Semantics Pragmatics World Knowledge Conceptual Models

9. OntoSoar Architecture 1/22/2015AAAI 2015 - IE with a Cognitive Agent9

10. Construction Grammar 1/22/2015AAAI 2015 - IE with a Cognitive Agent10

11. Applying Constructions 1/22/2015AAAI 2015 - IE with a Cognitive Agent11 Charles Christopher Lathrop, N. Y. City, b. 1817, d. 1865, son of Mary Ely and Gerard Lathrop ;

12. … More Constructions 1/22/2015AAAI 2015 - IE with a Cognitive Agent12 Charles Christopher Lathrop, N. Y. City, b. 1817, d. 1865, son of Mary Ely and Gerard Lathrop ;

13. Building Knowledge 1/22/2015AAAI 2015 - IE with a Cognitive Agent13 Charles Christopher Lathrop, N. Y. City, b. 1817, d. 1865, son of Mary Ely and Gerard Lathrop ;

14. Knowledge Structures Compared 1/22/2015AAAI 2015 - IE with a Cognitive Agent14 … his widow married JONATHAN SQUIRES, who was born in Ohio, July 25, 1823, by whom she had one son, J. Wilbur, born June 16, 1865, Charles Christopher Lathrop, N. Y. City, b. 1817, d. 1865, son of Mary Ely and Gerard Lathrop ;

15. Results on Examples 1/22/2015AAAI 2015 - IE with a Cognitive Agent15

16. 1/22/2015AAAI 2015 - IE with a Cognitive Agent16

17. Results on The Ely Ancestry 1/22/2015AAAI 2015 - IE with a Cognitive Agent17 Item TypeInstance Found Persons16,848 Births8,609 Deaths2,406 Genders1,674 Couples3,343 Children3,049 Total35,929 a book of 830 pages, including our Example 1

18. Conclusions Contributions Produces usable genealogy data from scanned books Does this using: – Integration of several levels of knowledge – An adaptation of Embodied Construction Grammar – A cognitive architecture (Soar) Future Work Integrate parsing with semantics Develop a means to learn many new constructions Adapt to varying book styles Scale up to perform well on 100’s of thousands of books 1/22/2015AAAI 2015 - IE with a Cognitive Agent18 It works! … and, it could work a lot better.