New Technologies Supporting Technical Intelligence Anthony Trippe, 221 st ACS National Meeting.

Slides:



Advertisements
Similar presentations
Pseudo-Relevance Feedback For Multimedia Retrieval By Rong Yan, Alexander G. and Rong Jin Mwangi S. Kariuki
Advertisements

CIRPA Conference October 23, CIRPA Conference 2011  Organization Overview  BI Program – Enrolment Management Project ◦ Project Drivers ◦ Business.
SHELLY POTTS, PH.D. UNIVERSITY OFFICE OF EVALUATION AND EDUCATIONAL EFFECTIVENESS ARIZONA STATE UNIVERSITY Quality Assurance Mechanisms.
Chapter 5: Introduction to Information Retrieval
PolyAnalyst Data and Text Mining tool Your Knowledge Partner TM www
Prof. Carolina Ruiz Computer Science Department Bioinformatics and Computational Biology Program WPI WELCOME TO BCB4003/CS4803 BCB503/CS583 BIOLOGICAL.
Benjamin J. Deaver Advisor – Dr. LiGuo Huang Department of Computer Science and Engineering Southern Methodist University.
Building an Intelligent Web: Theory and Practice Pawan Lingras Saint Mary’s University Rajendra Akerkar American University of Armenia and SIBER, India.
1 WEEK 10 Intelligent (Software) Agents. 2 Case Scenario Every year, ABC Enterprise will conduct annual general meeting (AGM) to report company performance.
1 Information Retrieval and Extraction 資訊檢索與擷取 Chia-Hui Chang, Assistant Professor Dept. of Computer Science & Information Engineering National Central.
Basic concepts of Data Mining, Clustering and Genetic Algorithms Tsai-Yang Jea Department of Computer Science and Engineering SUNY at Buffalo.
Data Mining By Archana Ketkar.
Quality evaluation and improvement for Internal Audit
Text Mining: Finding Nuggets in Mountains of Textual Data Jochen Dijrre, Peter Gerstl, Roland Seiffert Presented by Huimin Ye.
Text Mining: Finding Nuggets in Mountains of Textual Data Jochen Dijrre, Peter Gerstl, Roland Seiffert Presented by Drew DeHaas.
Presented To: Madam Nadia Gul Presented By: Bi Bi Mariam.
DASHBOARDS Dashboard provides the managers with exactly the information they need in the correct format at the correct time. BI systems are the foundation.
Innovations in Justice Information Sharing Strategies and Best Practices February 2007 Melissa R. Johnson, CCA Communications Director, International Association.
Data Mining By Andrie Suherman. Agenda Introduction Major Elements Steps/ Processes Tools used for data mining Advantages and Disadvantages.
OLAM and Data Mining: Concepts and Techniques. Introduction Data explosion problem: –Automated data collection tools and mature database technology lead.
What is Business Intelligence? Business intelligence (BI) –Range of applications, practices, and technologies for the extraction, translation, integration,
Intelligent Systems Lecture 23 Introduction to Intelligent Data Analysis (IDA). Example of system for Data Analyzing based on neural networks.
Data Management Turban, Aronson, and Liang Decision Support Systems and Intelligent Systems, Seventh Edition.
Ihr Logo Chapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization Turban, Aronson, and Liang.
Machine Learning. Learning agent Any other agent.
1 Data Mining Books: 1.Data Mining, 1996 Pieter Adriaans and Dolf Zantinge Addison-Wesley 2.Discovering Data Mining, 1997 From Concept to Implementation.
 Expanding roles of I.S.  Types of I.S  Transaction Processing  Record Keeping  Tradional Accounting applications.
The Information School at the University of Washington Information Audits Bob Boiko UW iSchool ischool.washington.edu Metatorial Services Inc.
Introduction to Data Mining Group Members: Karim C. El-Khazen Pascal Suria Lin Gui Philsou Lee Xiaoting Niu.
Innovations in Justice Information Sharing Strategies and Best Practices November 30, 2006 Lisa M. Palmieri, CCA-Supervisory Intelligence Analyst President,
Using Text Mining and Natural Language Processing for Health Care Claims Processing Cihan ÜNAL
Copyright © 2006, The McGraw-Hill Companies, Inc. All rights reserved. Decision Support Systems Chapter 10.
Copyright Prentice Hall, Inc. 1 Computers: Information Technology in Perspective, 11e Larry Long and Nancy Long Chapter 10 Information Systems.
Datawarehouse Objectives
Ontology-Driven Automatic Entity Disambiguation in Unstructured Text Jed Hassell.
© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 5-1 Chapter 5 Business Intelligence: Data.
A Scalable Self-organizing Map Algorithm for Textual Classification: A Neural Network Approach to Thesaurus Generation Dmitri G. Roussinov Department of.
Introduction to machine learning and data mining 1 iCSC2014, Juan López González, University of Oviedo Introduction to machine learning Juan López González.
Machine Learning Lecture 1. Course Information Text book “Introduction to Machine Learning” by Ethem Alpaydin, MIT Press. Reference book “Data Mining.
 Copyright 2008 Digital Enterprise Research Institute. All rights reserved. Semantic on the Social Semantic Desktop.
Kingdom of Saudi Arabia Ministry of Higher Education Al-Imam Muhammad ibn Saud Islamic University College of Computer and Information Sciences Types of.
Data Mining By Dave Maung.
Ihr Logo Chapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization Turban, Aronson, and Liang.
Research and Business Proposals and Planning for Business Reports
BAA - Big Mechanism using SIRA Technology Chuck Rehberg CTO at Trigent Software and Chief Scientist at Semantic Insights™
Advanced Database Course (ESED5204) Eng. Hanan Alyazji University of Palestine Software Engineering Department.
Presented by: Ashgan Fararooy Referenced Papers and Related Work on:
AN INTELLIGENT AGENT is a software entity that senses its environment and then carries out some operations on behalf of a user, with a certain degree of.
Chapter 5: Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization DECISION SUPPORT SYSTEMS AND BUSINESS.
DATABASES AND DATA WAREHOUSES
1 Technology in Action Chapter 11 Behind the Scenes: Databases and Information Systems Copyright © 2010 Pearson Education, Inc. Publishing as Prentice.
Data Mining BY JEMINI ISLAM. Data Mining Outline: What is data mining? Why use data mining? How does data mining work The process of data mining Tools.
Chapter 4 Decision Support System & Artificial Intelligence.
Finding Experts Using Social Network Analysis 2007 IEEE/WIC/ACM International Conference on Web Intelligence Yupeng Fu, Rongjing Xiang, Yong Wang, Min.
BOĞAZİÇİ UNIVERSITY DEPARTMENT OF MANAGEMENT INFORMATION SYSTEMS MATLAB AS A DATA MINING ENVIRONMENT.
Text Analytics A Tool for Taxonomy Development Tom Reamy Chief Knowledge Architect KAPS Group Program Chair – Text Analytics World Knowledge Architecture.
Text Document Categorization by Term Association Maria-luiza Antonie Osmar R. Zaiane University of Alberta, Canada 2002 IEEE International Conference on.
Instructional Technologies - used as media for delivering instruction - conveyors of information and tutors of students. Mindtools – are computer applications.
Chapter 2 Data, Text, and Web Mining. Data Mining Concepts and Applications  Data mining (DM) A process that uses statistical, mathematical, artificial.
Introduction to Machine Learning, its potential usage in network area,
Decision support systems (DSS)
Decision Support Systems
Machine Learning overview Chapter 18, 21
Applications of Data Mining in Software Engineering
Mining the Data Charu C. Aggarwal, ChengXiang Zhai
Presented by: Prof. Ali Jaoua
C.U.SHAH COLLEGE OF ENG. & TECH.
CSE 635 Multimedia Information Retrieval
KNOWLEDGE MANAGEMENT (KM) Session # 37
Pre-classification and AI
Presentation transcript:

New Technologies Supporting Technical Intelligence Anthony Trippe, 221 st ACS National Meeting

Aurigin Systems Inc. Aurigin Consulting Practice Director IP Consulting Services

Introduction  What is Technical Intelligence – Definitions – How Does it Fit with the Company’s Business Strategy The Intelligence Cycle Actionable Intelligence – What is it Not

Introduction (Cont.)  Gatekeeper Approach to TI – The Intelligence Cycle  Ad-Hoc Team Approach to TI – The Intelligence Cycle

Introduction (Cont.)  Computer Assisted TI – Data Mining – Text Mining  Available Methods – Concept Clustering – Self Organized Maps (SOMs) – Neural Networks – Decision Trees

What Is Technical Intelligence?  Definitions: – A tool to assist with long term strategic technical planning – Work processes for helping technical decision makers make smarter decisions faster – An analytical process that transforms disaggregated technological information into relevant strategic knowledge about your competitor’s technical position, size of efforts and trends

What Is Technical Intelligence?  How Does it Fit with the Company’s Business Strategy – Provides foresight into strategic activities Entering new business areas Acquiring new technologies Evaluating competitor’s business moves Project guidance Developing partnerships

What Is Technical Intelligence?  Actionable Intelligence – Intelligence Cycle Define needs and prepare a plan Collect source materials Analyze the results Impact the business – Information when analyzed becomes intelligence – Intelligence directed towards a business decision becomes actionable – Must be used by the decision maker

What Is Technical Intelligence?  What is it Not? – For Patentability – For Validity – For Freedom to Practice – Not about information its about intelligence – It is about trends and forecasting not about focused and specific information retrieval

Gatekeeper Networks and The Intelligence Cycle  Define Needs and Prepare a Plan – Gatekeepers tend to be an expert in a specific area and typically only work in that area – TI is a part time job and involvement is often reactive – Tend to approach each problem the same way (hammer and nail approach) and while excited and interested in subject may not have time to stay current with new intelligence methods

Gatekeeper Networks and The Intelligence Cycle  Collect Source Materials – Limited conference attendance – Personal journal reading – Personal networking – Heavy reliance on the “grapevine”

Gatekeeper Networks and The Intelligence Cycle  Analyze the Results – Manual Mapping Involves reading each document one at a time Information is collected by using: –Spreadsheets –Word Processor tables –Flow charts –Butcher paper and sticky notes Difficult to see hidden trends in large data sets Does not scale well

Gatekeeper Networks and The Intelligence Cycle  Impact the Business – Delivers message using: Handmade charts and graphs Memos Attendance at internal meetings – Knowledge is power – Potential silo creation – NIH – Potentially limited to specific projects

Ad-hoc Team Approach to TI  Define Needs and Prepare a Plan – Each project is done on a case by case basis using a team approach involving subject matter experts – TI Facilitators can communicate in a technically proficient manner and are trained in the field of TI with frequent updates – TI people are often employed full-time in conducting TI – Provides directed, actionable intelligence to the specific business need – The Need Drives the Question

Ad-hoc Team Approach to TI  Collect Source Materials – Size doesn’t matter – Any available electronic source is fair game – Print resources can be scanned in – Internal and external data – Also use human intelligence – The Question Drives the Data

Ad-hoc Team Approach to TI  Analyze the Data – The Data Drives the Tool – Computer Generated Maps Can: Group similar documents together Build landscapes based on semantic concepts Discover trends and do statistical analysis – Mining Activities Data Text – Does not replace reading the source materials

Ad-hoc Team Approach to TI  Impact the Business – Delivers message using: Specific, focused charts, graphs and presentations Detailed visualizations Buy-in from subject matter experts – Focused on business need – Knowledge is shared – Collective effort of many experts – TI team is a corporate resource

Computer Assisted TI  Data Mining – Relies on fielded (structured) data and exact string matches – Involves numerically based statistical analysis – Allows for temporal analysis – Clustering based on coding – Involves co-occurancy matrixes Examination of patent subject matter by Assignee

Co-code Clustering

Co-Occurancy Matrix

Graphical Representation

Computer Assisted TI  Text Mining – Relies on unstructured or semi-structured data – Term extraction takes place based on semantic based AI algorithms – Documents containing similar concepts can be organized together (Classification) – Documents containing overlapping concepts can be placed together geographically (Clustering)

Text Mining  Term Extraction Linguistic Pre- processing Tokens Part of Speech Stemming Term Generation Candidate Generation Combination of Candidates Term Filtering Linguistic Patterns & Association Metrics Information Retrieval Metrics TFIDF Reader

Text Mining  Information Extraction Term Extraction Named Entity Recognition Co- Reference Domain Knowledge Taxonomies

Available Methods  Concept Clustering – A form of SOM – Uses: Term extraction TFIDF Bootstrapping and generation of vectors based on shared concepts – Topographical representation

Themescape

Available Methods  Self Organizing Maps (SOMs) – WEBSOM a method for automatically organizing collections of text documents and for preparing visual maps of them to facilitate the mining and retrieval of information – Details on SOM algorithm can be found at: research/som.shtml

WEBSOM

Available Methods  Neural Networks – Started as model of biological neural networks in the brain – Start with a training set – Use a second known set to measure difference between guess and known result – Computer makes adjustment, guesses again – Iterative process until within tolerance – Results visualized with standard methods (SOM, et…)

Available Methods  Decision Trees – Represents a set of rules – Training set identifies rules based on defined results and corresponding trends – Can be used on new data to make business decisions – Also called expert systems

Decision Tree