Anomaly Detection brief review of my prospectus Ziba Rostamian CS590 – Winter 2008.

Slides:

Advertisements

Similar presentations

Pattern Finding and Pattern Discovery in Time Series

Advertisements

Sensor-Based Abnormal Human-Activity Detection Authors: Jie Yin, Qiang Yang, and Jeffrey Junfeng Pan Presenter: Raghu Rangan.

Data Mining Anomaly Detection Lecture Notes for Chapter 10 Introduction to Data Mining by Tan, Steinbach, Kumar © Tan,Steinbach, Kumar Introduction to.

Data Mining Anomaly Detection Lecture Notes for Chapter 10 Introduction to Data Mining by Minqi Zhou © Tan,Steinbach, Kumar Introduction to Data Mining.

Anomaly Detection in Data Docent Xiao-Zhi Gao

ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.

The Decision-Making Process IT Brainpower

DATA MINING CS157A Swathi Rangan. A Brief History of Data Mining The term “Data Mining” was only introduced in the 1990s. Data Mining roots are traced.

UNIVERSITY OF SOUTH CAROLINA Department of Computer Science and Engineering On-line Alert Systems for Production Plants A Conflict Based Approach.

Data Mining Anomaly Detection Lecture Notes for Chapter 10 Introduction to Data Mining by Tan, Steinbach, Kumar © Tan,Steinbach, Kumar Introduction to.

1 Hidden Markov Model Instructor : Saeed Shiry  CHAPTER 13 ETHEM ALPAYDIN © The MIT Press, 2004.

Anomaly Detection. Anomaly/Outlier Detection  What are anomalies/outliers? The set of data points that are considerably different than the remainder.

Causal-State Splitting Reconstruction Ziba Rostamian CS 590 – Winter 2008.

© Tan,Steinbach, Kumar Introduction to Data Mining 4/18/ Data Mining Anomaly Detection Lecture Notes for Chapter 10 Introduction to Data Mining by.

. cmsc726: HMMs material from: slides from Sebastian Thrun, and Yair Weiss.

seminar on Intrusion detection system

Part I: Classification and Bayesian Learning

Hub Queue Size Analyzer Implementing Neural Networks in practice.

Causal-State Splitting Reconstruction Ziba Rostamian CS 590 – Winter 2008.

WAC/ISSCI Automated Anomaly Detection Using Time-Variant Normal Profiling Jung-Yeop Kim, Utica College Rex E. Gantenbein, University of Wyoming.

Intrusion and Anomaly Detection in Network Traffic Streams: Checking and Machine Learning Approaches ONR MURI area: High Confidence Real-Time Misuse and.

Water Contamination Detection – Methodology and Empirical Results IPN-ISRAEL WATER WEEK (I 2 W 2 ) Eyal Brill Holon institute of Technology, Faculty of.

CS490D: Introduction to Data Mining Prof. Chris Clifton April 14, 2004 Fraud and Misuse Detection.

Data Mining Anomaly Detection Lecture Notes for Chapter 10 Introduction to Data Mining by Tan, Steinbach, Kumar © Tan,Steinbach, Kumar Introduction to.

Data Mining Anomaly Detection Lecture Notes for Chapter 10 Introduction to Data Mining by Tan, Steinbach, Kumar © Tan,Steinbach, Kumar Introduction to.

Extracting Places and Activities from GPS Traces Using Hierarchical Conditional Random Fields Yong-Joong Kim Dept. of Computer Science Yonsei.

Intrusion Detection Jie Lin. Outline Introduction A Frame for Intrusion Detection System Intrusion Detection Techniques Ideas for Improving Intrusion.

MACHINE LEARNING 張銘軒譚恆力 1. OUTLINE OVERVIEW HOW DOSE THE MACHINE “ LEARN ” ? ADVANTAGE OF MACHINE LEARNING ALGORITHM TYPES  SUPERVISED.

Anomaly detection with Bayesian networks Website: John Sandiford.

Generating Intelligent Links to Web Pages by Mining Access Patterns of Individuals and the Community Benjamin Lambert Omid Fatemieh CS598CXZ Spring 2005.

© Negnevitsky, Pearson Education, Will neural network work for my problem? Will neural network work for my problem? Character recognition neural.

Machine Learning An Introduction. What is Learning?  Herbert Simon: “Learning is any process by which a system improves performance from experience.”

Using Identity Credential Usage Logs to Detect Anomalous Service Accesses Daisuke Mashima Dr. Mustaque Ahamad College of Computing Georgia Institute of.

Conceptual Foundations © 2008 Pearson Education Australia Lecture slides for this course are based on teaching materials provided/referred by: (1) Statistics.

K. J. O’Hara AMRS: Behavior Recognition and Opponent Modeling Oct Behavior Recognition and Opponent Modeling in Autonomous Multi-Robot Systems.

1 Machine Learning 1.Where does machine learning fit in computer science? 2.What is machine learning? 3.Where can machine learning be applied? 4.Should.

Using Inactivity to Detect Unusual behavior Presenter : Siang Wang Advisor : Dr. Yen - Ting Chen Date : Motion and video Computing, WMVC.

Second Line Intrusion Detection Using Personalization DISA Sponsored GWU-CS.

N. GagunashviliRAVEN Workshop Heidelberg Nikolai Gagunashvili (University of Akureyri, Iceland) Data mining methods in RAVEN network.

© Tan,Steinbach, Kumar Introduction to Data Mining 4/18/ Data Mining Anomaly Detection Lecture Notes for Chapter 10 Introduction to Data Mining by.

Data Mining Anomaly Detection Lecture Notes for Chapter 10 Introduction to Data Mining by Tan, Steinbach, Kumar © Tan,Steinbach, Kumar Introduction to.

Data Mining Anomaly Detection © Tan,Steinbach, Kumar Introduction to Data Mining.

Data Mining Anomaly Detection Lecture Notes for Chapter 10 Introduction to Data Mining by Tan, Steinbach, Kumar © Tan,Steinbach, Kumar Introduction to.

Data Mining Anomaly/Outlier Detection Lecture Notes for Chapter 10 Introduction to Data Mining by Tan, Steinbach, Kumar © Tan,Steinbach, Kumar Introduction.

Lecture 7: Outlier Detection Introduction to Data Mining Yunming Ye Department of Computer Science Shenzhen Graduate School Harbin Institute of Technology.

1 Data Mining: Concepts and Techniques (3 rd ed.) — Chapter 12 — Jiawei Han, Micheline Kamber, and Jian Pei University of Illinois at Urbana-Champaign.

CS 536 – Ahmed Elgammal CS 536: Machine Learning Fall 2005 Ahmed Elgammal Dept of Computer Science Rutgers University.

CHAPTER 8 DISCRIMINATIVE CLASSIFIERS HIDDEN MARKOV MODELS.

Data Mining Anomaly Detection Lecture Notes for Chapter 10 Introduction to Data Mining by Tan, Steinbach, Kumar © Tan,Steinbach, Kumar Introduction to.

Data Mining Anomaly/Outlier Detection Lecture Notes for Chapter 10 Introduction to Data Mining by Tan, Steinbach, Kumar.

CSCI 347, Data Mining Evaluation: Training and Testing, Section 5.1, pages

Anomaly Detection in GPS Data Based on Visual Analytics Kyung Min Su - Zicheng Liao, Yizhou Yu, and Baoquan Chen, Anomaly Detection in GPS Data Based on.

WHAT IS DATA MINING?  The process of automatically extracting useful information from large amounts of data.  Uses traditional data analysis techniques.

WHAT IS DATA MINING?  The process of automatically extracting useful information from large amounts of data.  Uses traditional data analysis techniques.

1 Creating Situational Awareness with Data Trending and Monitoring Zhenping Li, J.P. Douglas, and Ken. Mitchell Arctic Slope Technical Services.

Anomaly Detection Carolina Ruiz Department of Computer Science WPI Slides based on Chapter 10 of “Introduction to Data Mining” textbook by Tan, Steinbach,

Network Management Lecture 13. MACHINE LEARNING TECHNIQUES 2 Dr. Atiq Ahmed Université de Balouchistan.

Over the recent years, computer vision has started to play a significant role in the Human Computer Interaction (HCI). With efficient object tracking.

1 CSE 881: Data Mining Lecture 22: Anomaly Detection.

DATA MINING and VISUALIZATION Instructor: Dr. Matthew Iklé, Adams State University Remote Instructor: Dr. Hong Liu, Embry-Riddle Aeronautical University.

MadeCR: Correlation-based Malware Detection for Cognitive Radio

Lecture Notes for Chapter 9 Introduction to Data Mining, 2nd Edition

Data Mining Anomaly Detection

Outlier Discovery/Anomaly Detection

Data Mining Anomaly/Outlier Detection

Lecture 14: Anomaly Detection

Data Mining Anomaly Detection

Data Mining Anomaly/Outlier Detection

Exploiting the Power of Group Differences to Solve Data Analysis Problems Outlier & Intrusion Detection Guozhu Dong, PhD, Professor CSE

Data Mining Anomaly Detection

Presentation transcript:

Anomaly Detection brief review of my prospectus Ziba Rostamian CS590 – Winter 2008

What I am planning to accomplish Study Learning Finite Automaton. Focusing of CSSR algorithm. Choose an application of desire and test the performance of the CSSR algorithm. (Once I implement the algorithm I can try it for different application and find out where it performs better). Study CSSR and its extensions and use it for detecting anomaly of moving object. Apply some modification in to the algorithm (it depends on how I proceed).

Why this is academically interesting Finite automaton inference has several "real world" applications. Electrical engineering DFA’s have been proposed as a model of players. Model the problem of robot trying to learn its envirounment. The application of PFAs (Probabilistic Finite automaton), of which Hidden Markov Models (HMMs) are special case, are much more extensive. Speech recognition and handwriting recognition recognizing patterns in biological sequences such a DNA and proteins

Anomaly Detection What are anomalies/outliers? The set of data points that are considerably different than the remainder of the data Variants of Anomaly/Outlier Detection Problems Given a database D, find all the data points x  D with anomaly scores greater than some threshold t Given a database D, find all the data points x  D having the top-n largest anomaly scores f(x) Applications: Credit card fraud detection, telecommunication fraud detection, network intrusion detection, fault detection

Importance of Anomaly Detection Ozone Depletion History In 1985 three researchers (Farman, Gardinar and Shanklin) were puzzled by data gathered by the British Antarctic Survey showing that ozone levels for Antarctica had dropped 10% below normal levels Why did the Nimbus 7 satellite, which had instruments aboard for recording ozone levels, not record similarly low ozone concentrations? NASA discovered that the spring-time ''ozone hole'' had been covered up by a computer- program desinged to discard sudden, large drops in ozone concentrations as ''errors''.

Anomaly detection in moving object Example: There are a large number of massive vessels sailing near American coasts. It’s unrealistic to manually trace such a enormous number of moving objects and identify the suspicious ones. Therefore, it’s highly desirable to develop automated tools that can evaluate the behavior of all maritime vessels and flag the suspicious ones. This will allow human agent to focus their monitoring more efficiently and accurantely.

Mechanisms for Anomaly detection Classification, which relies on training data set. Normal Outliers Clustering, which performs automated grouping without using training set.

Anticipated Challenges Tracking moving object can generate an enormous amount of complex data. Example: the time and the location of a vessel might be recorded every few seconds, and non-spatial information such a vessel’s weight, speed, shape and color may be included in this recording There exists substantial complexities of possible abnormal behavior.