Artificial Immune Systems: An Emerging Technology Dr. Jonathan Timmis Computing Laboratory University of Kent at Canterbury England. UK.

Slides:



Advertisements
Similar presentations
V-Detector: A Negative Selection Algorithm Zhou Ji, advised by Prof. Dasgupta Computer Science Research Day The University of Memphis March 25, 2005.
Advertisements

Artificial Immune Systems. CBA - Artificial Immune Systems Artificial Immune Systems: A Definition AIS are adaptive systems inspired by theoretical immunology.
Sazalinsyah Razali (syah)‏ Dr. Q. Meng (Supervisor)‏
CIFD: Computational Immunology for Fraud Detection
Immune System Part III:
Artificial Immune Systems Razieh Khamseh-Ashari Department of Electrical and Computer Eng Isfahan University of Technology Supervisor: Dr. Abdolreza Mirzaei.
1 BY: Nazanin Asadi Zohre Molaei Isfahan University of Technology.
Lecture 4 Activation of Adaptive Immunity. Overview In order to initiate an immune response antigen must be recognized. In order to initiate an immune.
Specific Immunity—3 rd line of defense Who are the players? Antigens Antibodies and B-cells Antibody editing and clonal selection Cytotoxic T-cells Helper.
Immune System Chapter 14.
Anomaly Detection in Data Docent Xiao-Zhi Gao
Lecture outline The nomenclature of Immunology
16-1 Topics Immunity Lymphoid system Immunity Matures throughout life Has memory – enhanced response to pathogens Vaccination – deliberate exposureto.
Click to edit master text Click to edit Master text styles Second level Third level Fourth level Fifth level Artificial Immune Systems Dr Uwe Aickelin.
Artificial Immune Systems Andrew Watkins. Why the Immune System? Recognition –Anomaly detection –Noise tolerance Robustness Feature extraction Diversity.
Information Processing in Living Systems. Does the brain compute?
Complexity and the Immune System. Why look at the immune system? -Intermediate level -One of the major information processing systems in the body (with.
Principles of Immunology Overview of Adaptive Immunity 1/24/06 “Too many people overvalue what they are not and undervalue what they are.” M Forbes.
Artificial Immune Systems: A New Computational Intelligence Approach
The body’s defenses. Reading: Ch. 43; Keywords Lines of defense Lymphatic system Inflammation Features of immune system Memory B-cells Primary and secondary.
1 Negative selection algorithms: from the thymus to V-detector Dissertation defense Zhou Ji Major professor: Prof. Dasgupta Advisory committee: Dr. Lin,
Introduction to Artificial Immune Systems (AIS) BIC 2005: International Symposium on Bio-Inspired Computing Johor, MY, 5-7 September 2005 Dr. Leandro Nunes.
An Introduction to Artificial Immune Systems Dr. Jonathan Timmis Computing Laboratory University of Kent at Canterbury CT2 7NF. UK.
Specific Immunity. Who are the players? Antigens: foreign proteins, usually part of virus or bacteria Antibodies: Proteins made by immune cells that “recognize”
Specific Immune Defense. Antigens Antibody-generator, Non-self, Large molecules Properties: ◦1. Immunogenicity ◦2. Reactivity Antigenic determinant or.
Immune Response Adaptive Immune Response. Adaptive Immune 2 Adaptive Immune Response Humoral Immunity B cells Cellular Immunity T cells.
Specific immune system
Population-based metaheuristics Nature-inspired Initialize a population A new population of solutions is generated Integrate the new population into the.
By : Anas Assiri.  Introduction  fraud detection  Immune system  Artificial immune system (AIS)  AISFD  Clonal selection.
Distributed Network Intrusion Detection An Immunological Approach Steven Hofmeyr Stephanie Forrest Patrik D’haeseleer Dept. of Computer Science University.
1 Principles of a Computer Immune System Anil Somayaji, Steven Hofmeyr, & Stephanie Forrest Presented by: Jesus Morales.
Genetic Algorithm.
Specific Cellular Defence.  Range of white blood cells (WBCs) circulate monitoring for damage, pathogens or cancerous cells  In response to damage or.
Specific Defense Mechanisms – The Immune System
Immune System Metaphors Applied to Intrusion Detection and Related Problems by Ian Nunn, SCS, Carleton University
Lecture 14 Immunology: Adaptive Immunity. Principles of Immunity Naturally Acquired Immunity- happens through normal events Artificially Acquired Immunity-
Nasraoui, Gonzalez, Cardona, Dasgupta: Scalable Artificial Immune System Based Data Mining NSF-NGDM, Nov. 1-3, 2002, Baltimore, MD Artificial Immune Systems.
Rogério de LemosDEFINE – Pisa, November 2002 – 1 Proactive Computing: Artificial Immune Systems Rogério de Lemos University of Kent at Canterbury  Brian.
Automatic Test-Data Generation: An Immunological Approach Kostas Liaskos Marc Roper {Konstantinos.Liaskos, TAIC PART 2007.
Zentrum für Hochleistungsrechnen (ZHR) – A Bios Group Presentation Niloy Ganguly Immune System and Search Technology Designing a Fast Search Algorithm.
Specific Immune System
Cell mediated response What the B-cells miss or are not programmed to deal with T-cells are able to handle. Usually 1.
APPLICATION OF THE METHOD AND COMBINED ALGORITHM ON THE BASIS OF IMMUNE NETWORK AND NEGATIVE SELECTION FOR IDENTIFICATION OF TURBINE ENGINE SURGING Lytvynenko.
Chapter 16 Immunological Tolerance. Contents Part Ⅰ Introduction Part Ⅱ Mechanisms of Self Tolerance Part Ⅲ Factors affecting Induced Tolerance Part Ⅳ.
Specific Defenses of the Host
CHAPTER 23 Molecular Immunology.
Immune System Overview. GOT DEFENSE? ANATOMY OF THE IMMUNE SYSTEM The immune system is localized in several parts of the body –immune cells develop.
Telling self from non-self: Learning the language of the Immune System Rose Hoberman and Roni Rosenfeld BioLM Workshop May 2003.
Chapter 23 Immunogenetics. The immune response in mammals involves three steps: 1.Recognition of the foreign substance 2.Communication of this recognition.
Adaptive immunity – B cell
Immunology Chapter 43. Innate Immunity Present and waiting for exposure to pathogens Non-specific External barriers and internal cellular and chemical.
Artificial Immune System based Cooperative Strategies for Robot Soccer Competition International Forum on Strategic Technology, p.p , Oct
IMMUNOLOGICAL TOLERANCE Lecture 6 Jan Żeromski 2007/2008.
Changing the Rules of the Game Dr. Marco A. Janssen Department of Spatial Economics.
___________DEFENSES of the HOST: THE IMMUNE RESPONSE
starter CELL comparison Cell Natural Killer Cell B Lymphocyte
Dr.Abeer Mahmoud ARTIFICIAL INTELLIGENCE (CS 461D) Dr. Abeer Mahmoud Computer science Department Princess Nora University Faculty of Computer & Information.
Immunology B cells and Antibodies – humoral
Lecture 7 Immunology Cells of adaptive immunity
Presentation By SANJOG BHATTA Student ID : July 1’ 2009.
Surface Defect Inspection: an Artificial Immune Approach Dr. Hong Zheng and Dr. Saeid Nahavandi School of Engineering and Technology.
GENERAL IMMUNOLOGY PHT 324
Daily Warm-up March 19th During the Quarter Quell, Katniss Everdeen searches for water in the arena. Before she found it, she began to become dehydrated.
Adaptive Defense System
Unit 4 - Immunology and Public Health
Immune System Chapter 14.
Immune System Chapter 14.
Telling self from non-self: Learning the language of the Immune System
Introduction to Microbiology
Immunocomputing and Artificial Immune Systems
Presentation transcript:

Artificial Immune Systems: An Emerging Technology Dr. Jonathan Timmis Computing Laboratory University of Kent at Canterbury England. UK. Congress on Evolutionary Computation Seoul, Korea.

CEC 2001Artificial Immune Systems Tutorial Overview What are Artificial Immune Systems? Background immunology Why use the immune system as a metaphor Immune Metaphors employed Review of AIS work Applications More blue sky research

CEC 2001Artificial Immune Systems Immune metaphors Immune System Idea!Idea ‘ Other areas Artificial Immune Systems

CEC 2001Artificial Immune Systems Relatively new branch of computer science Some history Using natural immune system as a metaphor for solving computational problems Not modelling the immune system Variety of applications so far … Fault diagnosis (Ishida) Computer security (Forrest, Kim) Novelty detection (Dasgupta) Robot behaviour (Lee) Machine learning (Hunt, Timmis, de Castro)

CEC 2001Artificial Immune Systems Why the Immune System? Recognition Anomaly detection Noise tolerance Robustness Feature extraction Diversity Reinforcement learning Memory Distributed Multi-layered Adaptive

CEC 2001Artificial Immune Systems Part I – Basic Immunology

CEC 2001Artificial Immune Systems Role of the Immune System Protect our bodies from infection Primary immune response Launch a response to invading pathogens Secondary immune response Remember past encounters Faster response the second time around

CEC 2001Artificial Immune Systems How does it work?

CEC 2001Artificial Immune Systems Where is it?

CEC 2001Artificial Immune Systems Multiple layers of the immune system

CEC 2001Artificial Immune Systems Immune Pattern Recognition The immune recognition is based on the complementarity between the binding region of the receptor and a portion of the antigen called epitope. Antibodies present a single type of receptor, antigens might present several epitopes. This means that different antibodies can recognize a single antigen

CEC 2001Artificial Immune Systems Antibodies Antibody MoleculeAntibody Production

CEC 2001Artificial Immune Systems Clonal Selection

CEC 2001Artificial Immune Systems T-cells Regulation of other cells Active in the immune response Helper T-cells Killer T-cells

CEC 2001Artificial Immune Systems Main Properties of Clonal Selection (Burnet, 1978) Elimination of self antigens Proliferation and differentiation on contact of mature lymphocytes with antigen Restriction of one pattern to one differentiated cell and retention of that pattern by clonal descendants; Generation of new random genetic changes, subsequently expressed as diverse antibody patterns by a form of accelerated somatic mutation

CEC 2001Artificial Immune Systems Reinforcement Learning and Immune Memory Repeated exposure to an antigen throughout a lifetime Primary, secondary immune responses Remembers encounters No need to start from scratch Memory cells Associative memory

CEC 2001Artificial Immune Systems Learning (2)

CEC 2001Artificial Immune Systems Immune Network Theory Idiotypic network ( Jerne, 1974) B cells co-stimulate each other Treat each other a bit like antigens Creates an immunological memory

CEC 2001Artificial Immune Systems Immune Network Theory(2)

CEC 2001Artificial Immune Systems Shape Space Formalism Repertoire of the immune system is complete ( Perelson, 1989) Extensive regions of complementarity Some threshold of recognition  V   V   V  V       

CEC 2001Artificial Immune Systems Self/Non-Self Recognition Immune system needs to be able to differentiate between self and non-self cells Antigenic encounters may result in cell death, therefore Some kind of positive selection Some element of negative selection

CEC 2001Artificial Immune Systems Summary so far …. Immune system has some remarkable properties Pattern recognition Learning Memory So, is it useful?

CEC 2001Artificial Immune Systems Some questions for you !

CEC 2001Artificial Immune Systems Part II – A Review of Artificial Immune Systems

CEC 2001Artificial Immune Systems Topics to Cover A few disclaimers … I can not cover everything as there is a large amount of work out there To do so, would be silly Proposed general frameworks Give an overview of significant application areas and work therein I am not an expert in all the problem domains I would earn more money if I was !

CEC 2001Artificial Immune Systems Shape Space Describe interactions between molecules Degree of binding between molecules Complement threshold Each paratope matches a certain region of space Complete repertoire

CEC 2001Artificial Immune Systems Representation and Affinities Representation affects affinity measure Binary Integer Affinity is related to distance Euclidian Hamming Affinity threshold

CEC 2001Artificial Immune Systems Basic Immune Models and Algorithms Bone Marrow Models Negative Selection Algorithms Clonal Selection Algorithm Somatic Hypermutation Immune Network Models

CEC 2001Artificial Immune Systems Bone Marrow Models Gene libraries are used to create antibodies from the bone marrow Antibody production through a random concatenation from gene libraries Simple or complex libraries

CEC 2001Artificial Immune Systems Negative Selection Algorithms Forrest 1994: Idea taken from the negative selection of T-cells in the thymus Applied initially to computer security Split into two parts: Censoring Monitoring

CEC 2001Artificial Immune Systems Negative Selection Algorithm Each copy of the algorithm is unique, so that each protected location is provided with a unique set of detectors Detection is probabilistic, as a consequence of using different sets of detectors to protect each entity A robust system should detect any foreign activity rather than looking for specific known patterns of intrusion. No prior knowledge of anomaly (non-self) is required The size of the detector set does not necessarily increase with the number of strings being protected The detection probability increases exponentially with the number of independent detection algorithms There is an exponential cost to generate detectors with relation to the number of strings being protected (self). Solution to the above in D’haeseleer et al. (1996)

CEC 2001Artificial Immune Systems Somatic Hypermutation Mutation rate in proportion to affinity Very controlled mutation in the natural immune system Trade-off between the normalized antibody affinity D* and its mutation rate ,

CEC 2001Artificial Immune Systems Immune Network Models Timmis & Neal, 2000 Used immune network theory as a basis, proposed the AINE algorithm Initialize AIN For each antigen Present antigen to each ARB in the AIN Calculate ARB stimulation level Allocate B cells to ARBs, based on stimulation level Remove weakest ARBs (ones that do not hold any B cells) If termination condition met exit else Clone and mutate remaining ARBs Integrate new ARBs into AIN

CEC 2001Artificial Immune Systems Immune Network Models De Castro & Von Zuben (2000c) aiNET, based in similar principles At each iteration step do For each antigen do Determine affinity to all network cells Select n highest affinity network cells Clone these n selected cells Increase the affinity of the cells to antigen by reducing the distance between them (greedy search) Calculate improved affinity of these n cells Re-select a number of improved cells and place into matrix M Remove cells from M whose affinity is below a set threshold Calculate cell-cell affinity within the network Remove cells from network whose affinity is below a certain threshold Concatenate original network and M to form new network Determine whole network inter-cell affinities and remove all those below the set threshold Replace r% of worst individuals by novel randomly generated ones Test stopping criterion

CEC 2001Artificial Immune Systems Part III - Applications

CEC 2001Artificial Immune Systems Anomaly Detection The normal behavior of a system is often characterized by a series of observations over time. The problem of detecting novelties, or anomalies, can be viewed as finding deviations of a characteristic property in the system. For computer scientists, the identification of computational viruses and network intrusions is considered one of the most important anomaly detection tasks

CEC 2001Artificial Immune Systems Virus Detection Protect the computer from unwanted viruses Initial work by Kephart 1994 More of a computer immune system

CEC 2001Artificial Immune Systems Virus Detection (2) Okamoto & Ishida (1999a,b) proposed a distributed approach Detected viruses by matching self-information first few bytes of the head of a file the file size and path, etc. against the current host files. Viruses were neutralized by overwriting the self- information on the infected files Recovering was attained by copying the same file from other uninfected hosts through the computer network

CEC 2001Artificial Immune Systems Virus Detection (3) Other key works include: A distributed self adaptive architecture for a computer virus immune system (Lamont, 200) Use a set of co-operating agents to detect non-self patterns Immune SystemComputational System Pathogens (antigens)Computer viruses B-, T-cells and antibodiesDetectors ProteinsStrings Antibody/antigen bindingPattern matching

CEC 2001Artificial Immune Systems Security Somayaji et al. (1997) outlined mappings between IS and computer systems A security systems need Confidentiality Integrity Availability Accountability Correctness

CEC 2001Artificial Immune Systems IS to Security Systems Immune SystemNetwork Environment Static Data SelfUncorrupted data Non-selfAny change to self Active Processes on Single Host CellActive process in a computer Multicellular organismComputer running multiple processes Population of organismsSet of networked computers Skin and innate immunitySecurity mechanisms, like passwords, groups, file permissions, etc. Adaptive immunityLymphocyte process able to query other processes to seek for abnormal behaviors Autoimmune responseFalse alarm SelfNormal behavior Non-selfAbnormal behavior Network of Mutually Trusting Computers Organ in an animalEach computer in a network environment

CEC 2001Artificial Immune Systems Network Security Hofmeyr & Forrest (1999, 2000): developing an artificial immune system that is distributed, robust, dynamic, diverse and adaptive, with applications to computer network security. Kim & Bentley (1999). New paper here at CEC so I won’t cover it, go see it for yourself!

CEC 2001Artificial Immune Systems Forrests Model AIS for computer network security. (a) Architecture. (b) Life cycle of a detector. Datapathtriple ( , , ftp) Broadcast LAN ip: port: 2000 Internal host External host ip: port: 22 Host Activation threshold Cytokine level Permutation mask Detector set immature memory activated matches Detector Randomlycreated Immature Mature & Naive Death Activated Memory No matchduring tolerization Exceed activation threshold Don’t exceed activation threshold No co stimulation Co stimulation Match during tolerization

CEC 2001Artificial Immune Systems Novelty Detection Image Segmentation : McCoy & Devarajan (1997) Detecting road contours in aerial images Used a negative selection algorithm

CEC 2001Artificial Immune Systems Hardware Fault Tolerance Immunotronics (Bradley & Tyrell, 2000) Use negative selection algorithm for fault tolerance in hardware Table 4.1. Immune SystemHardware Fault Tolerance Recognition of selfRecognition of valid state/state transition Recognition of non-selfRecognition of invalid state/state transition LearningLearning correct states and transitions Humoral immunityError detection and recovery Clonal deletionIsolation of self-recognizing tolerance conditions Inactivation of antigenReturn to normal operation Life of an organismOperation lifetime of a hardware

CEC 2001Artificial Immune Systems Machine Learning Early work on DNA Recognition Cooke and Hunt, 1995 Use immune network theory Evolve a structure to use for prediction of DNA sequences 90% classification rate Quite good at the time, but needed more corroboration of results

CEC 2001Artificial Immune Systems Unsupervised Learning Timmis, 2000 Based on Hunts work Complete redesign of algorithm: AINE Immune metadynamics Shape space Few initial parameters Stabilises to find a core pattern within a network of B cells

CEC 2001Artificial Immune Systems Results (Timmis, 2000)

CEC 2001Artificial Immune Systems Another approach de Castro and von Zuben, 2000 aiNET cf. SOFM Use similar ideas to Timmis Immune network theory Shape space Suppression mechanism different Eliminate self similar cells under a set threshold Clone based on antigen match, network not taken into account

CEC 2001Artificial Immune Systems Results (de Castro & von Zuben, 2001) Test ProblemResult from aiNET

CEC 2001Artificial Immune Systems Supervised Approach Carter, 2000 Pattern recognition and classification system: Immunos-81 Use T-cells, B-cells, antibodies and amino-acid library Builds a library of data types and classes System can generalise Good classification rates on sample data sets

CEC 2001Artificial Immune Systems Robotics Behaviour Arbitration Ishiguro et al. (1996, 1997) : Immune network theory to evolve a behaviour among a set of agents Collective Behaviour Emerging collective behaviour through communicating robots (Jun et al, 1999) Immune network theory to suppress or encourage robots behaviour

CEC 2001Artificial Immune Systems Scheduling Hart et al. (1998) and Hart & Ross (1999a) Proposed an AIS to produce robust schedules for a dynamic job-shop scheduling problem in which jobs arrive continually, and the environment is subject to changes. Investigated is an AIS could be evolved using a GA approach then be used to produce sets of schedules which together cover a range of contingencies, predictable and unpredictable. Model included evolution through gene libraries, affinity maturation of the immune response and the clonal selection principle.

CEC 2001Artificial Immune Systems Diagnosis Ishida (1993) Immune network model applied to the process diagnosis problem Later was elaborated as a sensor network that could diagnose sensor faults by evaluating reliability of data from sensors, and process faults by evaluating reliability of constraints among data. Main immune features employed: Recognition is performed by distributed agents which dynamically interact with each other; Each agent reacts based solely on its own knowledge; and Memory is realized as stable equilibrium points of the dynamical network.

CEC 2001Artificial Immune Systems Summary Covered much, but there is much work not covered (so apologies to anyone for missing theirs) Immunology Immune metaphors Antibodies and their interactions Immune learning and memory Self/non-self Negative selection Application of immune metaphors

CEC 2001Artificial Immune Systems The Future Rapidly growing field that I think is very exciting Much work is very diverse Need of a general framework Wide possible application domains Lots of work to do …. Keep me in a job for quite a while yet