Hierarchical Distributed Genetic Algorithm for Image Segmentation Hanchuan Peng, Fuhui Long*, Zheru Chi, and Wanshi Siu {fhlong, phc,

Slides:



Advertisements
Similar presentations
Applications of one-class classification
Advertisements

Exact and heuristics algorithms
電腦視覺 Computer and Robot Vision I Chapter2: Binary Machine Vision: Thresholding and Segmentation Instructor: Shih-Shinh Huang 1.
Optimal Design Laboratory | University of Michigan, Ann Arbor 2011 Design Preference Elicitation Using Efficient Global Optimization Yi Ren Panos Y. Papalambros.
Institute of Intelligent Power Electronics – IPE Page1 Introduction to Basics of Genetic Algorithms Docent Xiao-Zhi Gao Department of Electrical Engineering.
WRSTA, 13 August, 2006 Rough Sets in Hybrid Intelligent Systems For Breast Cancer Detection By Aboul Ella Hassanien Cairo University, Faculty of Computer.
Spie98-1 Evolutionary Algorithms, Simulated Annealing, and Tabu Search: A Comparative Study H. Youssef, S. M. Sait, H. Adiche
Modeling Pixel Process with Scale Invariant Local Patterns for Background Subtraction in Complex Scenes (CVPR’10) Shengcai Liao, Guoying Zhao, Vili Kellokumpu,
1 Lecture 8: Genetic Algorithms Contents : Miming nature The steps of the algorithm –Coosing parents –Reproduction –Mutation Deeper in GA –Stochastic Universal.
1 Learning to Detect Objects in Images via a Sparse, Part-Based Representation S. Agarwal, A. Awan and D. Roth IEEE Transactions on Pattern Analysis and.
Finite State Machine State Assignment for Area and Power Minimization Aiman H. El-Maleh, Sadiq M. Sait and Faisal N. Khan Department of Computer Engineering.
1 Abstract This paper presents a novel modification to the classical Competitive Learning (CL) by adding a dynamic branching mechanism to neural networks.
University of CreteCS4831 The use of Minimum Spanning Trees in microarray expression data Gkirtzou Ekaterini.
Segmentation Divide the image into segments. Each segment:
Data classification based on tolerant rough set reporter: yanan yean.
Prénom Nom Document Analysis: Data Analysis and Clustering Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Basic concepts of Data Mining, Clustering and Genetic Algorithms Tsai-Yang Jea Department of Computer Science and Engineering SUNY at Buffalo.
A fuzzy video content representation for video summarization and content-based retrieval Anastasios D. Doulamis, Nikolaos D. Doulamis, Stefanos D. Kollias.
Image Registration of Very Large Images via Genetic Programming Sarit Chicotay Omid E. David Nathan S. Netanyahu CVPR ‘14 Workshop on Registration of Very.
Image Segmentation by Clustering using Moments by, Dhiraj Sakumalla.
Image segmentation by clustering in the color space CIS581 Final Project Student: Qifang Xu Advisor: Dr. Longin Jan Latecki.
Graph-based consensus clustering for class discovery from gene expression data Zhiwen Yum, Hau-San Wong and Hongqiang Wang Bioinformatics, 2007.
Extracting Places and Activities from GPS Traces Using Hierarchical Conditional Random Fields Yong-Joong Kim Dept. of Computer Science Yonsei.
A Genetic Algorithms Approach to Feature Subset Selection Problem by Hasan Doğu TAŞKIRAN CS 550 – Machine Learning Workshop Department of Computer Engineering.
Genetic Algorithms and Ant Colony Optimisation
Cristian Urs and Ben Riveira. Introduction The article we chose focuses on improving the performance of Genetic Algorithms by: Use of predictive models.
Image Segmentation Seminar III Xiaofeng Fan. Today ’ s Presentation Problem Definition Problem Definition Approach Approach Segmentation Methods Segmentation.
COMMON EVALUATION FINAL PROJECT Vira Oleksyuk ECE 8110: Introduction to machine Learning and Pattern Recognition.
Intro. ANN & Fuzzy Systems Lecture 36 GENETIC ALGORITHM (1)
Image Classification 영상분류
(Particle Swarm Optimisation)
GENETIC ALGORITHMS FOR THE UNSUPERVISED CLASSIFICATION OF SATELLITE IMAGES Ankush Khandelwal( ) Vaibhav Kedia( )
Automatic Image Annotation by Using Concept-Sensitive Salient Objects for Image Content Representation Jianping Fan, Yuli Gao, Hangzai Luo, Guangyou Xu.
Derivative Free Optimization G.Anuradha. Contents Genetic Algorithm Simulated Annealing Random search method Downhill simplex method.
Color Image Segmentation Speaker: Deng Huipeng 25th Oct , 2007.
1 Document Image Matching Based on Component Blocks Fuhui Long, Hanchuan Peng, Zheru Chi, and Wanchi Siu Center for Multimedia Signal Processing, Department.
Last lecture summary. SOM supervised x unsupervised regression x classification Topology? Main features? Codebook vector? Output from the neuron?
CS654: Digital Image Analysis
Smooth Side-Match Classified Vector Quantizer with Variable Block Size IEEE Transaction on image processing, VOL. 10, NO. 5, MAY 2001 Department of Applied.
Computer Graphics and Image Processing (CIS-601).
Advances in digital image compression techniques Guojun Lu, Computer Communications, Vol. 16, No. 4, Apr, 1993, pp
Genetic algorithms (GA) for clustering Pasi Fränti Clustering Methods: Part 2e Speech and Image Processing Unit School of Computing University of Eastern.
Chap 7 Image Segmentation. Edge-Based Segmentation The edge information is used to determine boundaries of objects Pixel-based direct classification methods.
Genetic Algorithms CSCI-2300 Introduction to Algorithms
1 Effect of Spatial Locality on An Evolutionary Algorithm for Multimodal Optimization EvoNum 2010 Ka-Chun Wong, Kwong-Sak Leung, and Man-Hon Wong Department.
Unsupervised Mining of Statistical Temporal Structures in Video Liu ze yuan May 15,2011.
主講者 : 陳建齊. Outline & Content 1. Introduction 2. Thresholding 3. Edge-based segmentation 4. Region-based segmentation 5. conclusion 2.
Digital Image Processing
Medical Image Analysis Image Segmentation Figures come from the textbook: Medical Image Analysis, by Atam P. Dhawan, IEEE Press, 2003.
Faculty of Information Engineering, Shenzhen University Liao Huilian SZU TI-DSPs LAB Aug 27, 2007 Optimizer based on particle swarm optimization and LBG.
Convolutional Restricted Boltzmann Machines for Feature Learning Mohammad Norouzi Advisor: Dr. Greg Mori Simon Fraser University 27 Nov
Application of the GA-PSO with the Fuzzy controller to the robot soccer Department of Electrical Engineering, Southern Taiwan University, Tainan, R.O.C.
Multilevel thresholding by fast PNN based algorithm UNIVERSITY OF JOENSUU DEPARTMENT OF COMPUTER SCIENCE FINLAND Olli Virmajoki and Pasi Fränti.
Non-parametric Methods for Clustering Continuous and Categorical Data Steven X. Wang Dept. of Math. and Stat. York University May 13, 2010.
Color Image Segmentation Mentor : Dr. Rajeev Srivastava Students: Achit Kumar Ojha Aseem Kumar Akshay Tyagi.
Genetic Algorithms for clustering problem Pasi Fränti
Surface Defect Inspection: an Artificial Immune Approach Dr. Hong Zheng and Dr. Saeid Nahavandi School of Engineering and Technology.
EVOLUTIONARY SYSTEMS AND GENETIC ALGORITHMS NAME: AKSHITKUMAR PATEL STUDENT ID: GRAD POSITION PAPER.
Grid-Based Genetic Algorithm Approach to Colour Image Segmentation Marco Gallotta Keri Woods Supervised by Audrey Mbogho.
An Evolutionary Algorithm for Neural Network Learning using Direct Encoding Paul Batchis Department of Computer Science Rutgers University.
南台科技大學 資訊工程系 Region partition and feature matching based color recognition of tongue image 指導教授:李育強 報告者 :楊智雁 日期 : 2010/04/19 Pattern Recognition Letters,
A Document-Level Sentiment Analysis Approach Using Artificial Neural Network and Sentiment Lexicons Yan Zhu.
Genetic Algorithm. Outline Motivation Genetic algorithms An illustrative example Hypothesis space search.
Computer Vision Lecture 12: Image Segmentation II
Deep Learning Hierarchical Representations for Image Steganalysis
Dr Arfan Jaffar Genetic Algorithm and SOM based Fuzzy Hybrid Intelligent Method for Color Image Segmentation Research Seminar.
Density-Based Image Vector Quantization Using a Genetic Algorithm
Introduction to Genetic Algorithm and Some Experience Sharing
A Block Based MAP Segmentation for Image Compression
Presentation transcript:

Hierarchical Distributed Genetic Algorithm for Image Segmentation Hanchuan Peng, Fuhui Long*, Zheru Chi, and Wanshi Siu {fhlong, phc, Center for Multimedia Signal Processing, Department of Electronic & Information Engineering, The Hong Kong Polytechnic University, Hong Kong

Abstract A new Hierarchical Distributed Genetic Algorithm (HDGA) is proposed for image segmentation. Histogram dichotomy: to explore the statistical property of input image and produce a hierarchically quantized image. HDGA is imposed on the quantized image to explore the spatial connectivity and produce final segmentation result. HDGA is a major improvement of the original Distributed Genetic Algorithm (DGA) and Multiscale Distributed Genetic Algorithm (MDGA): A priori assumption Chromosome structure Fitness function Genetic operations Our experiments prove the advantages of HDGA.

Outline Introduction Details of HDGA Experimental Results Discussion & Conclusion

Introduction: Paradigms for Image Segmentation A lot of existing algorithms for image segmentation. Gray-level thresholding of local/global/deterministic/fuzzy/stochastic schemes Iterative pixel classification (including deterministic and stochastic relaxation) Parameter space clustering (including probabilistic and fuzzy clustering) Surface fitting, surface classification and surface/region growing Edge detection Statistical models (including Markov Random Field (MRF), Gibbs random field, etc) Neural networks Genetic Algorithm (GA)

Introduction: Genetic Algorithms for Image Segmentation Haseyama ’ s GA: Minimizing an MSE function for segmentation Bhanu ’ s GA: Hybrid model and parameter optimization Bhandarkar ’ s GA: Region adjacency graph generation & cost function minimization Kim ’ s hybrid model of GA & MRF Horita ’ s GA: Region segmentation of K-mean clustering Scheunders ’ s genetic Lloyd-Max Quantizer (LMQ) Andrey ’ s "distributed" GA based on classifier system Long ’ s multilevel distributed genetic algorithm ……

Introduction: Genetic Approaches for Image Segmentation Use GA as an alternative optimization method of traditional image segmentation techniques. Use GA to remove the sensitivity of the present image segmentation techniques to the initial conditions. Use GA in a more novel and promising way, which codes the segmentation process model itself, instead of the model parameters. Based on existing segmentation techniques New approach!

Introduction: DGA (Distributed Genetic Algorithm) DGA is novel because it is not based on existing segmentation techniques distributed GA classifier system “ Distributed ” : the genetic operations, i.e. selection, crossover, mutation, are performed on locally distributed subgroups of chromosomes, but not globally on all chromosomes in the whole population. Classifier system: a set of symbolic production rules. A classifier is a condition/action rule. It exchanges message with environment through detectors and effectors.

Introduction: DGA – Paradigm Image segmentation: a function that takes an image as input and a labeled image as output. The function is represented by classifier system, which consists of a set of spatially organized binary- coded production rules imposed on each pixel. By iteratively modifying the production rules using a distributed genetic algorithm, the rule set encoding the possibly best segmentation can be obtained.

Introduction: DGA – Main Problems predefine region numbers on the feature histogram unreasonable initialization scheme of chromosome population redundant and inefficient condition- action chromosome structure

Details of HDGA: HDGA – A Major Improvement of DGA a new unsupervised image segmentation method based on: hierarchical adaptive thresholding (HAT) distributed GA

Details of HDGA: Paradigm of HDGA

Details of HDGA: Role of HAT HAT explores the statistical property of the input image provide a reasonable initialization for GA operations progressive segmentation

Details of HDGA: Role of Distributed GA Distributed genetic algorithm explores the spatial connectivity New chromosome structure New fitness function New genetic operations

Details of HDGA: Main Advantages of Our Model It outperforms Andrey's DGA model: adaptively and effectively controls the segmentation quality without a priori assumption of the image region number; produce regions with high homogeneity, high contrast, low noise, and accurate boundaries; more efficient in both computation and storage.

The image feature histogram is repeatedly dichotomized into hierarchical continuous intervals until each of the intervals has a pixel-by-pixel MSE less than a given positive threshold T MSE We can prove: the sum of the pixel variances on all intervals in a higher level is always smaller than that in the lower level --- progressive segmentation Details of HDGA: Paradigm of HAT

Details of HDGA: HAT based Initialization GA initialization in Andrey’s modelGA initialization in our model

Details of HDGA: Distributed GA-based Segmentation 1. HAT based initialization- DLI 2. Evaluation by Fitness Function 3. Genetic Operations 3.1 Selection--- select the c p,q with the largest fitness f p,q in  m,n 3.2 Crossover-- produce new offspring 3.3 Mutation – replace c m,n with any chromosome in the whole population randomly according to probability r m 4. Repeat 2, 3 until stop criterion is satisfied

Standard Images in Experiments

Non-standard Image Samples

Level 1Level 2 Level 3Level 4 Progressive Segmentation on Different Levels for "bird"

Segmentation: HDGA vs DGA for “ bird ” HDGA DGA

Segmentation: HDGA vs DGA for “ lena ” HDGA DGA

HDGA DGA Segmentation: HDGA vs DGA for “ peppers ”

Quantitative Evaluation Region Homogeneity – H Region Contrast – C Region boundary accuracy – r A Number of regions – N R Speed –convergence speed –computational complexity Storage complexity Note: For 1,2,3, the larger the better; For 4,5,6, the smaller the better.

Region Contrast where Region Homogeneity where Region Boundary Accuracy

Region homogeneity (  10 6 ) in HDGA vs DGA

Region Contrast of HDGA vs DGA

Region Boundary Accuracies of HDGA vs DGA

Segmentation Region Numbers of HDGA vs DGA

Average Convergence Speeds of HDGA vs DGA

Computational Speeds of HDGA vs DGA

1.HAT explores the statistical property of the input image provide a reasonable initialization for GA operations progressive segmentation 2.Distributed genetic algorithm explores the spatial connectivity new chromosome structure, fitness function, genetic operations 3.Our new model outperforms Andrey et al's DGA model adaptively and effectively controls the segmentation quality without a priori assumption of the image region number; produce regions with high homogeneity, high contrast, low noise, and accurate boundaries; more efficient in both computation and storage. Conclusions