Introduction The Berkeley Drosophila Transcription Network Project is developing a suite of methods to convert image stacks generated by confocal microscopy.

Slides:



Advertisements
Similar presentations
Shape Matching and Object Recognition using Low Distortion Correspondence Alexander C. Berg, Tamara L. Berg, Jitendra Malik U.C. Berkeley.
Advertisements

Medical Image Registration Kumar Rajamani. Registration Spatial transform that maps points from one image to corresponding points in another image.
Hongliang Li, Senior Member, IEEE, Linfeng Xu, Member, IEEE, and Guanghui Liu Face Hallucination via Similarity Constraints.
Inferring regulatory networks from spatial and temporal gene expression patterns Y. Fomekong Nanfack¹, Boaz Leskes¹, Jaap Kaandorp¹ and Joke Blom² ¹) Section.
Applications of Visualization and Data Clustering to 3D Gene Expression Data Oliver Rübel 1,2,3,7, Gunther H. Weber 3,7, Min-Yu Huang 1,7, E. Wes Bethel.
Chapter 6 Feature-based alignment Advanced Computer Vision.
A Geometric Database for Gene Expression Data Baylor College of Medicine Gregor Eichele Christina Thaller Wah Chiu James Carson Rice University Tao Ju.
Uncertainty Representation. Gaussian Distribution variance Standard deviation.
On Constrained Optimization Approach To Object Segmentation Chia Han, Xun Wang, Feng Gao, Zhigang Peng, Xiaokun Li, Lei He, William Wee Artificial Intelligence.
Instructor: Mircea Nicolescu Lecture 13 CS 485 / 685 Computer Vision.
Computer Vision Group University of California Berkeley Estimating Human Body Configurations using Shape Context Matching Greg Mori and Jitendra Malik.
Computer Vision Group University of California Berkeley Shape Matching and Object Recognition using Shape Contexts Jitendra Malik U.C. Berkeley (joint.
Extraction and comparison of gene expression patterns from 2D RNA in situ hybridization images BIOINFORMATICS Gene expression Vol. 26, no. 6, 2010, pages.
A Study of Approaches for Object Recognition
Computing correspondences in order to study spatial and temporal patterns of gene expression Charless Fowlkes UC Berkeley, Computer Science.
Finding and exploiting correspondences in Drosophila embryos Charless Fowlkes and Jitendra Malik UC Berkeley Computer Science.
Correspondence & Symmetry
E.G.M. PetrakisTexture1 Repeative patterns of local variations of intensity on a surface –texture pattern: texel Texels: similar shape, intensity distribution.
CS292 Computational Vision and Language Visual Features - Colour and Texture.
Preprocessing II: Between Subjects John Ashburner Wellcome Trust Centre for Neuroimaging, 12 Queen Square, London, UK.
B 5:0-3% 5:9-25% 5:51-75% Introduction The Berkeley Drosophila Transcription Network Project (BDTNP) is a multidisciplinary collaboration studying the.
A New Correspondence Algorithm Jitendra Malik Computer Science Division University of California, Berkeley Joint work with Serge Belongie, Jan Puzicha,
An Integrated Pose and Correspondence Approach to Image Matching Anand Rangarajan Image Processing and Analysis Group Departments of Electrical Engineering.
Face Recognition Using Neural Networks Presented By: Hadis Mohseni Leila Taghavi Atefeh Mirsafian.
Microarray Gene Expression Data Analysis A.Venkatesh CBBL Functional Genomics Chapter: 07.
Introduction --Classification Shape ContourRegion Structural Syntactic Graph Tree Model-driven Data-driven Perimeter Compactness Eccentricity.
ABSTRACT To fully understand and be able to computationally model the spatial complexity of developmental regulatory networks, it is critical to measure.
Exploratory Data Analysis. Computing Science, University of Aberdeen2 Introduction Applying data mining (InfoVis as well) techniques requires gaining.
ABSTRACT To fully understand and be able to computationally model the spatial complexity of developmental regulatory networks, it is critical to measure.
ALIGNMENT OF 3D ARTICULATE SHAPES. Articulated registration Input: Two or more 3d point clouds (possibly with connectivity information) of an articulated.
Texture. Texture is an innate property of all surfaces (clouds, trees, bricks, hair etc…). It refers to visual patterns of homogeneity and does not result.
Time Series Data Analysis - I Yaji Sripada. Dept. of Computing Science, University of Aberdeen2 In this lecture you learn What are Time Series? How to.
Detecting Curved Symmetric Parts using a Deformable Disc Model Tom Sie Ho Lee, University of Toronto Sanja Fidler, TTI Chicago Sven Dickinson, University.
Image Registration as an Optimization Problem. Overlaying two or more images of the same scene Image Registration.
Discovering Deformable Motifs in Time Series Data Jin Chen CSE Fall 1.
Spatio-Temporal Free-Form Registration of Cardiac MR Image Sequences Antonios Perperidis s /02/2006.
Stage 5:0-3% t5:4-8% t5:9-25% t5:26-50% t5:51-75% t5:76-100%. BDTNP data >6800 PointClouds for stages 4 and 5 ~3.5 Tb raw image data ~6.8 Gb stage 4 and.
A Unified Feature Registration Framework for Brain Anatomical Alignment Haili Chui, Robert Schultz, Lawrence Win, James Duncan and Anand Rangarajan* Image.
CSE 185 Introduction to Computer Vision Feature Matching.
Evaluation of gene-expression clustering via mutual information distance measure Ido Priness, Oded Maimon and Irad Ben-Gal BMC Bioinformatics, 2007.
Colour and Texture. Extract 3-D information Using Vision Extract 3-D information for performing certain tasks such as manipulation, navigation, and recognition.
Course14 Dynamic Vision. Biological vision can cope with changing world Moving and changing objects Change illumination Change View-point.
MDL Principle Applied to Dendrites and Spines Extraction in 3D Confocal Images 1. Introduction: Important aspects of cognitive function are correlated.
A morphogenic framework for analyzing gene expression in Drosophila melanogaster blastoderms. Soile V.E. Keränen 1, Cris L. Luengo Hendriks 1, Charless.
Image registration aligns the common features of two images. The open-source Insight Toolkit (ITK, funded by the National Library of Medicine) provides.
Quantitative Analysis of Mitochondrial Tubulation Using 3D Imaging Saritha Dwarakapuram*, Badrinath Roysam*, Gang Lin*, Kasturi Mitra§ Department of Electrical.
Date of download: 5/28/2016 Copyright © 2016 SPIE. All rights reserved. Schematic representation of the benchtop microsurgery microscope system for combined.
CSCI 631 – Foundations of Computer Vision March 15, 2016 Ashwini Imran Image Stitching.
A 2D/3D correspondence building method for reconstruction of a 3D bone surface model Longwei Fang
Deformation Modeling for Robust 3D Face Matching Xioguang Lu and Anil K. Jain Dept. of Computer Science & Engineering Michigan State University.
CSCI 631 – Foundations of Computer Vision March 15, 2016 Ashwini Imran Image Stitching Link: singhashwini.mesinghashwini.me.
Pathology Spatial Analysis February 2017
We propose a method which can be used to reduce high dimensional data sets into simplicial complexes with far fewer points which can capture topological.
Computer Vision, Robotics, Machine Learning and Control Lab
Paper Presentation: Shape and Matching
Shape matching and object recognition using shape contexts
CSE 554 Lecture 10: Extrinsic Deformations
Image Registration 박성진.
Imaging in Systems Biology
Group 9 – Data Mining: Data
CSE 185 Introduction to Computer Vision
Volume 133, Issue 2, Pages (April 2008)
Natalie Elia, Carolyn Ott, Jennifer Lippincott-Schwartz  Cell 
Stefano De Renzis, J. Yu, R. Zinzen, Eric Wieschaus  Developmental Cell 
Numerical analysis of cell morphology of tapetal cells in wild type.
Variation in the Dorsal Gradient Distribution Is a Source for Modified Scaling of Germ Layers in Drosophila  Juan Sebastian Chahda, Rui Sousa-Neves, Claudia Mieko.
Shadow Enhancers Foster Robustness of Drosophila Gastrulation
Probing the Limits to Positional Information
Spatial Regulation of Developmental Signaling by a Serpin
Enhancer Control of Transcriptional Bursting
Presentation transcript:

Introduction The Berkeley Drosophila Transcription Network Project is developing a suite of methods to convert image stacks generated by confocal microscopy into numerical representations of gene expression at cellular resolution. One key difficulty is that fluorescence microscopy can only capture expression levels for a few (2-4) gene products in a given animal. Here we report on a method for registering 3D expression data from different Drosophila embryos stained for overlapping subsets of target genes in order to build a composite atlas, ultimately containing collocation information for 1000’s of genes. Registration is also shown to be a useful tool in studying morphology. We observe complex, dynamic patterns of cell density during cellular blastoderm prior to gastrulation. Application: Building a 3D Atlas of Gene Expression In order to build models of transcription networks in developing embryos, we need to measure the spatial co-expression of active genes. If we treat each image separately, then for N genes it is necessary to perform O(N 2 ) hybridizations, one for each pair. Registration allows us to construct a complete picture with only O(N) hybridizations, one for each gene paired with a reference gene. This makes it feasible to aim for large scale models of 1000s of genes which would otherwise require millions of hybridizations. Here we show an initial composite atlas built from 150 images of 14 different genes. Charless C. Fowlkes 1, C.L. Luengo Hendriks 2, S.V.E. Keränen 2, M.D. Biggin 2, DW Knowles 2, D. Sudar 2, and J. Malik 1 1)Computer Science Division, University of California, Berkeley, CA 2)Life Sciences and Genomics Divisions, Lawrence Berkeley National Laboratory Building Composite Maps of Gene Expression Patterns and Morphology: Registering 3D Representations of Drosophila Embryos Registering 3D Blastoderm Models Application: Pre-gastrulation Dynamics of Cell Density Registration is also useful in the quantitative study of embryo morphology. Just as we can use reference gene correspondence to average fluorescence measurements, we can also average morphological measurements, in this case the density of cell packing. Here we find a complex dynamic pattern which wouldn’t have been apparent in casual visual inspection of the raw data. Of interest is the steep density gradient on either side of the collection of cells that will soon collapse into the ventral furrow. ftz eve snail kni hb id, x, y, z, Vn, Vc, Sytox, Cy3_n,… 1, , , , , , 52.18, 23.55,… 2, , , 79.36, , , 82.12, 31.67,… 3, , , 88.65, , , 85.32, 35.63,…... 2-photon fluorescent confocal microscopy (20x lens) captures the entire embryo (~500µm by 200µm) at high enough resolution to distinguish individual nuclei (voxel size 0.45x0.45x1.5µm) Each confocal image stack is segmented into cellular volumes with the help of a nuclear stain and the fluorescence level is quantified in each volume (see poster 358A by C.L. Luengo Hendriks et al). The resulting pointcloud contains position, volumes and expression levels associated with each detected nucleus in the blastoderm. Nuclear segmentation Geometric modeling & Feature extraction Geometric modeling recovers neighborhood relationships between cells, capturing the blastoderm topology. Distinctive local patterns of gene expression around each cell provide features that drive the correspondence process. To combine expression data from two or more embryos, it is necessary to identify corresponding cells in each embryo. This is accomplished by registering each embryo onto a composite map where multiple expression measurements can be meaningfully averaged. Registration onto composite map The figure at right demonstrates the utility of registering multiple embryos. Each square shows the joint distribution of the expression levels for a pair of genes. For example, ftz and eve are expressed in a disjoint set of cells so the distribution shows anti-correlation. In contrast, sna and twi show strong co-expression Correspondence as Optimization Xij = 1 if cell i is matched to cell j 0 otherwise Cij = dissimilarity of local descriptors for cells i and j Dij = distance between cells i and j minimize : Σ ij (Cij + λDij) Xij subject to : Σ i Xij = 1 Σ j Xij = 1 λ sets the relative importance of distance versus descriptor similarity Registration Algorithm 1.Perform coarse registration 2.Extract shape-context descriptor 3.Find corresponding cells 4.Warp embryo model to align with corresponding cells on target model 5.Repeat 3-4 until convergence A Non-linear Deformation Model Once the initial correspondence has been computed we would like to find a global deformation that brings the matched cells into alignment. We fit a regularized thin-plate spline to model the deformation between embryos. The thin plate spline is the higher dimensional generalization of the cubic spline. The smoothness of the spline fit is governed by a regularization term. We start with a high degree of regularization, enforcing nearly rigid transformations and gradually relax this constraint over the course of several iterations. Local Descriptors of Expression Patterns For each cell we compute a descriptor which captures the local pattern of gene expression. The descriptor, called a shape context, integrates expression levels over bins arranged in a polar fashion around the given cell. Bins far from the cell of interest integrate over a larger area and are less sensitive to variations in the shape of expression patterns. Single embryo co-expression Composite model co-expression The lower triangle shows the statistics measured for single embryo pointclouds. The upper triangle is generated by registering these same embryos onto the composite atlas, allowing us to fill in statistics for gene pairs which were not originally imaged. ftz eve The figures at right show the local nuclear density in an cylindrical (mercator) projection. This is a convenient way to display the entire embryo at once. Densities were averaged inside a moving window whose radius was ~5 times the average inter-nuclear distance. The title on each figure indicates the temporal staging and number of embryos in each cohort. Staging is quantified by the degree to which cellularization has progressed (e.g % cell wall invagination). Embryos showing any signs of gastrulation were excluded from consideration nuclei / μm 2 Four different views of a three dimensional gene expression atlas containing 14 genes. [Numbers] indicate how many embryos were included in the average for that gene. Averaging over multiple embryos drives down measurement noise kni [14]kr [2]rho [45]slp1 [17]tll [2]sna [36]fkh [8]gnt [7]trn [1]eve [81]hb [7]ftz [81]