Classification and Feature Selection for Craniosynostosis Shulin Yang, Linda G. Shapiro, Michael L. Cunningham, Matthew Speltz, Su-In Lee University of.

Slides:



Advertisements
Similar presentations
Automatic Photo Pop-up Derek Hoiem Alexei A.Efros Martial Hebert Carnegie Mellon University.
Advertisements

The blue and green colors are actually the same.
Pattern Recognition and Machine Learning
Face Alignment with Part-Based Modeling
Lecture 13 – Perceptrons Machine Learning March 16, 2010.
Chapter 4: Linear Models for Classification
Cos 429: Face Detection (Part 2) Viola-Jones and AdaBoost Guest Instructor: Andras Ferencz (Your Regular Instructor: Fei-Fei Li) Thanks to Fei-Fei Li,
SOMM: Self Organizing Markov Map for Gesture Recognition Pattern Recognition 2010 Spring Seung-Hyun Lee G. Caridakis et al., Pattern Recognition, Vol.
The loss function, the normal equation,
x – independent variable (input)
Introduction to Predictive Learning
1 Learning to Detect Objects in Images via a Sparse, Part-Based Representation S. Agarwal, A. Awan and D. Roth IEEE Transactions on Pattern Analysis and.
1 Color Segmentation: Color Spaces and Illumination Mohan Sridharan University of Birmingham
Beyond bags of features: Adding spatial information Many slides adapted from Fei-Fei Li, Rob Fergus, and Antonio Torralba.
Technology Project: Shape-Based Retrieval of 3D Craniofacial Data PI: Linda Shapiro, Ph.D. Key Personnel: James Brinkley, M.D., Ph.D. Michael Cunningham,
1 Automated Feature Abstraction of the fMRI Signal using Neural Network Clustering Techniques Stefan Niculescu and Tom Mitchell Siemens Medical Solutions,
Machine Learning Usman Roshan Dept. of Computer Science NJIT.
Face Recognition Using Neural Networks Presented By: Hadis Mohseni Leila Taghavi Atefeh Mirsafian.
Face Alignment Using Cascaded Boosted Regression Active Shape Models
Machine Learning CUNY Graduate Center Lecture 3: Linear Regression.
Radial Basis Function Networks
Learning Visual Similarity Measures for Comparing Never Seen Objects By: Eric Nowark, Frederic Juric Presented by: Khoa Tran.
Thien Anh Dinh1, Tomi Silander1, Bolan Su1, Tianxia Gong
Recognizing Deformable Shapes Salvador Ruiz Correa Ph.D. Thesis, Electrical Engineering.
Recognition using Boosting Modified from various sources including
Matlab Matlab Sigmoid Sigmoid Perceptron Perceptron Linear Linear Training Training Small, Round Blue-Cell Tumor Classification Example Small, Round Blue-Cell.
3D Craniofacial Image Analysis and Retrieval Linda Shapiro* Department of Computer Science & Engineering Department of Electrical Engineering Department.
Example: line fitting. n=2 Model fitting Measure distances.
Overview of Supervised Learning Overview of Supervised Learning2 Outline Linear Regression and Nearest Neighbors method Statistical Decision.
Recognizing Deformable Shapes Salvador Ruiz Correa UW Ph.D. Graduate Researcher at Children’s Hospital.
Object Recognition in Images Slides originally created by Bernd Heisele.
Today Ensemble Methods. Recap of the course. Classifier Fusion
BAGGING ALGORITHM, ONLINE BOOSTING AND VISION Se – Hoon Park.
Recognizing Deformable Shapes Salvador Ruiz Correa (CSE/EE576 Computer Vision I)
Overview of the final test for CSC Overview PART A: 7 easy questions –You should answer 5 of them. If you answer more we will select 5 at random.
Robust Real Time Face Detection
Linear Models for Classification
Lecture 09 03/01/2012 Shai Avidan הבהרה: החומר המחייב הוא החומר הנלמד בכיתה ולא זה המופיע / לא מופיע במצגת.
Recognizing Deformable Shapes Salvador Ruiz Correa (CSE/EE576 Computer Vision I)
Technology Project: Shape-Based Retrieval of 3D Craniofacial Data PI: Linda Shapiro, Ph.D. Key Personnel: James Brinkley, M.D., Ph.D., Michael Cunningham,
Category Independent Region Proposals Ian Endres and Derek Hoiem University of Illinois at Urbana-Champaign.
Visual Computing Computer Vision 2 INFO410 & INFO350 S2 2015
Technology Project: Shape-Based Retrieval of 3D Craniofacial Data PI: Linda Shapiro, Ph.D. Key Personnel: James Brinkley, M.D., Ph.D., Michael Cunningham,
Lloyd Algorithm K-Means Clustering. Gene Expression Susumu Ohno: whole genome duplications The expression of genes can be measured over time. Identifying.
A Shape-based Image Retrieval System for Assisting Intervention Planning Jill Lin Biomedical and Health Informatics.
9.913 Pattern Recognition for Vision Class9 - Object Detection and Recognition Bernd Heisele.
Machine Learning CUNY Graduate Center Lecture 6: Linear Regression II.
Meeting 8: Features for Object Classification Ullman et al.
Shape2Pose: Human Centric Shape Analysis CMPT888 Vladimir G. Kim Siddhartha Chaudhuri Leonidas Guibas Thomas Funkhouser Stanford University Princeton University.
Machine Learning Usman Roshan Dept. of Computer Science NJIT.
Combining Models Foundations of Algorithms and Machine Learning (CS60020), IIT KGP, 2017: Indrajit Bhattacharya.
Multiple Organ detection in CT Volumes Using Random Forests
Big data classification using neural network
3D Shape Analysis for Quantification, Classification and Retrieval
Recognizing Deformable Shapes
Feature description and matching
Texture Classification of Normal Tissues in Computed Tomography
CS 2750: Machine Learning Support Vector Machines
Categorization by Learning and Combing Object Parts
Pattern Recognition and Machine Learning
Sigmoid and logistic regression
Introduction to Radial Basis Function Networks
Technology Project: Shape-Based Retrieval of 3D Craniofacial Data
Machine learning overview
Recognizing Deformable Shapes
Introduction.
Machine Learning – a Probabilistic Perspective
Graph Attention Networks
Logistic Regression Geoff Hulten.
Presentation transcript:

Classification and Feature Selection for Craniosynostosis Shulin Yang, Linda G. Shapiro, Michael L. Cunningham, Matthew Speltz, Su-In Lee University of Washington

Craniosynostosis Craniosynostosis is a common congenital condition in which one or more of the fibrous sutures in an infant’s calvaria fuse prematurely. CoronalMetopicSagittal

Goal of our Work To analyze 3D skull shapes for the purpose of medical research – Classification: which type of craniosynostosis – Region selection: which regions contribute most toward classification – Quantification: what is the degree of severity of the deformity

Related Work Previous work – Craniofacial descriptors that analyzed the shape of the mid-face and back of the head [ICIAP09] – Classification of two synostoses vs. normal using symbolic shape descriptors [ICCV05, CPCJournal06] Difference from ours – not fully automatic – doctors may not understand the methodology – focus on the whole skull

Overview of our Approach Two step approach to shape analysis – Cranial image (CI) generation A shape representation for 3D images – Shape analysis using CI Classification Localization of interest areas on skulls Quantification of craniofacial abnormalities

Cranial Image (CI) Generation Automatic system: process 3D CT images – Input: CT skull images – Output: a distance matrix – Cranial Image j N 1 2 i d(i,j) N

Landmarks

Visualization of Cranial Image Yellow represents 0 in the matrix; Blue represents 1 in the matrix 1 plane3 planes10 planes

Shape Analysis using CI Goal: classification and feature selection on CI Methodology: logistic regression model – x: features in a Cranial Image – y: classification result for a Cranial Image – w: weight assigned to each feature in a Cranial Image

Logistic Regression Find the “w” that minimize the loss function

Regularized Logistic Regression Models L 1 regularized logistic regression Fused lasso suppress the number of selected features suppress weight differences for pairs of neighboring features suppress the number of selected features

A New Form of Regularized Logistic Regression Models: cLasso cLasso – forming feature clusters – w c : weights of the cluster centers of CI features – w: residual weights of the features suppress the number of selected features suppress the number of feature clusters

Experiments Medical data: 3D CT images of children’s heads from hospitals in four different cities in the US; 70 images in total; 3 types of craniosynostosis Parameter selection: the regularization parameters were found using 10-fold cross validation on the training set

CT data

Classification Results: Error Rates Results using logistic regression only Results using four regression models

Parameter selection Misclassification rate v.s. lamda value

Visualization of Feature Selection using L 1 Regression

Visualization of Feature Selection using Fused Lasso

Quantification Use the same methodology as classification – Use the same training process – Replace the decision function: from sigmoid function to the linear combination before taking sigmoid – Function response: the severity of craniosynostosis Use different training data for each of the three craniosynostosis (coronal, metopic, sagittal)

Summary and Future Work Contributions – A fully automatic system for skull shape analysis – New form of logistic regression for feature selection and interest region localization Future work – Extension to other 3D shapes, such as facial surfaces – Landmark detection on 3D surfaces – Run studies of controls vs abnormal for each class and use results to quantify the degree of abnormality