Multiscale Feature Identification in the Solar Atmosphere

Slides:



Advertisements
Similar presentations
Scale & Affine Invariant Interest Point Detectors Mikolajczyk & Schmid presented by Dustin Lennon.
Advertisements

OpenCV Introduction Hang Xiao Oct 26, History  1999 Jan : lanched by Intel, real time machine vision library for UI, optimized code for intel 
Aggregating local image descriptors into compact codes
Solar Image Processing: A Multiscale View C. Alex Young NASA/GSFC C. Alex Young NASA/GSFC UCLA - IPAM (January 28, 2004)
Learning to estimate human pose with data driven belief propagation Gang Hua, Ming-Hsuan Yang, Ying Wu CVPR 05.
Edge detection Goal: Identify sudden changes (discontinuities) in an image Intuitively, most semantic and shape information from the image can be encoded.
SURF: Speeded-Up Robust Features
Boundary matting for view synthesis Samuel W. Hasinoff Sing Bing Kang Richard Szeliski Computer Vision and Image Understanding 103 (2006) 22–32.
Targil 2 Image enhancement and edge detection. For both we will use image derivatives.
Mean-Shift Algorithm and Its Application Bohyung Han
Announcements Mailing list: –you should have received messages Project 1 out today (due in two weeks)
Automatic Image Alignment (feature-based) : Computational Photography Alexei Efros, CMU, Fall 2005 with a lot of slides stolen from Steve Seitz and.
Edge Detection Today’s reading Forsyth, chapters 8, 15.1
Segmentation (Section 10.2)
Edge Detection Today’s readings Cipolla and Gee –supplemental: Forsyth, chapter 9Forsyth Watt, From Sandlot ScienceSandlot Science.
Introduction to Object Tracking Presented by Youyou Wang CS643 Texas A&M University.
CS4670: Computer Vision Kavita Bala Lecture 7: Harris Corner Detection.
Multiscale transforms : wavelets, ridgelets, curvelets, etc.
DIGITAL SIGNAL PROCESSING IN ANALYSIS OF BIOMEDICAL IMAGES Prof. Aleš Procházka Institute of Chemical Technology in Prague Department of Computing and.
IIS for Image Processing Michael J. Watts
Edge Detection Today’s reading Cipolla & Gee on edge detection (available online)Cipolla & Gee on edge detection Szeliski, Ch 4.1.2, From Sandlot.
Phase Congruency Detects Corners and Edges Peter Kovesi School of Computer Science & Software Engineering The University of Western Australia.
The Wavelet Packets Equalization Technique: Applications on LASCO Images M.Mierla, R. Schwenn, G. Stenborg.
The Extraction and Classification of Craquelure for Geographical and Conditional Based Analysis of Pictorial Art Mouhanned El-Youssef, Spike Bucklow, Roman.
Edge detection Goal: Identify sudden changes (discontinuities) in an image Intuitively, most semantic and shape information from the image can be encoded.
Expectation-Maximization (EM) Case Studies
Histograms of Oriented Gradients for Human Detection(HOG)
Edge Detection and Geometric Primitive Extraction Jinxiang Chai.
MIT AI Lab / LIDS Laboatory for Information and Decision Systems & Artificial Intelligence Laboratory Massachusetts Institute of Technology A Unified Multiresolution.
Machine Vision Edge Detection Techniques ENT 273 Lecture 6 Hema C.R.
Computer vision. Applications and Algorithms in CV Tutorial 3: Multi scale signal representation Pyramids DFT - Discrete Fourier transform.
Edge Segmentation in Computer Images CSE350/ Sep 03.
Introduction to Scale Space and Deep Structure. Importance of Scale Painting by Dali Objects exist at certain ranges of scale. It is not known a priory.
Instructor: Mircea Nicolescu Lecture 7
Chapter 24: Perception April 20, Introduction Emphasis on vision Feature extraction approach Model-based approach –S stimulus –W world –f,
Digital Image Processing CSC331
Announcements Final is Thursday, March 18, 10:30-12:20 –MGH 287 Sample final out today.
CSC321: Introduction to Neural Networks and Machine Learning Lecture 17: Boltzmann Machines as Probabilistic Models Geoffrey Hinton.
1 Shape Descriptors for Maximally Stable Extremal Regions Per-Erik Forss´en and David G. Lowe Department of Computer Science University of British Columbia.
Motion tracking TEAM D, Project 11: Laura Gui - Timisoara Calin Garboni - Timisoara Peter Horvath - Szeged Peter Kovacs - Debrecen.
CSCI 631 – Foundations of Computer Vision March 15, 2016 Ashwini Imran Image Stitching Link: singhashwini.mesinghashwini.me.
Edge Detection slides taken and adapted from public websites:
CS262: Computer Vision Lect 06: Face Detection
- photometric aspects of image formation gray level images
CS 4501: Introduction to Computer Vision Sparse Feature Detectors: Harris Corner, Difference of Gaussian Connelly Barnes Slides from Jason Lawrence, Fei.
CSC321: Neural Networks Lecture 19: Boltzmann Machines as Probabilistic Models Geoffrey Hinton.
IIS for Image Processing
Nonparametric Semantic Segmentation
Edge Detection CS 678 Spring 2018.
Graduate School of Information Sciences, Tohoku University
Jeremy Bolton, PhD Assistant Teaching Professor
Edge detection Goal: Identify sudden changes (discontinuities) in an image Intuitively, most semantic and shape information from the image can be encoded.
Contourlet Transforms For Feature Detection
Outline Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, “Gradient-based learning applied to document recognition,” Proceedings of the IEEE, vol. 86, no.
Outline S. C. Zhu, X. Liu, and Y. Wu, “Exploring Texture Ensembles by Efficient Markov Chain Monte Carlo”, IEEE Transactions On Pattern Analysis And Machine.
Introduction Computer vision is the analysis of digital images
A Similarity Retrieval System for Multimodal Functional Brain Images
a kind of filtering that leads to useful features
CS Digital Image Processing Lecture 5
a kind of filtering that leads to useful features
Edge Detection Today’s reading
Expectation-Maximization & Belief Propagation
Edge Detection Today’s reading
Introduction to Object Tracking
Edge Detection Today’s readings Cipolla and Gee Watt,
Introduction Computer vision is the analysis of digital images
Lecture 5: Feature invariance
Filtering An image as a function Digital vs. continuous images
Review and Importance CS 111.
DIGITAL IMAGE PROCESSING Elective 3 (5th Sem.)
Presentation transcript:

Multiscale Feature Identification in the Solar Atmosphere C. Alex Young, Dawn C. Myers, Peter T. Gallagher (L-3 Communications GIS) SIRW at the ROB - Oct. 23-24, 2003

General Outline Motivation An Aside An event and a standard approach A Multiscale approach Some natural extensions - Beamlets, Ridgelets, Curvelets, and all that - Morphological Component Analysis.

Motivation To model a subjective feature detection method (an observer with a computer mouse, i.e. the point-and-click detector) with an objective detection method using a multiscale vision model. Try to track edges over multiple scales or resolutions using a wavelet based multiscale edge detector. This will then give us consistent, reproducible, and statistical features.

The Solar Physics Community has only scratched the surface. Tracking features with a mouse and a pen is only a start not science. We need to develop an image processing tree in solarsoft. Morphological transforms and wavelets are not cutting edge, they are simply a starting point and part of a basic toolset.

General Multiscale Transforms Neural Networks Support Vector Machines Markov Chain Monte Carlo Imaging Texture Modeling Multiscale Likelihood / Posterior Methods Non-linear filtering Maximum Entropy Information Theory Approach (Shannon Information)

The Event - April 21, 2002

Images at the time of the first brightening in the TRACE movie Images at the time of the first brightening in the TRACE movie. (Gallagher 2003) Top panels: TRACE 195 Å difference images created by subtracting each image from a frame taken at 00:42:30 UT. Bottom panels: LASCO C2 and C3 images showing the similar morphology of the eruption as it propagates away from the solar surface. (Gallagher 2003)

A Standard Analysis

Can we use a vision model to remove some of the subjectivity Can we use a vision model to remove some of the subjectivity? Say multiscale edges.

The Method A multiscale version of an edge detector is implemented by smoothing with dilated kernels θ. These kernels are B3 cubic splines which approximates a Gaussian. The detector is computed with two wavelets that are the first partial derivative of θ. The wavelet transform components are proportional to the gradient vector smoothed by θ. So the wavelet transform maxima at each scale size give us multiscale edges corresponding to curves of structure at a particular scale.

Wavelets and multiscale edges for 4 scales TRACE 195 Å image at 00:58:58 UT scale = 2 scale = 4 scale = 8 scale = 16

A set of edges from 00:46:34 UT to 01:01:58 UT at 2 scales The top image shows the 30 multiscale edges at scale 8 (green) and 16 (red) over the image at 00:46:34 UT. The bottom images zoom in on the fronts.

Following a front in TRACE.

The event in C2

At a fine and medium scale (no background model)

C2 edges for one scale size

Beamlets, Ridgelets, Curvelets and all that Wavelets are generally isotropic and best suited for representing point structures. If we extend the multiscale model from points to lines, curves and the like we can obtain a near optical representation. Combining different multiscale morphologies gives us Morphological Component Analysis

Beamlet (multiscale line-segments)

Ridgelet (wavelets in Radon space)

Curvelet (multiscale curves)

XMM image

Morphological Component Analysis à trous wavelet encoding ridgelet encoding

HST image of A370 ridgelet/curvelet encoding à trous wavelet encoding sum of all three

Conclusions The toolset for solar image processing needs to be made available to the community. (image processing branch in SSW - see Peter Gallagher) Wavelet based transforms provide a robust representation of many structures in solar images. The natural extension wavelet transforms is a general multiscale morphological method. Apply machine learning, probabilistic methodologies etc. to the represented structures.