Laboratory for Applications of Remote Sensing Critical Class Oriented Active Learning for Hyperspectral Image Classification Hyperspectral Image Classification School of Civil Engineering, Purdue University and Laboratory for Applications of Remote Sensing 1, mcrawford 2 July 28, 2011 IEEE International Geoscience and Remote Sensing Symposium Wei Di and Melba Crawford

Outline  Background Critical Class Oriented Active Learning(AL)  Proposed Methods (SVM-CC, SVM-CC MS ) –Guided & Active Learning –Critical Class Oriented –Margin Sampling Based  Experimental Results  Conclusions & Future Work

Laboratory for Applications of Remote Sensing I. BACKGROUND

Motivation Sampling Strategy D L Pool Training Data Target H Supervised Classifier Achieve better performance Higher utility, low redundancy Economically allocate resources for labeling Focus on a specific task or requirement Intelligent sampling strategy

Active Learning Query Strategy D L Pool D U Pool Supervised Classifier ClassifierSupervised New x L Output Classifier Training xUxU f(x u ) Passive Learning Active Learning (AL) - Active Learning (AL) - Iterative learning circle Uncertainty & Critical Class

Introduction  Active Learning in remote sensing -Classification: Tuia et al. [2009], Patra and Bruzzone [2011] Demir et al. [2011], Di and Crawford [2011],. -Segmentation: Jun et al. [2010]  Critical Class oriented Active Learning - Shifting hyperplane by pair-wise SVM -Identify “Difficult” Classes -Category based query & margin sampling  Goal Provide concept level guidance for building training set favoring “difficult” classes

Laboratory for Applications of Remote Sensing II. PROPOSED METHOD

Key Idea: Shifting Hyperplane Pair-wise Class A and B Class A Class B Hyperplane w Margin Support Vectors Hyperplane Margin New Samples Cumulative Change Critical Significant Level Changing Hyperplane

Critical Class Identification  Query-based Regularizer w k - hyperplane vector by SVM for kth binary class at the  th query.  Accumulated Margin Instability  Measure the cumulative changes  Order Statistic  Rank class pairs:  Prob. of the kth class pair at critical level C L :

Critical Class Query Critical Class Set Critical Class Pair Higher probability Critical Class Identification SVM-CC SVM-CC Random Query From Critical Class Set SVM-CC MS SVM-CC MS Query Sample within Critical Class set and closest to margin Critical Class Set  Query

Laboratory for Applications of Remote Sensing III. EXPERIMENTAL RESULTS

Kennedy Space Center & Botswana Data AVIRIS hyperspectral data Acquired on March, of total 224 bands Spectral bandwidth 10nm Spatial resolution 18m Data Description KSCBOT C LASS N AME No.C LASS N AME No. 1 Scrub761Water361 2 Willow Swamp243Primary Floodplain308 3 Cabbage Palm Hammock*256Riparian*303 4 Cabbage Palm/Oak Hammock* 252Firescar335 5 Slash Pine*161Island Interior370 6 Oak / Broadleaf hammock*229Woodlands*324 7 Hardwood Swamp*105Savanna342 8 Graminoid Marsh431Short Mopane299 9 Salt Marsh419Exposed Soils Water927 * Denotes the hard classes

Experimental Results IndexClass-Pair KSC 18  (3,4)  Cabbage Palm Hammock;  Cabbage Palm/Oak Hammock 26  (4,6)  Cabbage Palm/Oak Hammock  Oak / Broadleaf hammock BOT18  (3,6)  Riparian  Woodlands Accumulated Margin Instability (AMI) 10 th 30 th AMI as learning process KSC BOT

Experimental Results DTDT KSC at 600 th queryBOT at 400 th query Class Index CCCC MS SVM MS CCCC MS SVM MS C C C C C C C C C C DTDT DUDU Learning Curve Per-Class Improvement vs RS

Experimental Results KSCC1C2C3C4C5C6C7C8C9C10 CC CC MS SVM MS RS BOTC1C2C3C4C5C6C7C8C9 CC CC MS SVM MS RS Per-Class Sampling Ratio Per-class Sampling Ratio Ratio of Support Vectors RS SVM MS CC CC MS KSC

Laboratory for Applications of Remote Sensing IV. CONCLUSIONS AND FUTURE WORK

Conclusions & Future Work  Conclusions -Shifting Hyperplane – Provides valuable information for identifying difficult classes. -Critical Class Oriented Margin Sampling – Focuses on difficult classes, as well as informative samples, improve performance in multi-class problem. -Support Vectors - Concentrate on samples likely to be support vectors.  Future work -Investigation of feature subspaces for identifying the critical classes. -Design proper sample-wise utility score to enhance the category based query.

Laboratory for Applications of Remote Sensing IV. CONCLUSIONS AND FUTURE WORK

Conclusions & Future Work  Conclusions -Shifting Hyperplane – Provides valuable information for identifying difficult classes. -Critical Class Oriented Margin Sampling – Focuses on difficult classes, as well as informative samples; improves performance in multi-class problem. -Support Vectors - Concentrate on samples likely to be support vectors.  Future work -Investigation of the feature subspace for identifying the critical classes. -Design proper sample-wise utility score to enhance the category based query.

Thanks very much!

Critical Class Identification Process Accumulative Margin Instability Critical Class Probability Heat Map

Experimental Results (a) KSC: RS (b) KSC: SVM MS (c) KSC: SVM-CC (d) KSC: SVM-CC MS Per-class Learning Performance

Experimental Results RS SVM MS SVM-CC SVM-CC MS BOT Ratio of Support Vectors