Research Methods Festival 2006 What is MDS? Prof APM Coxon, U Edinburgh 1 What is Multidimensional Scaling [MDS] ? Tony Macmillan Coxon –Honorary Professorial.

Slides:



Advertisements
Similar presentations
What is Multidimensional Scaling [MDS] ?
Advertisements

Interpreting Data for use in Charts and Graphs.
Computing in Archaeology Session 12. Multivariate statistics © Richard Haddlesey
What we Measure vs. What we Want to Know
MDS- why not? 1 ESRC Research Methods Festival July 2004 SESSION: New Directions in Multidimensional Analysis Tony Macmillan Coxon, University of Edinburgh.
ENV Envisioning Information Lecture 4 – Multivariate Data Exploration Glyphs and other methods Hierarchical approaches Ken Brodlie.
Dr. Engr. Sami ur Rahman Data Analysis Lecture 6: SPSS.
Copyright Jiawei Han, modified by Charles Ling for CS411a
VORTEX Version Software Application Sociology; Marketing research; Social-psychological research Social-medical research Staff recruitment, staff.
Eigen Decomposition and Singular Value Decomposition
Analysis of High-Throughput Screening Data C371 Fall 2004.
Psychology Practical (Year 2) PS2001 Correlation and other topics.
DETC ASME Computers and Information in Engineering Conference ONE AND TWO DIMENSIONAL DATA ANALYSIS USING BEZIER FUNCTIONS P.Venkataraman Rochester.
Eigen Decomposition and Singular Value Decomposition
UNIT-2 Data Preprocessing LectureTopic ********************************************** Lecture-13Why preprocess the data? Lecture-14Data cleaning Lecture-15Data.
Design of Experiments Lecture I
Self-Organizing Maps Projection of p dimensional observations to a two (or one) dimensional grid space Constraint version of K-means clustering –Prototypes.
Advanced Methods and Analysis for the Learning and Social Sciences PSY505 Spring term, 2012 March 12, 2012.
An Introduction to Multivariate Analysis
1 Optimizing Subjective Results Julia C. O'Neill Karl R. Wursthorn Rohm and Haas Company ASA/ASQ Fall Technical Conference October 18, 2002.
CLUSTERING PROXIMITY MEASURES
Dimension reduction (1)
Quick & Simple Introduction to Multidimensional Scaling Professor Tony Coxon Hon. Professorial Research Fellow, University of Edinburgh (
Non-linear Dimensionality Reduction CMPUT 466/551 Nilanjan Ray Prepared on materials from the book Non-linear dimensionality reduction By Lee and Verleysen,
Visualizing and Exploring Data Summary statistics for data (mean, median, mode, quartile, variance, skewnes) Distribution of values for single variables.
Common Factor Analysis “World View” of PC vs. CF Choosing between PC and CF PAF -- most common kind of CF Communality & Communality Estimation Common Factor.
© University of Minnesota Data Mining for the Discovery of Ocean Climate Indices 1 CSci 8980: Data Mining (Fall 2002) Vipin Kumar Army High Performance.
Dimensional reduction, PCA
Multivariate Data Analysis Chapter 10 - Multidimensional Scaling
Extending metric multidimensional scaling with Bregman divergences
The Terms that You Have to Know! Basis, Linear independent, Orthogonal Column space, Row space, Rank Linear combination Linear transformation Inner product.
Dimension reduction : PCA and Clustering Christopher Workman Center for Biological Sequence Analysis DTU.
10/17/071 Read: Ch. 15, GSF Comparing Ecological Communities Part Two: Ordination.
Chapter 11 Multiple Regression.
Atul Singh Junior Undergraduate CSE, IIT Kanpur.  Dimension reduction is a technique which is used to represent a high dimensional data in a more compact.
Multivariate Analysis Techniques
Factor Analysis Psy 524 Ainsworth.
Midterm Review. 1-Intro Data Mining vs. Statistics –Predictive v. experimental; hypotheses vs data-driven Different types of data Data Mining pitfalls.
The Tutorial of Principal Component Analysis, Hierarchical Clustering, and Multidimensional Scaling Wenshan Wang.
ROOT: A Data Mining Tool from CERN Arun Tripathi and Ravi Kumar 2008 CAS Ratemaking Seminar on Ratemaking 17 March 2008 Cambridge, Massachusetts.
© 2013 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
January 2004Professor APM Coxon1 WHAT IS NewMDSX? NewMDSX is…… A library of self-contained computer programs and utilities for multidimensional scaling.
Data Mining & Knowledge Discovery Lecture: 2 Dr. Mohammad Abu Yousuf IIT, JU.
Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology Adaptive nonlinear manifolds and their applications to pattern.
Data Reduction. 1.Overview 2.The Curse of Dimensionality 3.Data Sampling 4.Binning and Reduction of Cardinality.
Multidimensional Scaling Vuokko Vuori Based on: Data Exploration Using Self-Organizing Maps, Samuel Kaski, Ph.D. Thesis, 1997 Multivariate Statistical.
Slide 14.1 Nonmetric Scaling MathematicalMarketing Chapter 14 Nonmetric Scaling Measurement, perception and preference are the main themes of this section.
Module III Multivariate Analysis Techniques- Framework, Factor Analysis, Cluster Analysis and Conjoint Analysis Research Report.
Multidimensional Scaling and Correspondence Analysis © 2007 Prentice Hall21-1.
Multidimensional Scaling
CS685 : Special Topics in Data Mining, UKY The UNIVERSITY of KENTUCKY Dimensionality Reduction CS 685: Special Topics in Data Mining Spring 2008 Jinze.
Out of sample extension of PCA, Kernel PCA, and MDS WILSON A. FLORERO-SALINAS DAN LI MATH 285, FALL
The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL Dimensionality Reduction Part 1: Linear Methods Comp Spring 2007.
McGraw-Hill/Irwin © 2003 The McGraw-Hill Companies, Inc.,All Rights Reserved. Part Four ANALYSIS AND PRESENTATION OF DATA.
Methods of multivariate analysis Ing. Jozef Palkovič, PhD.
Non-Parametric Tests 12/1.
Motion Segmentation with Missing Data using PowerFactorization & GPCA
Even More on Dimensions
Clustering (3) Center-based algorithms Fuzzy k-means
Multidimensional Scaling and Correspondence Analysis
Multidimensional Scaling
Probabilistic Models with Latent Variables
Clustering and Multidimensional Scaling
Multivariate Statistics
Dimension reduction : PCA and Clustering
Multidimensional Scaling
Multidimensional Scaling
WHAT IS NewMDSX? NewMDSX is……
Data Pre-processing Lecture Notes for Chapter 2
Levels of Measurement Where were we: ah, yes! Representational measurement … NOW … (Numerical) Representations of a measurement structure are not *usually.
Presentation transcript:

Research Methods Festival 2006 What is MDS? Prof APM Coxon, U Edinburgh 1 What is Multidimensional Scaling [MDS] ? Tony Macmillan Coxon –Honorary Professorial Research Fellow, University of Edinburgh –Emeritus Professor of Sociological Research Methods, University of Wales –Co-founder &Co- Director of MDS software packages, MDSX [OS] (freeware)and NewMDSX for Windows (not-for-profit) Website: see my entry on multidimensional scaling in Lewis-Beck, M.S. et al, eds (2004) The Sage Encyclopaedia of Social Science Research Methods. London Sage Publications )

Research Methods Festival 2006 What is MDS? Prof APM Coxon, U Edinburgh 2 What is Multidimensional Scaling [MDS] ? A quick answer … –the most flexible, useful, user- friendly –but grossly under-used, under- taught –family of Research Methods in Social Science!

Research Methods Festival 2006 What is MDS? Prof APM Coxon, U Edinburgh 3 WHAT IS MULTIDIMENSIONAL SCALING? MDS (aka Smallest Space Analysis) –Has origins in Psychometrics in s: Analysis of similarity data as distances Scale construction and dimensionality reduction Underwent major burst of development in 1960s due to non-metric revolution(Coombs) and computing developments

Research Methods Festival 2006 What is MDS? Prof APM Coxon, U Edinburgh 4 WHAT IS MULTIDIMENSIONAL SCALING? – Given a map, its easy to calculate the distances between the points…… MDS operates the other way round: –Given the distances [data] find the [configuration] which generated them ….and can do so when all but the ordinal information has been jettisoned –(the non-metric revolution) Even when there are missing data and in the presence of considerable noise/error –(MDS is robust)

Research Methods Festival 2006 What is MDS? Prof APM Coxon, U Edinburgh 5 WHAT IS MULTIDIMENSIONAL SCALING? MDS is a family of models differentiated by … –(DATA) the empirical inter-relationships between a set of objects/variables which are given in a set of dis/similarity data –(FUNCTION) are then re-scaled (according to permissible transformations for the data level of measurement), and in terms of –(MODEL) the assumptions of the model chosen to represent the data

Research Methods Festival 2006 What is MDS? Prof APM Coxon, U Edinburgh 6 WHAT IS MULTIDIMENSIONAL SCALING? To produce a SOLUTION consisting of: –a CONFIGURATION, which is a pattern of points representing the objects located in a space of a small number of dimensions (hence SSA) where the distances (or angular separation) between the points represents the dis/similarities between the data-points as perfectly as possible (the imperfection/badness of fit is measured by Stress – No stress is perfection)

Research Methods Festival 2006 What is MDS? Prof APM Coxon, U Edinburgh 7 WHAT IS MULTIDIMENSIONAL SCALING? – MDS thus provides…. a useful and easily-assimilable graphic visualisation –Tukey: A picture is worth a thousand words and/or a graphical representation of the structure underlying a complex data set

Research Methods Festival 2006 What is MDS? Prof APM Coxon, U Edinburgh 8 VARIANTS OF MDS MODELS MDS can be used with a wide variety of DATA: –direct data (pair comparisons, ratings, rankings) –derived data (profiles, co-occurrence matrices, textual data, aggregated data) –measures of association etc derived from simpler data, and –tables of data.

Research Methods Festival 2006 What is MDS? Prof APM Coxon, U Edinburgh 9 VARIANTS OF MDS MODELS MDS can also be used with a wide variety of: Transformations (levels of measurement) monotonic (ordinal), linear/metric (interval), but also –Splines (SPSS PROXSCAL) –log-interval (MRSCAL), –Power (MULTISCALE) –smoothness (local preservation of distance) Models –chiefly distance (Euclidean, but also City-block), –Factor/vector, Composition (additive)

Research Methods Festival 2006 What is MDS? Prof APM Coxon, U Edinburgh 10 MDS PROGRAMS: Usually either General Purpose (e.g. SPSS PROXSCAL ) or specific to Data-shape, Trans & Model (e.g. NewMDSX ) –BASIC 2W1M SCALING: Non-metric (ordinal), Metric (linear, log-int) Principal Components Clustering (Hierarchical & Non-hierarchical) –2W2M (Rectangular) SCALING: Multidimensional … Preference, Sorting, Unfolding Property-fitting, Profile Analysis (continuity) Triadic MD Scaling –3W2M (and higher) Individual Differences (INDSCAL), (Tucker) Points-of-View Procrustean IndDiffs (Lingoes PINDIS) Canonical Decomposition ( 3-7 Mode) –Utilities: Comparison of configurations (by Procrustes rotation) WOMBATS (Measures & Data-manipulation)

Research Methods Festival 2006 What is MDS? Prof APM Coxon, U Edinburgh 11 SITES & SOFTWARE: SITES 1.NEWMDSX AND DOCUMENTATION: 2.INTERACTIVE PERMAP (Heady) 3.THREE-WAY SCALING (Kroonenberg) FORREST YOUNGS VISTA (Visual Statistics)

Research Methods Festival 2006 What is MDS? Prof APM Coxon, U Edinburgh 12 WHAT IS MDS? … and now for an example Perception of road accident causes by Ward Vanlaar ( Traffic Injury Research Foundation, Ottawa) & APMC An application of INDSCAL &c Other examples available at: : Molinero: Predicting Bank Failure Kendall: Maps from Marriages Coxon: Subjective Categorization of Drugs

Research Methods Festival 2006 What is MDS? Prof APM Coxon, U Edinburgh 13 WHAT IS MULTIDIMENSIONAL SCALING? APPENDIX Multidimensional Scaling … Is often subsumed with Cluster analysis & Seriation/sequencing as Combinatorial Data Analysis –(Arabie: Forms basis of Graphical Data Visualization – and Data Mining – As well as computer-assisted text-analysis – (T-LAB) – (HAMLET)

Research Methods Festival 2006 What is MDS? Prof APM Coxon, U Edinburgh 14 WHAT IS MULTIDIMENSIONAL SCALING? APPENDIX WHAT IS MULTIDIMENSIONAL SCALING? APPENDIX : Related and Special-case Models : –Metric Scalar Products SVDModels *PRINCIPAL COMPONENTS ANALYSIS FACTOR ANALYSIS (+ communalities) –Discrete Clustering *HIERARCHICAL CLUSTERING *PARTITION & ADDITIVE CLUSTERING –Tables *SIMPLE (2W2M) AND MULTIPLE (3W) CORRESPONDENCE ANALYSIS –Other *M/ANOVA & *SIMPLE COMPOSITION

Research Methods Festival 2006 What is MDS? Prof APM Coxon, U Edinburgh 15 SOME POSSIBLE WEAKNESSES in MDS There ARE any??! Relative ignorance of the sampling/inferential properties of stress But, simulation (Spence), MLE estimation Prone-ness to local minima solutions but less so, and multiple starts & interactive programs like PERMAP allow thousands of runs to check A few forms of data/models are prone to degeneracies – especially MD Unfolding, but see new PREFSCAL in SPSS14) difficulty in representing the asymmetry of causal models –though external analysis is very akin to dependent- independent modelling, –there are convergences with GLM in hybrid models such as CLASCAL (INDSCAL with parameterization of latent classes)