The Cognitive Bases of Music Performance Peter Q. Pfordresher Department of Psychology Auditory Perception and Action Lab.

Slides:



Advertisements
Similar presentations
Delayed auditory feedback: a study into vocal motor patterns UCL Institute of Cognitive Neuroscience Dr Zarinah Agnew Dr Carolyn McGettigan Briony Banks.
Advertisements

"Assessing the capacities of the self-defined tone-deaf : Deconstructing a myth" John Sloboda and Karen Wise (Centre for Psychology Research: Research.
Results and Discussion Logan Pedersen & Dr. Mei-Ching Lien School of Psychological Science, College of Liberal Arts Introduction A classic finding in Psychology.
Working Memory Dr. Claudia J. Stanny EXP 4507 Memory & Cognition Spring 2009.
Musical Performance Musical performance in broad sense Children’s play songs, hymn or folk singing, dancing to music All merit investigation in own right.
Speech perception 2 Perceptual organization of speech.
A.Diederich– International University Bremen – USC – MMM – Spring Auditory scene.
E DUARDO M ERCADO III 1 & L. N EIL F RAZER 2 1 Department of Psychology, University at Buffalo, SUNY 2 School of Ocean and Earth Sciences, University of.
A.Diederich – International University Bremen – USC – MMM – Spring 2005 Development of music perception Dowling, W.J. (1999). Development of music perception.
Music Perception. Why music perception? 1. Found in all cultures - listening to music is a universal activity. 2. Interesting from a developmental point.
Module 4 Introduction to Music K-6 © 2006 Curriculum K-12 Directorate, NSW Department of Education and Training.
A Perceptual Model of Pulse Salience and Metrical Accent in Musical Rhythms Richard Parncutt Presented by Zhenyao Mo.
 The results of Experiment 2 replicated those of Experiment 1. Error rates were comparable for younger adults (2.4%) and older adults (2.1%).  Again,
Phonetic Similarity Effects in Masked Priming Marja-Liisa Mailend 1, Edwin Maas 1, & Kenneth I. Forster 2 1 Department of Speech, Language, and Hearing.
The Phase Correction Response in Sensorimotor Synchronization Bruno H. Repp Haskins Laboratories, New Haven, CT (now retired)
A.Diederich – International University Bremen – USC – MMM – Spring 2005 Rhythm and timing  Clarke, E.F. Rhythm and timing in music. In Deutsch, D. Chapter.
Pinpointing the Beat: Tapping to Expressive Performances. By S. Dixon and W. Goebl (2002). (beat tracking & auto-transcription) Emilios Cambouropoulos.
Cognitive Processes PSY 334 Chapter 3 – Attention July 8, 2003.
Detecting Prosody Improvement in Oral Rereading Minh Duong and Jack Mostow Project LISTEN Carnegie Mellon University The research.
Effects of Metrical Subdivision on Perceived Beat Rate Bruno H. Repp Haskins Laboratories, New Haven, Connecticut.
THE EFFECTS OF AGING ON DISCRETE AND CONTINUOUS MOTOR COORDINATION A. S. Bangert 1, C. M. Walsh 2,3, A. E. Boonin 1,4, E. Anderson 4, D. J. Goble 4, P.
The Influence of Musical Context on Tempo Rubato Timmers, Ashley, Desain, Heijink.
Tone and Voice: A Derivation of the Rules of Voice- Leading from Perceptual Principles DAVID HURON Music Perception 2001, 19, 1-64.
What are harmonics? Superposition of two (or more) frequencies yields a complex wave with a fundamental frequency.
Distinguishing Evidence Accumulation from Response Bias in Categorical Decision-Making Vincent P. Ferrera 1,2, Jack Grinband 1,2, Quan Xiao 1,2, Joy Hirsch.
Cross-cultural Study of Rhythm Perception and Production Makiko Sadakata & Peter Desain NICI, Radboud University Nijmegen RPPW 2005, 2-6, July.
A Time Based Approach to Musical Pattern Discovery in Polyphonic Music Tamar Berman Graduate School of Library and Information Science University of Illinois.
Review of MUSIC PERFORMANCE by Caroline Palmer Ann. Rev. Psychol. 1997, 48: Professor, Dept of Psychology Canada Research Chair Cognitive Neuropsychology.
Machine Discoveries: A few Simple, Robust Local Expression Principles Written by Gerhard Widmer presented by Siao Jer, ISE 575b, Spring 2006.
COMBINATION TONES The Science of Sound Chapter 8 MUSICAL ACOUSTICS.
Synchronization and Continuation Tapping to Complex Meters Joel S. Snyder 1, Erin E. Hannon 2, Edward W. Large 3, & Morten H. Christiansen 2 1 The Rotman.
Audio Scene Analysis and Music Cognitive Elements of Music Listening
KEY KNOWLEDGEKEY SKILLS  The principles and processes of learning as applied to the cognitive, associative and autonomous stages, including the role feedback.
Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck.
Cognitive Processes PSY 334 Chapter 3 – Attention April 14, 2003.
Adaptive Design of Speech Sound Systems Randy Diehl In collaboration with Bjőrn Lindblom, Carl Creeger, Lori Holt, and Andrew Lotto.
Methods Inhibition of Return was used as a marker of attention capture.  After attention goes to a location it is inhibited from returning later. Results.
10/13/98Acoustical Society of America1 Synchronization of musical sound and visual images: Issues of empirical and practical significance in multimedia.
Psychology of Music Learning Miksza Music and Brain Research …from Peretz & Zatorre (2005)
Hearing: auditory coding mechanisms. Harmonics/ Fundamentals ● Recall: most tones are complex tones, consisting of multiple pure tones ● The lowest frequency.
Sh s Children with CIs produce ‘s’ with a lower spectral peak than their peers with NH, but both groups of children produce ‘sh’ similarly [1]. This effect.
1 Introduction to Information Technology LECTURE 6 AUDIO AS INFORMATION IT 101 – Section 3 Spring, 2005.
A preliminary computational model of immanent accent salience in tonal music Richard Parncutt 1, Erica Bisesi 1, & Anders Friberg 2 1 University of Graz,
Listeners often move spontaneously when listening to music (Clayton, 2007). Entrainment to rhythmic stimuli (music or metronome) has been extensively studied.
Metacognition as Kludge Peter Carruthers with thanks to Logan Fletcher Maryland Metacognition Seminar, 12/9/11.
Chapter 10 Response Time and Display Rate February 3, 2004.
1 Cross-language evidence for three factors in speech perception Sandra Anacleto uOttawa.
Psychology of Music Learning Miksza MUSICAL ABILITY.
Music and the Mind Cognitive Elements of Music Listening Kevin D. Donohue Databeam Associate Professor Electrical and Computer Engineering University.
Intentional binding with a robotic hand To what extent agency is modulated by embodiment? Emilie CASPAR, Patrick HAGGARD & Axel CLEEREMANS 1- CO3-Consciousness,
Chapter 8 Action Preparation
Melodic Similarity Presenter: Greg Eustace. Overview Defining melody Introduction to melodic similarity and its applications Choosing the level of representation.
Basic cognitive processes - 1 Psych 414 Prof. Jessica Sommerville.
Acoustic Illusions & Sound Segregation Reading Assignments for Quizette 3 Chapters 10 & 11.
Signatures and Earmarks: Computer Recognition of Patterns in Music By David Cope Presented by Andy Lee.
Audio Scene Analysis and Music Cognitive Elements of Music Listening Kevin D. Donohue Databeam Professor Electrical and Computer Engineering University.
Without Words for Emotions: Is the emotional processing deficit in alexithymia caused by dissociation or suppression? Christian Sinnott & Dr. Mei-Ching.
Introduction Individuals with ASD show inhibitory control deficits that may be associated with the disabling repetitive behaviors characterizing this disorder.
Relationship between Pitch and Rhythm Perception with Tonal Sequences
Sandra J. Guzman1, Cody Elston1, Valeriy Shafiro2 & Stanley Sheft2
UNIT 3 THE CONSCIOUS SELF
Attention Components and Creative Potential: An ERP Exploration
Effects of divided attention and sensorimotor synchronization on detection of timing perturbations in auditory sequences Bruno H. Repp Haskins Laboratories,
Cold Spring Harbor Laboratory Cold Spring Harbor, NY USA
Detecting Prosody Improvement in Oral Rereading
Memory and Melodic Density : A Model for Melody Segmentation
Comparison of observed switching behavior to ideal switching performance. Comparison of observed switching behavior to ideal switching performance. Conventions.
Expectation in music 2 Day 19
Modelling the Effect of Depression on Working Memory
By Cecily flemate Freson pacific University
Presentation transcript:

The Cognitive Bases of Music Performance Peter Q. Pfordresher Department of Psychology Auditory Perception and Action Lab

Overview Memory and planning Timing in performance Feedback in performance Musical deficits: The case of “bad” singing

Memory and Planning Errors and “what’s on your mind?” Freud’s best contribution! Lashley (1951): Errors suggest hierarchical, not serial, organization

Memory and planning Serial ordering errors Target vs. intruder Target/intruder relationships Distance Direction Anticipation Perseveration Exchange Examples “But barkling water is bad for you” (intended: sparkling) Vousden et al., 2000

Memory and Planning Errors constrained by structure Remain within a melodic line (Plamer & van De Sande, 1993; Palmer, 1996) Stay within a musical phrase (P&vDs, 1995) Directional characteristics of planning Anticipations = thinking ahead More anticipations = fewer errors (e.g., Drake & Palmer, 2000; Dell et al., 1997) Faster tempo = fewer anticipations (Drake & Palmer, 2000; but not Palmer & Pfordresher, 2003)

Planning and structure Palmer & van de Sande, 1995 Errors move toward boundaries (but do not cross…)

Anticipations are GOOD (Drake & Palmer, 2000) In speech (Dell, Burger, & Svec, 1997)

Memory and Planning Planning and distance Greater distance for adults Greater distance for slower tempi The range model (Palmer & Pfordresher, 2003; Pfordresher et al., 2006). Distance results from Serial proximity Metrical similarity

The range model Event Activation Level 2 X X X X X X Level 1 X X X X X X X X X X X X Current (planned) event Metrical Grid Serial = “tapering off” from current Metrical = “up/down” pattern

Timing Maintaining regularity: Two sources of variability (Wing & Kristofferson, 1973): Expressive timing Present even in “deadpan” performances (Palmer, 1989) Associated with structure (Todd, 1985) Association with movement? (Sundberg & Verillo, 1999) Relational invariance? (e.g., Repp, 1998) Problems: Ornaments (Desain & Honig, 1994) “Swing ratios”

The Wing & Kristofferson model “Clock” variability

“Metronomic” performance? Palmer, 1989

Music and Structure (Todd, 1985) Phrase structure Predicted timing (IOI)

Music and Motion (Friberg & Sundberg, 1999) RunnersPianists (tempo) OR Pianists (IOI)

Relational invariance and generalized motor programs Rhythm at fast tempo (IOIs): | | | | Rhythm at slower tempo (IOIs): | | | | Predicting IOIs is easy: IOI i = β * x i Where β = tempo (base IOI) and x i is the ratio for each IOI β * [1.5.5], where β = 500 or 800 Tempo like a “switch” that turns up or down the IOIs

Perceptual feedback Focus mostly on auditory Altered auditory feedback What is necessary? Presence of feedback? Facilitates memory, but not necessary Absence doesn’t disrupt piano (Repp, 1999) Though more important for singing Timing of feedback? IMPORTANT Disruption varies with delay amount Probably function of rhythm

Time CDE G CDE G Actions (key press) Feedback Asynchronous Feedback (e.g., DAF) Time CDE G CDE G Actions (key press) Feedback Normal Feedback Time Actions (key press) Feedback Altered Feedback Contents CDE G EGC D

Feedback and memory Finney & Palmer (2003) Example Stimulus: Results:

Disruption from feedback absence? Piano: Repp, 1999Voice: Mürbe et al., 2003

Delayed auditory feedback % IOI difference Absolute time: Gates et al. (1974) Delay as % of IOI Relative time: Pfordresher & Benitez (2007)

Perceptual feedback Feedback contents? More complex Random pitch sequences: no disruption (Finney, 1997) Serial shifts do disrupt (Pfordresher, 2005) Even when shift is a “variation” (Pfordresher, in press) What is the role of feedback? NOT “feedback”!!! Rather, perception and action share a common “plan” (Pfordresher, 2006)

Normal Serial shift TransposedSerial shift + Transposed

A framework for auditory feedback (Pfordresher, 2006)

Musical deficits: “Bad” singing Nature of the deficit Mistuned notes May be influenced by vocal range Compress pitch intervals NOT: contour errors Sing faster than they should (Dalla Bella et al., 2007)

Bad singing and mistuning Pfordresher & Brown (2007) See also Welch (1979) (Bad singers) Vocal range

Bad singing and pitch intervals Slope =.88Slope =.69 NOTE: Both are good fits Pfordresher & Brown (2007)

“Bad” singing What causes bad singing? Still a question… Tone deafness (literally)? Congenital Amusia (Peretz et al., 2002) BUT: evidence that bad singers are good listeners (Bradshaw & McHenry, 200; Dalla Bella et al., 2007; Pfordresher & Brown, 2007) Motor control? Not likely either… How prevalent is bad singing? Probably ~10% of population Twice as prevalent as true “tone deafness”

Congenital amusia and singing Perception Hyde & Peretz, 2004 Production Ayotte, Peretz, & Hyde, 2004

Thank You Students who helped: Ohio state Danielle Brink Grant Baldwin UB Ece Yildirim Jennifer Walsh Jenny O’Sullivan UTSA Brian Benitez (MS, 2005) Erik M. Gallemore (MS, 2005) Julliann Canady Augusto Petacchi Danielle Maddock Zachary Clay Funding sources: National Science Foundation BCS BCS BCS San Antonio Life Sciences Institute Grant # UTSA Faculty Research Award, 2003 The Grammy Foundation And to many, many participants…