Prosodic marking of appositive relative clause types in spoken discourse: pragmatic and phonetic analyses of a British English corpus Cyril Auran & Rudy.

Slides:



Advertisements
Similar presentations
APPROACHES TO T&L Language
Advertisements

1 Using the HTK speech recogniser to analyse prosody in a corpus of German spoken learners English Toshifumi Oba, Eric Atwell University of Leeds, School.
Automatic Grapheme-Phoneme Conversion for Spoken British English Corpora C. AURAN, C. BOUZON & D.J. HIRST Laboratoire Parole et Langage CNRS UMR6057 Université
References: ARMSTRONG, L. & WARD, I A handbook of English intonation, Cambridge, Heffer. AURAN, C Prosodie et anaphore dans le discours en.
Anaphoric Third Person Pronouns and Prosodic Features as Markers of Cohesion in English Spoken Discourse: A Corpus Study Cyril Auran Laboratoire Parole.
Acoustic/Prosodic Features
M. A. K. Halliday Notes on transivity and theme in English (4.2 – 4.5) Part 2.
Phonetics as a scientific study of speech
Tone perception and production by Cantonese-speaking and English- speaking L2 learners of Mandarin Chinese Yen-Chen Hao Indiana University.
Tools for Speech Analysis Julia Hirschberg CS4995/6998 Thanks to Jean-Philippe Goldman, Fadi Biadsy.
Appositive Relative Clauses and their Prosodic Realization in Spoken Discourse: a Corpus Study of Phonetic Aspects in British English Cyril Auran & Rudy.
Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.
Tools for Speech Analysis Julia Hirschberg CS4995/6998 Thanks to Jean-Philippe Goldman, Fadi Biadsy.
Nuclear Accent Shape and the Perception of Prominence Rachael-Anne Knight Prosody and Pragmatics 15 th November 2003.
Mandarin Chinese Speech Recognition. Mandarin Chinese Tonal language (inflection matters!) Tonal language (inflection matters!) 1 st tone – High, constant.
Niebuhr, D‘Imperio, Gili Fivela, Cangemi 1 Are there “Shapers” and “Aligners” ? Individual differences in signalling pitch accent category.
Prosodic Signalling of (Un)Expected Information in South Swedish Gilbert Ambrazaitis Linguistics and Phonetics Centre for Languages and Literature.
Processing of large document collections Part 6 (Text summarization: discourse- based approaches) Helena Ahonen-Myka Spring 2006.
Effectiveness of spatial cues, prosody, and talker characteristics in selective attention C.J. Darwin & R.W. Hukin.
© 2004 The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Intercultural Communication in Contexts Third Edition Judith N. Martin and Thomas.
Combining Prosodic and Text Features for Segmentation of Mandarin Broadcast News Gina-Anne Levow University of Chicago SIGHAN July 25, 2004.
Spoken Language Technologies: A review of application areas and research issues Analysis and synthesis of F0 contours Agnieszka Wagner Department of Phonetics,
Comparing American and Palestinian Perceptions of Charisma Using Acoustic-Prosodic and Lexical Analysis Fadi Biadsy, Julia Hirschberg, Andrew Rosenberg,
EE2F1 Speech & Audio Technology Sept. 26, 2002 SLIDE 1 THE UNIVERSITY OF BIRMINGHAM ELECTRONIC, ELECTRICAL & COMPUTER ENGINEERING Digital Systems & Vision.
Prosodic Cues to Discourse Segment Boundaries in Human-Computer Dialogue SIGDial 2004 Gina-Anne Levow April 30, 2004.
1 Phonetics Study of the sounds of Speech Articulatory Acoustic Experimental.
Turn-taking in Mandarin Dialogue: Interactions of Tone and Intonation Gina-Anne Levow University of Chicago October 14, 2005.
A Corpus Search Methodology for Focus Realization Jonathan Howell and Mats Rooth Linguistics and CIS Cornell University.
Weakness of Structural linguistics Functionalism
McEnery, T., Xiao, R. and Y.Tono Corpus-based language studies. Routledge. Unit A 2. Representativeness, balance and sampling (pp13-21)
Schizophrenia and Depression – Evidence in Speech Prosody Student: Yonatan Vaizman Advisor: Prof. Daphna Weinshall Joint work with Roie Kliper and Dr.
Translation Studies 8. Research methods in Translation Studies Krisztina Károly, Spring, 2006 Sources: Károly, 2002; Klaudy, 2003.
Working group on multimodal meaning representation Dagstuhl workshop, Oct
Intonation and Information Discourse and Dialogue CS359 October 16, 2001.
Suprasegmentals Segmental Segmental refers to phonemes and allophones and their attributes refers to phonemes and allophones and their attributes Supra-
Efficacy of Computer-based Phonetic Training on Students’ Boundary Tone Zhang Yan, Nanjing University.
AUTOMATIC DETECTION OF REGISTER CHANGES FOR THE ANALYSIS OF DISCOURSE STRUCTURE Laboratoire Parole et Langage, CNRS et Université de Provence Aix-en-Provence,
Copyright 2007, Toshiba Corporation. How (not) to Select Your Voice Corpus: Random Selection vs. Phonologically Balanced Tanya Lambert, Norbert Braunschweiler,
The role of prosody in dialect synthesis and authentication Kyuchul Yoon Division of English Kyungnam University Spring 2008 Joint Conference of KSPS.
Adverbials Chapter 11 Longman Student Grammar of Spoken and Written English Biber; Conrad; Leech (2009, p )
Building a sentential model for automatic prosody evaluation Kyuchul Yoon School of English Language & Literature Yeungnam University Korea.
Towards multimodal meaning representation Harry Bunt & Laurent Romary LREC Workshop on standards for language resources Las Palmas, May 2002.
Speech Perception 4/4/00.
On Different Perspectives of Utilizing the Fujisaki Model to Mandarin Speech Prosody Zhao-yu Su Phonetics Lab, Institute of Linguistics, Academia Sinica.
Evaluating prosody prediction in synthesis with respect to Modern Greek prenuclear accents Elisabeth Chorianopoulou MSc in Speech and Language Processing.
Chapter 7-Verbal The Study of Language: Thinking Dialectically
Background: Speakers use prosody to distinguish between the meanings of ambiguous syntactic structures (Snedeker & Trueswell, 2004). Discourse also has.
Predicting Student Emotions in Computer-Human Tutoring Dialogues Diane J. Litman&Kate Forbes-Riley University of Pittsburgh Department of Computer Science.
Recognizing Discourse Structure: Speech Discourse & Dialogue CMSC October 11, 2006.
Topic and the Representation of Discourse Content
DiscAn : Towards a Discourse Annotation system for Dutch language corpora or why and how we would want to annotate corpora on the discourse level Ted Sanders.
Language in Cognitive Science. Research Areas for Language Computational models of speech production and perception Signal processing for speech analysis,
Merging Segmental, Rhythmic and Fundamental Frequency Features for Automatic Language Identification Jean-Luc Rouas 1, Jérôme Farinas 1 & François Pellegrino.
Control of prosodic features under perturbation in collaboration with Frank Guenther Dept. of Cognitive and Neural Systems, BU Carrie Niziolek [carrien]
Lexical, Prosodic, and Syntactics Cues for Dialog Acts.
The role of prosody in dialect authentication Simulating Masan dialect with Seoul speech segments Kyuchul Yoon Division of English, Kyungnam University.
Discuss how researchers analyze data obtained in observational research.
Dialect Simulation through Prosody Transfer: A preliminary study on simulating Masan dialect with Seoul dialect Kyuchul Yoon Division of English, Kyungnam.
Suprasegmental features and Prosody Lect 6A&B LING1005/6105.
Listening Comprehension in Pedagogical Research
Grammar Grammar analysis.
An Introduction to : a closer look at analysing vowels
Hungarian Academy of Sciences
Kenneth Baclawski et. al. PSB /11/7 Sa-Im Shin
Studying Intonation Julia Hirschberg CS /21/2018.
The American School and ToBI
Detecting Prosody Improvement in Oral Rereading
Comparing American and Palestinian Perceptions of Charisma Using Acoustic-Prosodic and Lexical Analysis Fadi Biadsy, Julia Hirschberg, Andrew Rosenberg,
Levels of Linguistic Analysis
Tools for Speech Analysis
Presentation transcript:

Prosodic marking of appositive relative clause types in spoken discourse: pragmatic and phonetic analyses of a British English corpus Cyril Auran & Rudy Loock Laboratoire Savoirs, Textes, Langage Université Lille 3 - CNRS UMR 8163

Global project and methodology Aim: relate discourse functions/structure and prosody Study of Appositive Relative Clauses in English (ARCs, see 1) (1) The students, who like linguistics, also like translation. 2-step methodology:  Discourse annotation: discourse function, information status of ARC and MC, syntactic characteristics  Prosodic annotation: semi-automatic analysis of the corresponding recordings using original scripts with Praat (cf. Boersma & Weenink 2006) Corpora:  Aix-MARSEC (cf. Auran, Bouzon & Hirst 2004)  IViE (cf. Grabe & Post 2002)  ICE-GB (cf. Greenbaum 1996)

ARCs and their functions in discourse Starting point: Loock’s (2003, 2005, 2007) taxonomy of ARCs and their discourse functions:

ARCs and their functions in discourse

Examples : (2) he was convinced # the battle # for the hearts # and minds of the people # was being won # especially # among the Ovambo # who form the majority # of SWAPO's support (3) the first book he took from the library was Darwin's # Origin of Species # which inspired him with the dream of becoming a geologist (4) Israelis # have sympathy and liking for Americans # which is just as well # since the country is swarming # with transatlantic visitors

ARCs and their functions in discourse Differences in the hierarchisation of the informational contents (ARC vs. MC):  Relevance/subjectivity: MC = foreground vs. ARC = background  Continuative: informational contents on the same level (narrative dynamism traditionally restricted to independent clauses; cf. Depraetere 1996) => Are continuatives independent clauses? (cf. Ross 1967, Emonds 1979, McCawley 1982, Fabb 1990 among others, who express this idea for ARCs as a whole.) => Prosodic investigation: are ARCs realized with the intonation contour of independent clauses or parentheticals?

Prosodic analysis Prosody as a macro-system:  tonal aspects (tone and intonation, in relation with speech melody)  temporal aspects (unit durations and speech rate)  intensity (one of the major correlates of loudness)  voice quality (in relation with spectral characteristics of the speech signal)

Prosodic analysis Representation levels (Hirst et al. 2000):  acoustic level: physical characteristics of the speech signal (F0, raw durations, dB)  phonetic level: retains only linguistically significant elements (low-level physical constraints factored out: MoMel modelling, z- transformed durations)  phonological levels (surface and deep): discrete and abstract coding

Prosodic analysis

2 prosodic dimensions:

Data extraction and analysis Number of items per ARC type:  Relevance37  Subjectivity8  Continuative1  Relevance/Subjectivity4  Ambiguous continuative2  Unidentified2

Data extraction and analysis Discourse parameters (5):  ARC type  Position (initial/medial/final)  Information status of antecedent  Information status of ARC  Phrastic status of antecedent

Data extraction and analysis Prosodic parameters (48):  Tonal domain (32): ARC mean F0 (Htz + semitones or ST), ARC minimum F0 (Htz + ST), ARC maximum F0 (Htz + ST), ARC register span (Htz + ST), ARC onset (Htz + ST), ARC offset (Htz + ST), previous IU mean F0 (Htz + ST), previous IU minimum F0 (Htz + ST), previous IU maximum F0 (Htz + ST), previous IU register span (Htz + ST), previous IU offset (Htz + ST), next IU mean F0 (Htz + ST), next IU minimum F0 (Htz + ST), next IU maximum F0 (Htz + ST), next IU register span (Htz + ST), next IU onset (Htz + ST), difference between previous IU offset and ARC onset (ST), difference between ARC offset and next IU onset (ST)  Temporal domain (10): ARC duration (raw and normalised), previous IU duration (raw and normalised), next IU duration (raw and normalised), difference between previous IU normalised duration and ARC normalised duration, difference between ARC normalised duration and next IU normalised duration, silence duration before ARC, silence duration after ARC  Intensity domain (6): mean of ARC global intensity, standard deviation of ARC global intensity, mean of previous IU global intensity, standard deviation of previous IU global intensity, mean of next IU global intensity, standard deviation of next IU global intensity

Results All ARC types:

Results Relevance vs. Subjectivity:

Results

Discussion All ARCS  both typical and atypical characteristics:  Register and intensity levels: lower than those of surrounding units  typical of prosodic parentheticals  Register and intensity spans + speech rate  classical IUs realizing independent clauses  to be linked with the possibility for ARCs to: have the syntactic behaviour and the semantic interpretation of independent clauses convey independent speech acts (cf. Emonds 1979, McCawley 1982 among others)

Discussion Relevance vs. Subjectivity ARCs:  Discourse discontinuity marking through high onset values for both types  Subjectivity ARCs display even stronger discontinuity ↔ more important rupture with the discourse topic (cf. shift between the referential and interpretative levels; see frame 1)  More peripheral information conveyed by subjectivity ARCs (non- topical comment or judgement)  Lower intensity level values for Subjectivity ARC: strategy used by the speaker to induce the perception of intermediate levels between otherwise discrete categories such as continuity/discontinuity, subjectivity/objectivity, etc. (conflicting prosodic characteristics for subjective episodes; cf. Di Cristo et al. 2004)  Speech rate differences need further investigation (the great majority of subjectivity ARCs qualifies sentential antecedents (cf. Loock 2007): parameters difficult to separate)

Conclusion Apparent correlation between discourse functions and prosody Some prosodic characteristics atypical of appositions in general Differences among ARC types: Subjectivity ARCs display prosodic rupture cues, on a par with the peripheral information which they convey Further investigation:  The respective roles of the syntactic status of the antecedent (nominal vs. sentential) and of the ARC type, particularly with relation to speech rate, need to be closely analysed.  Prosodic characteristics of Continuative ARCs: typical of subordinate or main clauses? Problem: availability of acoustically exploitable unscripted/spontaneous data