Summary  The task of extractive speech summarization is to select a set of salient sentences from an original spoken document and concatenate them to form a summary To facilitate users to better browse through and understand the content of the document  We propose a novel margin-based discriminative training (MBDT) algorithm that aims to penalize non-summary sentences in an inverse proportion to their summarization evaluation scores  The summarization model can be trained with an objective function that is closely coupled with the ultimate evaluation metric of extractive speech summarization A Margin-based Discriminative Modeling Approach for Extractive Speech Summarization Shih-Hung Liu †*, Kuan-Yu Chen *, Berlin Chen #, Ea-Ee Jan +,Hsin-Min Wang *, Hsu-Chun Yen †, Wen-Lian Hsu * † Institute of Information Science, Academia Sinica, Taiwan # National Taiwan Normal University, Taiwan * National Taiwan University, Taiwan + IBM Thomas J. Watson Research Center, USA Various Discriminative Models  SVM A binary summarizer which can output the decision score g(S i ) of each sentence S i  The posterior probability of a sentence S i being included in the summary class S can be approximated by the following sigmoid operation (the weights and are optimized by the training set):  Perceptron The decision score of sentence S i is f(S i )=  X i   X i is the inner product of feature vector of sentence S i and model parameter  The model parameter can be estimated by maximizing the accumulated squared score distances of all the training spoken documents  N is total training documents, Summ n is the reference summary of the n-th training document D n, S R denotes a summary sentence in Summ n, and S n * is the non-summary sentence of D n that has the highest decision score  Global Conditional Log-linear Model (GCLM) The GCLM method aims at maximizing the posterior scores of the summary sentences of each given training spoken document Experimental Results  Dataset: The summarization dataset employed in this study is a publicly available broadcast news (MATBN) corpus 100 documents for training and 20 documents for test  16 indicative features in total for representing the sentence  The results of comparing with other discriminative methods and unsupervised approaches. TD: manual transcripts SD: speech recognition transcripts  The results of each individual feature used in isolation and combination with other kind of feature Margin-based Discriminative Training (MBDT) 2)In the second stage, MBDT attempts to define a training objective function that is closely coupled with the ultimate evaluation metric of speech summarization w(S j ) is the weight of a (non-summary) sentence S j Eval(S j,Summ n ) is a function that estimate the summarization performance of a sentence S j of D n by comparing S j to the reference summary Summ n of D n with a desired evaluation metric  The score returns by Eval(S j,Summ n ) is between 0 and 1  The higher the value, the better the performance Prosodic Features 1. Pitch value (max, min, mean, diff) 2. Energy value (max, min, mean, diff) Lexical Features 1. Number of named entities 2. Number of stop words 3. Bigram language model scores 4. Normalized bigram scores Relevance Features 1. VSM 2. DLM 3. RM 4. SMM TDSD ROUGE-1ROUGE-2ROUGE-LROUGE-1ROUGE-2ROUGE-L SVM Ranking SVM Perceptron GCLM MBDT ILP Submodularity TDSD ROUGE-1ROUGE-2ROUGE-LROUGE-1ROUGE-2ROUGE-L MBDT+Pro MBDT+Lex MBDT+Rel MBDT+Pro+Lex MBDT+Lex+Rel MBDT+Pro+Rel MBDT+All