Natural Language Processing DR. SADAF RAUF

Topic Morphology: Indian Language and European Language Maryam Zahid

 Introduction  History  Natural Language Processing  Morphology  Hindi Morphology  Hindi Language Property  Exceptions  Differences  Conclusion

Introduction What Is Natural language processing? Natural language processing is subfield of Artificial Intelligence and linguistic, devoted to make computer “understand" statement written in natural language. What is natural language? Natural language is a language that is spoken or written by human for general communication. No software application can proliferate to all users unless it has utility to operate it with local language.

Introduction Morphology is the field of the linguistics that studies the internal structure of the words. Morphological Analysis and generation are essential steps in any NLP Application. LanguageFamilySpeakers million States BengaliIndo Aryan Eastern 8.3West Bengal GujaratiIndo Aryan western 4.6Gujarat,dadar Hindicentral40Dehli, uthar Pradesh

History Artificial Intelligence (AI) goal initially was to give computer the ability to parse natural language sentences similar to sentence diagrams that grade-school children learn. What is parse? The term has lexical analysis in which converting a sequence of character into a sequence of token i.e. meaning full character strings Checks that the sentence is correct according with the grammar and if so returns a parse tree representing the structure of the sentence One of the first such systems was developed in 1963 by Susumu Kuno of Harvard The goal of NLP evaluation is to measure one or more qualities of an algorithm or a system, and check whether the system answers,the goals of its designers, or meets the needs of its users.

Natural language processing Goals : 1) Natural language generation systems to convert information from computer to natural language and 2) Natural language understanding systems to convert reverse way. NL input NL out put Computer

Natural language processing Stages of language processing:  Phonetics and phonology (sound pattern of words)  Morphology (analysis of words)  Lexical Analysis (text divided into paragraph, sentences and words)  Syntactic Analysis (is using knowledge of grammar)  Semantic Analysis (is using info about meaning of word)  Pragmatics (using information of,context)  Discourse

Natural Language Understanding  Input/Output data Processing stage Other data used Frequency spectrogram freq. of diff. speech recognition sounds Word sequence grammar of “He loves Mary” syntactic analysis language Sentence structure meanings of semantic analysis words He loves Mary Partial Meaning context of  x loves(x,mary) pragmatics utterance Sentence meaning loves(john,mary)

Natural language processing Word formation rules from root words Nouns: Plural (boy-boys) Verbs: Tense : The tense of a verb shows the time when an action or condition occurred. Aspect: The aspect of a verb is determined by whether the action is on going or completed. Modality: Modality is about a speaker’s or a writer’s attitude towards the world. A speaker or writer can express certainty, possibility, willingness, obligation, necessity and ability by using modal words and expressions.

Morphology Morphology is the study of the way words are built up from smaller meaning bearing units, morphemes. European languages have both regular noun and irregular noun but Hindi language have only regular noun. Morphemes: Smallest meaning bearing units constituting a word

Morphology Morphemes Stem tree, go, fat Affixes Prefixes post - (postpone) Suffixes -ed (tossed)

Morphology  In English language, we do not use verbs as gender identification but in Hindi we use verbs for gender identification.  For example:  Saanchi NLP padati hai.  (Sanchi reads NLP.)  Saachya NLP padtaa hai.  (Sachya reads NLP.)

Hindi Morphology Derivational morphology involves the processes by which new lexemes are built from existing ones mainly through the addition of affixes. As an example in Hindi + e + esjk = eesjk (Pronoun to Adjective), like in English – go + at = goat (verb to noun) etc. Inflectional morphology involves the processes by which various inflectional forms are formed

Hindi Morphology

Indian Language Property  Five/Six distinct places of Articulation.  Unlike European Language, contain retroflex consonants.  Different languages like. Tamil, Sindhi, Punjabi, Bengali, Oriya.

Exceptions  In Tamil language, place of Articulation is represented by a single grapheme.  Singh language has implosive.  च and ज are dental-alveolar in Marathi only, while these are alveolar in Hindi.  ड़ and ढ़ are present in Hindi, Urdu, Sindhi, Punjabi & Oriya.

Exceptions  Punjabi language is tonal language.  व and ब are pronounced as ब in Bengali.  व and ब are pronounced as भ in Oriya.  More fricatives consonants are present in Hindi, Urdu, Punjabi due to influence of Arabic and English.

Differences  In Origin  Hindi belongs to Indo-European Language family under the western Hindi  English is form Germanic language family.

Differences  In Alphabets:  Hindi language follow Devangari script contains 10 vowels,40 consonants. Bar on the top.  English language contain 26 letters.  Unlike English, Hindi is phonetic language.

Differences  In Grammar:  Hindi uses pre. continuous instead of simple pre.  Hindi does not have equivalent of “do”.  English have definite articles.  In Hindi “subject-object-verb” while In English “subject-verb-object”.

Differences  In vocabulary:  Hindi adopt Devangari script, not too hard to master.  English uses POS(part of speech).

Hindi letters

English letters

Part of Speech  According to use of words:  Noun  Pronoun  Adjective  Verb  Adverb  Proposition  Conjunction  interjection

Verb  Latin word: verbum  Most important words in POS  Like personal pronoun: 3 person(1 st,2 nd,3 rd )  Like noun/pronoun: 2 number (singular,plural)

References  cs).  ection_and_Distributed_ Morphology.  ptoject.