1. By: Niraj Kumar Automatic Essay Grading Novelty Detection 1. 2.

2. One or multiple model essays Test Essays Output: %score or Essay-class Essay grading by using “Model Essays(s)” Source document(s) Test essays Output: %score or Essay-class Essay Grading with “Source Document(s)” Some quality specific samples Test essays Output: Essay-class Essay Grading without “Model Essays” Automatic Essay Grading System

3. Our Contribution

4. Word Graph of Text TEXT: 1. “Fighters were developed in World-War-I to deny enemy aircraft and dirigibles the ability to gather information by reconnaissance. 2. Early fighters were very small and lightly armed by later standards, and most were biplanes built with a wooden frame, covered with fabric, and limited to about 100 mph. 3. As control of the airspace over armies became increasingly important all of the major powers developed fighters to support their military operations.”

5. Feature Extraction-1 : Relevance of information

6. Total Correlation

7. Feature Extraction-2 : Presence of sparsely connected words Topical Term - T Topical Term - B Topical Term - A Topical Term - E Topical Term - D Topical Term - C - Used Weakly connected components of EGO-Network to identify the weakly connected components

8. Feature Extraction-3: Statistical and semantic role of words

9. Feature Extraction-4: Presence of talkative terms

10. Essay Grading

11. Pseudo Code

12. Evaluation System% Accuracy High School essays (Two-groups) Grade 5 essays (Three-groups) According to dataset 10-Fold cross validation According to dataset 10-Fold cross validation Our devised system88.00%87.89%63.00%63.01% Betsy80.00%78.00%51.00%51.20%

13. Novelty Detection Document Similarity Analysis Plagiarized Text Non-Plagiarized Text May Contain Novel Information May contain Noisy Information

14. Novelty Detection (Current Status) Plagiarism Detection Identifying “Copy-Paste” based plagiarism 1.Hashing and String matching based techniques are available 2.Systems are effective. Identifying “Copy-Paste” based plagiarism 1.Hashing and String matching based techniques are available 2.Systems are effective. Identifying “Word-re-order” based plagiarism 1.Challenging problem 2.Scholary articles Identifying “Word-re-order” based plagiarism 1.Challenging problem 2.Scholary articles Current Status: 1.Successfully designed the approach to meet both requirements 2.Trying to extend the work towards: 1.Information reuse in scholary articles 2.Novelty Detection Current Status: 1.Successfully designed the approach to meet both requirements 2.Trying to extend the work towards: 1.Information reuse in scholary articles 2.Novelty Detection

15. Reference 1.Tuomo Kakkonen, Niko Myller, Jari Timonen, and Erkki Sutinen; Automatic Essay Grading with Probabilistic Latent Semantic Analysis; Proceedings of the 2nd Workshop on Building Educational Applications Using NLP, pages 29–36, Ann Arbor, June 2005. 2.Jill Burstein, Martin Chodorow, Claudia Leacock: CriterionSM Online Essay Evaluation: An application for Automated Evaluation of Student Essays. IAAI 2003: 3-10. 3.Yigal Attali & Jill Burstein; Automated Essay Scoring With e-rater V.2; Journal of Technology, Learning, and Assessment (ISSN 1540-2525). 4.Derrick Higgins, Jill Burstein, Y. Attali: Identifying off-topic student essays without topic-specific training data. Natural Language Engineering 12(2): 145-159 (2006). 5.Jill Burstein, Martin Chodorow, Claudia Leacock: Automated Essay Evaluation: The Criterion Online Writing Service. AI Magazine 25(3): 27-36 (2004). 6.Shermis, M. D. & Hamner, B. (2012) Contrasting State-of-the-Art Automated Scoring of Essays: analysis. 7.William, G.,Church, K., and Yarowsky, D., (1993). A method for disambiguating word senses in a large corpus. Computers and the Humanities, 26: 415-439. 8.Hanneman, Robert A. and Mark Riddle. 2005. Introduction to social network methods. Riverside, CA: University of California, Riverside ( published in digital form at http://faculty.ucr.edu/~hanneman/ ). 9.Lawrence M. Rudner; Tahung Liang. Automated Essay Scoring Using Bayes’ Theorem. The Journal of Technology, Learning, and Assessment. Volume 1, Number 2 · June 2002. 10.Rothstein J (1952). Organization and entropy, Journal of Applied Physics 23, 1281–1282. 11.Wiebe, J. and E. Riloff: 2005, ‘Creating Subjective and Objective Sentence Classifiers from Unannotated Texts’. In: Proceeding of CICLing-05, pp. 475–486. 12.Jitesh Shetty,Jafar Adibi;Discovering important nodes through graph entropy the case of Enron email database;KDD ’2005 Chicago, Illinois.