1. School of something FACULTY OF OTHER School of Computing FACULTY OF ENGINEERING A research-led coursework assignment for the exceptional student and the student journey: Co-author an interdisciplinary research paper! Based on British Computer Society – Machine Intelligence contest entry: Combinatory Hybrid Elementary Analysis of Text: hybrid human-machine intelligence to generate research journal papers by Eric Atwell et al. Research Institute for Artificial Intelligence and Biological Systems, School of Computing, Faculty of Engineering, Leeds University

2. Outline Introduction Experiments to combine research and teaching in AI / Knowledge Management and Corpus Linguistics, using an AI-inspired intelligent agent architecture, but casting students as the intelligent agents. Each student applies KM/Data-mining to a corpus, then we combine results Methods Students given detailed coursework spec, write up as a research paper Results Draft research papers by Junaid Arshad, Chien-Ming Lai, Lan Nim, Noushin Rezapour Asheghi, Josiah Wang, Justin Washtell ( + more?) Conclusions Spamming journals? More research questions for next years classes

3. INTRODUCTION: controversial assumptions? Q: Whats the greatest commercial success on the Internet?

4. INTRODUCTION: controversial assumptions? Q: Whats the greatest commercial success on the Internet? A: not PORN... but ADVERTISING! (not EskimoTube, but YouTube and other Google adverts) Google is a web-search service? - NO: Google is an advert-generating service! - even EskimoTube makes money through adverts

5. INTRODUCTION: controversial assumptions? Q: Whats the greatest commercial success on the Internet? A: not PORN... but ADVERTISING! (not EskimoTube, but YouTube and other Google adverts) SPAM is a particularly successful innovation: generating large numbers of personalised adverts for potential customers Spam WORKS: even if only a low success rate...

6. INTRODUCTION: controversial assumptions? Q: What is the aim of academic research?

7. INTRODUCTION: controversial assumptions? Q: What is the aim of academic research? A: The aim of academic research is to generate journal papers (for RAE, for publicity, for promotion, ?) RAE: Researchers must produce 4 research papers in 6 years Students + Machine Intelligence: 40 draft papers in 6 weeks -a BIG advance in Machine Intelligence - AND research-led student learning We integrate AI and Human Intelligence at 3 levels: using AI architecture; AI tools; AI students

8. Background assumptions The aim of research is to generate conference/journal papers (for RAE, for publicity, for promotion, ?) Computing students should learn to apply ICT to practical, real / useful tasks Research-led teaching and learning is a Leeds Univ strength SO … students could learn by applying ICT to research questions, and writing research papers on results? BUT … research is hard – surely a student cant come up with ideas and results for a publishable research paper?! Maybe one student cant … but…

9. Intelligent Agent Architecture Wikipedia: In computer science, an intelligent agent (IA) is a software agent that exhibits some form of artificial intelligence that assists the user and will act on their behalf, in performing repetitive computer-related tasks. While the working of software agents used for operator assistance or data mining (sometimes referred to as bots) is often based on fixed pre-programmed rules, "intelligent" here implies the ability to adapt and learn … a multi-agent system (MAS) is a system composed of several agents, collectively capable of reaching goals that are difficult to achieve by an individual agent or monolithic system … A multiple agent system (MAS) is a distributed parallel computer system built of many very simple components, each using a simple algorithm, and each communicating with other components. A paradigm of an ant colony or bee swarm is used many times.

10. INTRODUCTION: Students as intelligent agents Monkeys at typewriters will eventually type Shakespeare plays Bio-Inspired Computing researchers aim to develop software which behaves like ants, bees, etc to achieve complex results Why not use students as super-intelligent agents?? Prof David Cliff: this is cheating – his goal is software agents BUT my goal is to generate research journal papers, I am not aiming to build bio-inspired computing software!

11. METHODS Structure: Introduction, Methods, Results, Conclusions. I cant tell you the details in 10 minutes… Instead… a birds eye view: how student + MI can help me generate a draft journal paper I am the QB queen bee: I guide the hive (students+MI) We have 10 minutes, not 6 weeks, so key steps only… NB: COMPUTING DEMOS ALWAYS GO WRONG

12. METHOD: How to create a journal paper QB) Design the overall HI-MI hybrid: coursework specification: http://www.comp.leeds.ac.uk/eric/cr32/cr32cw1.doc http://www.comp.leeds.ac.uk/eric/wwe.shtml QB) Select a domain + research question where MI is novel Humanities: Language and Cultural studies for a region; specifically: Which English dominates WWW in this region, British or American?

13. METHOD: How to create a journal paper Which English dominates WWW in your region, British or American? 1) Use AI search tool to choose a region and journal for this question; and find related research to cite, in the Introduction of your paper.region and journal related research paper 2) Choose 3+ countries in this region, use AI search tool to harvest a Web-Corpus for each countryWeb-Corpus QB) harvest 10 UK and 10 US Web-corpus data-samplesUKUS

14. How to create a journal paper (continued…) QB) Use AI tool to find significant differences: ML features characteristic of UK v. US English 3) Choose features, encode in uk-us ARFF fileARFF 4) Chosen region: encode features in test ARFF fileARFF 5) Use AI ML toolkit (WEKA) to build visualisation and ML evidence of uk-us decision;WEKA copy-and-paste into journal paper: novel evidence (novel for this readership!)

15. How to create a journal paper (continued…) 6) Decision-tree predictions for region samples: UK or US? (Test options: Supplied test set);test set copy into journal paper 7) Finish paper: Introduction, Methods, Results … (ML evidence: novel to this research journal readership), Conclusions 8) Submit paper via AI Knowledge Management toolSubmit QB) assess course-works, aka review/improve, submit to real conference/journal

16. RESULTS Student: outline paper for co-author to expand; great for CV! QB) 40 research papers to submit to conferences and journals … Ill let you know how many were accepted for Language Resources and Evaluation Conference 2010Language Resources and Evaluation Conference 2010, Malta

17. CONCLUSIONS For BCS Machine Intelligence contest: A hybrid of human and machine intelligence - AI architecture applied to students + smart choice of journals and instructions + use of AI tools by AI students … can produce 40 draft research papers in 6 weeks – much more than HI or MI alone. -a BIG advance in Machine Intelligence - AND Human Intelligence – novel student learning experience

18. CONCLUSIONS What else?... Students to draft research-led teaching resources for Wikipedia University: WikiversityWikiversity Same procedure, but instead of a paper, write a Wiki entry Not just AI students: any computer-literate student (or lecturer!) can use Wikipedia, and add to Wiki A.I. Lecturers could collaborate with Language/Humanities Lecturers to produce sharable blended learning resources Eg at UPenn: Natural Language Tool Kit NLTKNLTK At Leeds: Quranic Arabic CorpusQuranic Arabic Corpus LTC7: http://www.comp.leeds.ac.uk/eric/atwell10ltc.ppthttp://www.comp.leeds.ac.uk/eric/atwell10ltc.ppt Interested? Google me: Eric Atwell