The trouble with codified knowledge... (a) those that belong to the Emperor (b) embalmed ones (c) those that are trained (d) suckling pigs (e) mermaids (f) fabulous ones (g) stray dogs (h) those that are included in this classification (i) those that tremble as if they were mad (j) innumerable ones (k) those drawn with a very fine camel's-hair brush (l) others (m) those that have just broken a flower vase (n) those that resemble flies from a distance.” Celestial Emporium of Benevolent Knowledge “Animals may be divided as follows:

Orientation n The broader context n Me: cognitive psych; ergonomics; HCI; hypertext n next generation tools for learning: constructing, contesting and discovering knowledge/meaning/significance (in academic study, research, and other knowledge intensive environments)

Claims Counterclaims

A new infrastructure makes waves…  cognitive  institutional  disciplinary  …literacies…

Co-Evolving Processes, Practices & Technologies for Scholarly Publishing Simon Buckingham Shum Knowledge Media Institute Open University, UK Collaborative work with Tamara Sumner (U. Colorado Boulder, USA), Mike Wright (Unidata-UCAR,USA) Malcolm Story & Gary Li (Open U., UK) Continuity & Change in Scholarly Publishing 25 th June, 2001Amsterdam

Overview n Orientation n Journal of Interactive Media in Education (JIME) n Digital Document Discourse Environment (D 3 E) n Scholarly Ontologies Project (ScholOnto)

Orientation n The broader project n tools for constructing, contesting and discovering meaning n 2 ways to use technology n (i) streamline the current model (e.g. JHEP) (ii) explore new possibilities and evaluate (e.g. Psycoloquy; JIME) n JIME as a ‘new kid on the block’ n a ‘mobile exploration vehicle’ n unique mix of review technology+process n changing forms and roles n offers both process ideas and generic technology

Journal of Interactive Media in Education An Interactive Journal for Interactive Media www-jime.open.ac.uk

Peer review dimensions anonymousnamedappointed open invitation 1-shotconversation reviews discarded reviews preserved reviewers on their own reviewers interact author right of reply author no right of reply anonymousappointed 1-shot reviews discarded reviewers on their own author no right of reply anonymousnamedappointed open invitation 1-shotconversation reviews discarded reviews preserved reviewers on their own reviewers interact author right of reply author no right of reply

JIME in a nutshell n conversational open peer review intrinsic to journal’s review model: the social contract

JIME’s peer review model Private+Public / Conversational / Open Peer Review / Edited / Co-published with article n Reviewers assigned and named/hyperlinked n Conversational/argumentation model (web) n Hybrid 2-step process: private then public n Private s to editor if preferred n  revision, publication + open for further comments n Intellectual trace of the article’s history

JIME in a nutshell n conversational open peer review intrinsic to journal’s review model: the social contract n authors encouraged to back claims about technology with demonstrations/ walkthroughs for readers and reviewers

Interactive demonstration of a CD-ROM Readers can ‘play’ with the construction of a painting, as students were encouraged to do

Audio-visual slide presentation, walking the reader through a system The author introduces the multimedia system with a series of slides and commentary (streaming audio)

JIME in a nutshell n conversational open peer review intrinsic to journal’s review model: the social contract n authors encouraged to back claims about technology with demonstrations/ walkthroughs for readers and reviewers n articles tightly integrated with reviews in a web document-discussion interface n edited review discussions co-published with final article

Submission under review PrePrint or Published Peer review comments and discussion: tightly integrated + co-published JIME document user interface (generated by D3E from an HTML submission)

JIME alert to new review comment

Author links from text to discussion

Submission under review PrePrint or Published Peer review comments and discussion: tightly integrated + co-published JIME document user interface (generated by D3E from an HTML submission)

D 3 Eprint server generating a peer review discussion space for an ePrint archive document… D 3 E: Digital Document Discourse Environment d3e.open.ac.uk “Open Source from the Open University”

An arXiv eprint

Peer review/commentary on an arXiv document

JIME changes… n …Author’s experience n at least as much feedback as normal n typically gain an enormous amount from defending against expert peers n sometimes need to be coaxed into responding! n …Reviewer’s experience n engage in discussions with both authors and reviewers n formulate reflective contributions to debates in a timely, professional manner

JIME changes… (cont/d) n …Reader’s experience n insight into how to interpret the text (esp. students) n ‘dissenting voices’ are not silenced n …the concept of a ‘Publication’ n multimedia n hypertext structures possible n content can now be distributed across the formal document and the discussion space

Conversational Open Peer Review? n Pros n Rigorous, accountable quality control n At its best can promote interdisciplinary dialogue n Reviewers can debate between themselves n Works because journal Policies and Practices have evolved with the Technology n Cons n Both the technology and process are new n More resource intensive for authors and reviewers n Better for discursive, multidisciplinary fields? n Key n Technology enables new practices, but discourse analysis shows mixed evidence of changed working practices

Claims Counterclaims Emergent domain model grounded in perspectives

ScholOnto: Scholarly Ontologies Project n A discourse-oriented digital library server to mediate scholarly claims and argumentation (cf. link taxonomies theme) n beyond primary metadata… perspectival semantic web n literatures as conceptual networks n research documents complemented by concept maps summarising the key claims and argumentation n semantic layer over journal or eprint archives n “semantic citation links”  novel forms of scientometrics and information visualizations n structural templates for peer review

Other issues n “Would this work for me?…” n Hypertextual il/literacy n Framework for co-evolving policies and practices with technologies n Theories wrt. persistent discourse n D 3 E technical infrastructure

Journal of Interactive Media in Education www–jime.open.ac.uk Digital Document Discourse Environment d3e.open.ac.uk PhD on ePrints+Peer Review: deadline 16 th July kmi.open.ac.uk/studentships Scholarly Ontologies Project kmi.open.ac.uk/projects/scholonto