1. Importing and Exporting DataShop Data http://pslcdatashop.org Slides current to DataShop version 4.1.8 Brett Leber Interaction Designer

2. Is your data right for DataShop? It might be if it… was produced by an intelligent tutoring system follows a student action, tutor response sequence (untutored actions OK) is primarily textual encodes some notion of “steps” What kind of data do you have?

3. Benefits of importing your data DataShop offers: Web-based visualization and analysis tools for exploring your data Secure storage and backup A location on the web where anyone you want can access your data Web services for programmatic access

4. Directly/Real-time –Some tutors are logging directly to the PSLC logging database –CTAT-based tutors (when configured correctly), can log to disk or to the logging database over the internet Indirectly –Other tutors are logging to their own file formats or their own databases These data require a conversion process Many studies are in this category How do I get data in?

5. XML vs. tab-delimited format XML Richer description than tab- delimited –More fields –Problem start time –Problem description –Problem tutor flag More verbose Requires some familiarity with XML Not especially readable Tab-delimited More concise Can edit in Excel More easily shareable Less rich than XML –Missing problem start time, description, and tutor flag

6. <context_message context_message_id="02CE3AE5-F6D5-9177-913F-C34730F1096C" name="START_PROBLEM"> student01 08xz013 2010/02/22 06:43:47.002 US/Eastern Learn a Language Fall 2007 Learning Logging Translating Tech Talk Tutor Message Format

7. <tool_message context_message_id ="02CE3AE5-F6D5-9177-913F-C34730F1096C"> student01 08xz013 2010/02/22 06:45:48.014 US/Eastern <semantic_event transaction_id="B503948-9164-DD83-EBB2-1589FD38D435" name="ATTEMPT" /> _level0.VideoPlayerInstance1.sliderButtonName mymovie.flv 00:08:00.0 cue 00:04:34.8 00:05:42.2 Tutor Message Format

8. <tutor_message context_message_id ="02CE3AE5-F6D5-9177-913F-C34730F1096C"> student01 08xz013 2010/02/22 06:43:56.367 US/Eastern <semantic_event transaction_id="B503948-9164-DD83-EBB2-1589FD38D435" name="RESULT" /> _level0.VideoPlayerInstance1.sliderButtonName mymovie.flv 00:08:00.0 cue 00:04:34.8 00:05:42.2 INCORRECT Your answer is not correct. Select only the portion of the video where the man it talking about his family. family_words video_portion_selection Tutor Message Format

9. Same thing in tab-delimited Anon Student Id Session IDTimeTime Zone Student Response type Tutor Response Type student0108xz0132010/02/22 06:45:48.014 ESTATTEMPTRESULT Level(Unit)Problem Name Step NameOutcomeSelectionAction Learning Logging Translating Tech Talk mymovie.flv cue INCORR ECT mymovie.flvcue And so on

10. Tools: XML vs. tab-delimited format XML Java Logging Library –Log in XML to disk or to a logging server –http://pslcdatashop.org/about/libraries.htmlhttp://pslcdatashop.org/about/libraries.html Flash Logging Library –Log to a logging server –http://ctat.pact.cs.cmu.edu/index.php?id=logging- flashhttp://ctat.pact.cs.cmu.edu/index.php?id=logging- flash Build a tutor with CTAT without programming –Can log to disk or to a logging server –http://ctat.pact.cs.cmu.eduhttp://ctat.pact.cs.cmu.edu Convert to XML via your own program –Transform existing log data into valid Tutor Message Format –Validate your XML with a tool we’ve created –http://pslcdatashop.web.cmu.edu/xmlvalidator.htmlhttp://pslcdatashop.web.cmu.edu/xmlvalidator.html Tab-delimited DataShop Import Tool –Verify your import file with our Verification Tool –http://pslcdatashop.web.cmu.edu/impor tverify.htmlhttp://pslcdatashop.web.cmu.edu/impor tverify.html

11. Documentation For XML: Guide to the Tutor Message Format: http://pslcdatashop.org/dtd/guide/ http://pslcdatashop.org/dtd/guide/ For tab-delimited format: http://pslcdatashop.org/about/importverify.html To learn about terminology: http://pslcdatashop.org/help?page=terms To learn about existing DataShop output formats: http://pslcdatashop.org/help?page=export

12. Case Study: Chinese Writing Study Fall 2009 http://www.learnlab.org/research/wiki/index.php/Perfetti_-_Read_Write_Integration Researchers presented the DataShop team with their data, which was a tabular format unlike the DataShop format. DataShop team consulted with the research team to see which DataShop-required fields were missing and which new fields were extra. DataShop team and researchers arrived at definitions of problems, steps, and knowledge components. DataShop requires a correct/incorrect tagging of each attempt, so correctness was determined by a threshold (eg, 0.5) DataShop consultant (Alida) wrote a converter to convert from this tabular format to XML, and imported into DataShop.

13. Future of importing and the format Push-button import Richer, more-flexible format Multimedia (audio) Dialogue data

14. Exporting from DataShop From the website: –By transaction –By student-step –By student-problem From web services: –By transaction –By student-step

15. Exporting from DataShop 1.Log in to the web application. 2.Choose a dataset. 3.Click “Export” tab. 4.Choose a level of granularity (transaction, step, or problem). 5.Choose a sample. 6.Click export button. Tip: “All Data” sample is cached for transaction export, so choosing that sample results in fastest export.

16. Questions?