1. Open Science Framework Jeffrey Spies @jeffspies Center for Open Science | University of Virginia

3. CENTRE

4. Mission Increase openness, integrity, and reproducibility of scientific research.

5. Problem The gap between scholarly values and practices.

6. Incentives for individual success are focused on getting it published, not getting it right. Nosek, Spies, & Motyl, 2012

7. Key incentive = Publication What is published? Novel results Positive results Clean results What is not? Replications Negative/Nulls Mixed evidence

8. Norms Communality Open sharing Counternorms Secrecy Closed

9. Norms Communality Open sharing Universalism Evaluate research on own merit Counternorms Secrecy Closed Particularlism Evaluate research by reputation

10. Norms Communality Open sharing Universalism Evaluate research on own merit Disinterestedness Motivated by knowledge and discovery Counternorms Secrecy Closed Particularlism Evaluate research by reputation Self-interestedness Treat science as a competition

11. Norms Communality Open sharing Universalism Evaluate research on own merit Disinterestedness Motivated by knowledge and discovery Organized skepticism Consider all new evidence, even against one’s prior work Counternorms Secrecy Closed Particularism Evaluate research by reputation Self-interestedness Treat science as a competition Organized dogmatism Invest career promoting one’s own theories, findings

12. Norms Communality Open sharing Universalism Evaluate research on own merit Disinterestedness Motivated by knowledge and discovery Organized skepticism Consider all new evidence, even against one’s prior work Quality Counternorms Secrecy Closed Particularism Evaluate research by reputation Self-interestedness Treat science as a competition Organized dogmatism Invest career promoting one’s own theories, findings Quantity

13. Anderson, Martinson, & DeVries, 2007

16. Problem The gap between scholarly values and practices.

17. Solution Openness.

18. Openness Increases process transparency Increases accountability Facilitates reproducibility Fosters collaboration Fosters inclusivity Fosters innovation Protects against lock-in Open Content + APIs + Open Source Services

19. Openness is a means to increase research quality and efficiency.

20. Solution Technology can operationalize and incentivize scholarly values.

21. Openness is the solution; Workflow makes it practical.

22. Publish ReportSearch/DiscoveryDevelop IdeaDesign StudyCollect DataStore DataAnalyze DataWrite Report

23. Publish ReportSearch/DiscoveryDevelop IdeaDesign StudyCollect DataStore DataAnalyze DataWrite Report

24. Let experts be experts.

25. Scholars should focus on scholarship.

26. Publish ReportSearch/DiscoveryDevelop IdeaDesign StudyCollect DataStore DataAnalyze DataWrite Report OS F

27. OSF Application Framework Workflow Authentication Permissions File Storage File Rendering Meta-database Persistence Integrations Search SHARE osf.io journals registries preprint servers grants management university systems

28. http://osf.io

29. Collaboration Documentation Archiving

31. Version Control

33. Other Features Granular permissions Analytics dashboards Forking Persistent, citable identifiers (& content) Project snapshotting (i.e., registration)

34. Connects Services Researchers Use

36. Publish ReportSearch/DiscoveryDevelop IdeaDesign StudyCollect DataStore DataAnalyze DataWrite Report Now

37. OpenSesame Soon 29 grants to develop open tools and services: https://cos.io/pr/2015-09-24/https://cos.io/pr/2015-09-24/ Publish ReportSearch/DiscoveryDevelop IdeaDesign StudyCollect DataStore DataAnalyze DataWrite Report

38. http://osf.nd.edu

39. Let experts be experts.

40. OSF Application Framework Workflow Authentication Permissions File Storage File Rendering Meta-database Persistence Integrations Search SHARE osf.io journals registries preprint servers grants management university systems

55. OSF Application Framework Workflow Authentication Permissions File Storage File Rendering Meta-database Persistence Integrations Search SHARE osf.io journals registries preprint servers grants management university systems

56. http://osf.io/prereg

62. Society for the Study of Autism Registry

63. Society for the Study of... Author: Question 1: Analysis code:

64. OSF Application Framework Workflow Authentication Permissions File Storage File Rendering Meta-database Persistence Integrations Search SHARE osf.io journals registries preprint servers grants management university systems

65. Let experts be experts.

66. OSF Application Framework Workflow Authentication Permissions File Storage File Rendering Meta-database Persistence Integrations Search SHARE registries

68. OSF Application Framework Workflow Authentication Permissions File Storage File Rendering Meta-database Persistence Integrations Search SHARE preprint servers

70. Coming soon: http://osf.io/preprints

71. OSF Application Framework Workflow Authentication Permissions File Storage File Rendering Meta-database Persistence Integrations Search SHARE osf.io journals registries preprint servers grants management university systems

72. Substantive experts shouldn’t deal with… Workflow integration Authentication Permissions File storage File rendering Database –Metadata/Annotations/Co mmenting Persistence External service integrations Search SHARE Data

73. …or scaling these: Workflow integration Authentication Permissions File storage File rendering Database –Metadata/Annotations/Co mmenting Persistence External service integrations Search SHARE Data

74. @jeffspies | jeff@cos.io Find this presentation at http://osf.io/ A Framework for Managing and Sharing Research Workflow