Open Science Framework Jeffrey Center for Open Science | University of Virginia

CENTRE

Mission Increase openness, integrity, and reproducibility of scientific research.

Problem The gap between scholarly values and practices.

Incentives for individual success are focused on getting it published, not getting it right. Nosek, Spies, & Motyl, 2012

Key incentive = Publication What is published? Novel results Positive results Clean results What is not? Replications Negative/Nulls Mixed evidence

Norms Communality Open sharing Counternorms Secrecy Closed

Norms Communality Open sharing Universalism Evaluate research on own merit Counternorms Secrecy Closed Particularlism Evaluate research by reputation

Norms Communality Open sharing Universalism Evaluate research on own merit Disinterestedness Motivated by knowledge and discovery Counternorms Secrecy Closed Particularlism Evaluate research by reputation Self-interestedness Treat science as a competition

Norms Communality Open sharing Universalism Evaluate research on own merit Disinterestedness Motivated by knowledge and discovery Organized skepticism Consider all new evidence, even against one’s prior work Counternorms Secrecy Closed Particularism Evaluate research by reputation Self-interestedness Treat science as a competition Organized dogmatism Invest career promoting one’s own theories, findings

Norms Communality Open sharing Universalism Evaluate research on own merit Disinterestedness Motivated by knowledge and discovery Organized skepticism Consider all new evidence, even against one’s prior work Quality Counternorms Secrecy Closed Particularism Evaluate research by reputation Self-interestedness Treat science as a competition Organized dogmatism Invest career promoting one’s own theories, findings Quantity

Anderson, Martinson, & DeVries, 2007

Problem The gap between scholarly values and practices.

Solution Openness.

Openness Increases process transparency Increases accountability Facilitates reproducibility Fosters collaboration Fosters inclusivity Fosters innovation Protects against lock-in Open Content + APIs + Open Source Services

Openness is a means to increase research quality and efficiency.

Solution Technology can operationalize and incentivize scholarly values.

Openness is the solution; Workflow makes it practical.

Publish ReportSearch/DiscoveryDevelop IdeaDesign StudyCollect DataStore DataAnalyze DataWrite Report

Publish ReportSearch/DiscoveryDevelop IdeaDesign StudyCollect DataStore DataAnalyze DataWrite Report

Let experts be experts.

Scholars should focus on scholarship.

Publish ReportSearch/DiscoveryDevelop IdeaDesign StudyCollect DataStore DataAnalyze DataWrite Report OS F

OSF Application Framework Workflow Authentication Permissions File Storage File Rendering Meta-database Persistence Integrations Search SHARE osf.io journals registries preprint servers grants management university systems

Collaboration Documentation Archiving

Version Control

Other Features Granular permissions Analytics dashboards Forking Persistent, citable identifiers (& content) Project snapshotting (i.e., registration)

Connects Services Researchers Use

Publish ReportSearch/DiscoveryDevelop IdeaDesign StudyCollect DataStore DataAnalyze DataWrite Report Now

OpenSesame Soon 29 grants to develop open tools and services: Publish ReportSearch/DiscoveryDevelop IdeaDesign StudyCollect DataStore DataAnalyze DataWrite Report

Let experts be experts.

OSF Application Framework Workflow Authentication Permissions File Storage File Rendering Meta-database Persistence Integrations Search SHARE osf.io journals registries preprint servers grants management university systems

OSF Application Framework Workflow Authentication Permissions File Storage File Rendering Meta-database Persistence Integrations Search SHARE osf.io journals registries preprint servers grants management university systems

Society for the Study of Autism Registry

Society for the Study of... Author: Question 1: Analysis code:

OSF Application Framework Workflow Authentication Permissions File Storage File Rendering Meta-database Persistence Integrations Search SHARE osf.io journals registries preprint servers grants management university systems

Let experts be experts.

OSF Application Framework Workflow Authentication Permissions File Storage File Rendering Meta-database Persistence Integrations Search SHARE registries

OSF Application Framework Workflow Authentication Permissions File Storage File Rendering Meta-database Persistence Integrations Search SHARE preprint servers

Coming soon:

OSF Application Framework Workflow Authentication Permissions File Storage File Rendering Meta-database Persistence Integrations Search SHARE osf.io journals registries preprint servers grants management university systems

Substantive experts shouldn’t deal with… Workflow integration Authentication Permissions File storage File rendering Database –Metadata/Annotations/Co mmenting Persistence External service integrations Search SHARE Data

…or scaling these: Workflow integration Authentication Permissions File storage File rendering Database –Metadata/Annotations/Co mmenting Persistence External service integrations Search SHARE Data

@jeffspies | Find this presentation at A Framework for Managing and Sharing Research Workflow