WP 4.3 Convergence of Data Service Outcomes of in-depth interviews and a survey amongst existing and future data archive services Task Leader: DANS Partners:

Slides:



Advertisements
Similar presentations
Data Seal of Approval 16 guidelines in 16 slides Dr. Henk Harmsen.
Advertisements

DSA and the Certification Framework Ingrid Dillo Data Archiving and Networked Services DSA Conference, Florence 10 December 2012.
Keystroke analysis and implications for fieldwork WP3.3 – task 2 Johanna Bristle (SHARE, MEA) Verena Halbherr (ESS, GESIS) DASISH Final Conference – Gothenburg,
IASSIST / IFOD: Mobile Data and the Life Cycle – Tampere, Finland May 26-29, 2009 Lifecycle & Comparative Studies Metadata Needs of the Future CESSDA RI.
DASISH Online Training Module Claudia Engelhardt Access Policies and Licensing Timo Gnadt
WP 3: Survey Quality Eric Harrison City University London Knut Kalgraff Skjåk Norwegian Social Science Data Services IASSIST May May, Cologne.
CLARIN and the DSA Paul Trilsbeek The Language Archive Max Planck Institute for Psycholinguistics.
Transformations at GPO: An Update on the Government Printing Office's Future Digital System George Barnum Coalition for Networked Information December.
NSD © 2014 DASISH Digital Services Infrastructure for Social Sciences and Humanities WP4 Data Archiving Claudia Engelhardt (UGOE), Arjan Hogenaar (DANS),
Steven KrauwerCLARIN-NL Launch CLARIN-EU: Where do we stand? Steven Krauwer Utrecht institute of Linguistics UiL OTS CLARIN-EU Coordinator.
Steven KrauwerLREC20081 CLARIN: Common Language Resources and Technology Infrastructure for the Humanities and Social Sciences Kimmo Koskenniemi (University.
DASISH Common Solutions to Common Problems. DASISH – Data Service Infrastructure for the Social Sciences and Humanities DASISH brings together 5 ESFRI.
Depositing and Disseminating Digital Resources Alan Morrison Collections Manager AHDS Subject Centre for Literature, Linguistics and Languages.
Data Seal of Approval Overview Lightning Talk RDA Plenary 5 – San Diego March 11, 2015 Mary Vardigan University of Michigan Inter-university Consortium.
Who is doing a good job in digital preservation? Audit and Certification of Digital Repositories: ISO and the European Framework.
WP7: Training modules Claudia Engelhardt, Timo Gnadt, Jens Ludwig Gothenburg, Final.
Data Management Development and Implementation: an example from the UK SLA Conference, Boston, June 2015 Geraldine Clement-Stoneham Knowledge and Information.
Chinese-European Workshop on Digital Preservation, Beijing July 14 – Network of Expertise in Digital Preservation 1 Trusted Digital Repositories,
Ingest and Dissemination with DAITSS Presented by Randy Fischer, Programmer, Florida Center for Library Automation, University of Florida DigCCurr2007.
The Preparatory Phase Proposal a first draft to be discussed.
NSD©2014 Bjørn Henrichsen From Fragmentation to a Infrastructural System DASISH Strategic Board Gothenburg, November
Repository Requirements and Assessment August 1, 2013 Data Curation Course.
Data Archiving and Networked Services DANS is an institute of KNAW en NWO Trusted Digital Archives and the Data Seal of Approval Peter Doorn Data Archiving.
Data Archiving and Networked Services DANS is an institute of KNAW en NWO and the Peter Doorn Data Archiving and Networked Services EUDAT Conference Trust.
Jenn Riley Metadata Librarian Indiana University Digital Library Program.
Marina Signore Head of Service “Audit for Quality Istat Assessing Quality through Auditing and Self-Assessment Signore M., Carbini R., D’Orazio M., Brancato.
The activities of CESSDA Data Archives in Europe Roxane Silberman DwP Principal Investigator CNRS/Réseau Quetelet 1st DwB Regional Workshop, Ljubljana,
C ross-European data sharing made easy EDAF Luxembourg.
Reference Model for an Open Archival Information System (OAIS) ESIP Summer Meeting John Garrett – ADNET Systems at NASA/GSFC ESIP Summer Meeting.
DASISH Final Conference Common Solutions to Common Problems.
21/06/09C:\Users\ehttp://dariah.eu ah\Desktop\new_slides\dariah_slides_template_blue.odppage 1 Heiko Tjalsma, Andreas.
CLARIN work packages. Conference Place yyyy-mm-dd
BUILDING ON COMMON GROUND: EXPLORING THE INTERSECTION OF ARCHIVES AND DATA CURATION Lizzy Rolando & Wendy Hagenmaier 6/3/2015IASSIST 2015.
Metadata management: DDI and Nesstar at the Czech Social Science Data Archive Jindrich Krejci & Yana Leontiyeva Data without Boundaries, Ljubljana 24 &
Digital preservation activities at the NLW Sally McInnes 18 September 2009.
1 Strategic Plan for Digital Archives Programme DAP PROJECT SCOPE OVERVIEW STATUS.
A Data Category Registry- and Component- based Metadata Framework Daan Broeder et al. Max-Planck Institute for Psycholinguistics LREC 2010.
Funded by: © AHDS Preservation in Institutional Repositories Preliminary conclusions of the SHERPA DP project Gareth Knight Digital Preservation Officer.
Archiving microdata Standards and good practices United Nations Statistics Commission New York, February 26, 2009 Olivier Dupriez World Bank, Development.
EO Dataset Preservation Workflow Data Stewardship Interest Group WGISS-37 Meeting Cocoa Beach (Florida-US) - April 14-18, 2014.
SEEDS: Programme and Objectives SEEDS Kick-off meeting May 4, Lausanne Renate Kunz.
SEDAC Long-Term Archive Development Robert R. Downs Socioeconomic Data and Applications Center Center for International Earth Science Information Network.
Providing access to your data: Determining your audience Robert R. Downs, PhD NASA Socioeconomic Data and Applications Center (SEDAC) Center for International.
Antilope Benelux Summit Delft – The Netherlands Questionnaire & Debate.
Networks ∙ Services ∙ People Thomas Bärecke Journée Fédération, Paris Collaboration européenne GÉANT SA5 03/07/2015 SA5 T5 team
WP7: Workshops Claudia Engelhardt, Timo Gnadt, Jens Ludwig Gothenburg, Final conference.
Eurostat Sharing data validation services Item 5.1 of the agenda.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Webinar on Trust.
Open Science and Research – Services for Research Data Management © 2014 OKM ATT 2014–2017 initiative Licenced under.
DASISH Digital Services Infrastructure for Social Sciences and Humanities Daan Broeder TLA - MPI for Psycholinguistics / DASISH & CLARIN EGI Forum Garching,
Thomas Gutberlet HZB User Coordination NMI3-II Neutron scattering and Muon spectroscopy Integrated Initiative WP5 Integrated User Access.
1 Recent developments in quality related matters in the ESS High level seminar for Eastern Europe, Caucasus and Central Asia countries Claudia Junker,
Click to edit Master title style Click to edit Master text styles Second level Third level Fourth level Fifth level 1 SI O S Svalbard Integrated Arctic.
13 July 2005 Archives Hub day conference The Paradigm Project: The University of Oxford & The University of Manchester
WP3: Common policies and implementation strategies
CESSDA SaW Training on Trust, Identifying Demand & Networking
Data Management Plans Ron Dekker Director CESSDA.
CESSDA – for what and for whom?
Best practice survey on the current solutions for digital archiving
USING THE DSA TO BENCHMARK AND GUIDE TRUST WITHIN CESSDA
Innovative sources and tools for living conditions surveys
WP7: Training & Education
Darja Fišer CLARIN ERIC Director of User Involvement
DASISH WP4 Data Archiving
WP 5 Shared Data Access & Enrichment
Common Solutions to Common Problems
Data without Boundaries The DwB project (FP7-13)
e-Invoicing – e-Ordering 20/11/2008
Integrating social science data in Europe
Roxane Silberman, Réseau Quételet
Presentation transcript:

WP 4.3 Convergence of Data Service Outcomes of in-depth interviews and a survey amongst existing and future data archive services Task Leader: DANS Partners: CentERdata; GESIS; MPI/TLA; NSD; SND; UGOE; UiB Final DASISH Meeting, November 2014, Gothenburg 1

Scope of Task according to the DoW -Select and promote a number of high-quality deposit services -Come with concrete suggestions for service improvement Final DASISH Meeting, November 2014, Gothenburg 2

Methodology -Survey autumn/winter Building on the outcomes of Tasks 4.1 and 4.2 -In-depth interviews with Data Archive Services summer 2014 Final DASISH Meeting, November 2014, Gothenburg 3

Scope of Survey Gather information from organisations with relationship to CESSDA, CLARIN, DARIAH, ESS, or SHARE Questionnaire constructed, based on DADS (see Task 4.2) Transformed into web questionnaire by CentERdata Answered gathered between 20 September and 4 November 2013 Additional DADS derived from the survey outcomes Final DASISH Meeting, November 2014, Gothenburg 4

Response Overview Invitations sent:89 Complete responders:46 (52 %) Partial responders: 5 ( 6 %) Non-responders:33 (37 %) Non-archive responders: 3 ( 3%) Double response: 2 ( 2%) Final DASISH Meeting, November 2014, Gothenburg 5

Regional Representation (51 responders with a (future) DAS) Northwestern Europe: 34 respondents Eastern Europe: 12 respondents Southern Europe: 5 respondents Final DASISH Meeting, November 2014, Gothenburg 6

ESFRI Representation (full responders) CESSDA:24 respondents CLARIN:22 respondents DARIAH:13 respondents ESS: 7 respondents SHARE: 6 respondents (more than one representation per respondent possible) Co-relationships between CLARIN and DARIAH and between CESSDA and SHARE/ESS Final DASISH Meeting, November 2014, Gothenburg 7

Funding of Data Archive Services [N=51] (Partial) public funding48 With additional Third Party Funding20 With additional Revenues10 Complete Third Party Funding 1 (Partial) Project-Based Funding 4 (more than one type of funding possible per service) Final DASISH Meeting, November 2014, Gothenburg 8

Designated Communities: definition According to the OAIS-model: An identified group of potential consumers who should be able to understand a particular set of information Final DASISH Meeting, November 2014, Gothenburg 9

Designated Communities Social Scientists21 Linguists 9 Historians 3 Other, mostly multidisciplinary18 Final DASISH Meeting, November 2014, Gothenburg 10

Organisational Aspects of Data Archive Services Availability of mission statement:34 (65 %) Availability of deposit agreement:36 (72 %) Availability of usage agreement:35 (69 %) Availability of preservation policy:26 (50 %) Final DASISH Meeting, November 2014, Gothenburg 11

Rights Management within Data Archive Services Transfer of non-exclusive rights26 (50 %) No transfer of rights 3 ( 6 %) Depositor retains rights13 (25 %) Other 9 ( 18 %) Final DASISH Meeting, November 2014, Gothenburg 12

Ingest: file formats Only deposit in accepted file formats 5 (10 %) Archive works with list of preferred formats19 (38 %) Archive does not indicate restrictions17 (34 %) Archive negotiates with depositor 8 (16 %) Final DASISH Meeting, November 2014, Gothenburg 13

Ingest: metadata formats DC20 (40 %) DDI18 (36 %) CMDI13 (26 %) TEI 12 (24 %) IMDI 5 (10 %) Other16 (32 %) Final DASISH Meeting, November 2014, Gothenburg 14

Preservation Strategy Migration28 (56 %) Emulation 2 ( 4 %) Bitstream18 (36 %) Other13 (26 %) Final DASISH Meeting, November 2014, Gothenburg 15

Level of Trust Trustworthiness Strategy Preparatory Phase DSA 6 (12 %) DSA/Drambora self-assessment 8 (16 %) Peer-reviewed DSA 9 (18 %) Peer-reviewed ISO ( 2 %) No strategy(yet)22 (44 %) Note: level 1 and above-> NW Europe Final DASISH Meeting, November 2014, Gothenburg 16

Dissemination Ways of Accessing Archives Websites29 (58 %) Online catalogues24 (48 %) Special interfaces 7 (14 %) Final DASISH Meeting, November 2014, Gothenburg 17

Future Developments I Improvement of administration [documentation; data policy plans etc.] Improvement of ingest [automated ingest; submission agreement development; metadata standards] Storage & Preservation [preservation policy; provenance registration; PIDs] Final DASISH Meeting, November 2014, Gothenburg 18

Future Developments II Dissemination [Single Sign-On; user interface] Other items [certification; annotation tools; authentication and authorisation] Final DASISH Meeting, November 2014, Gothenburg 19

In-depth interviews Limited number of Data Archive Services Representing DARIAH, CESSDA and CLARIN Representing Northwest- and Eastern Europe Focus on ‘upcoming services’ (existing DASs have been analysed in WP 4.2) Interviews conducted during spring/summer 2014 Final DASISH Meeting, November 2014, Gothenburg 20

Methodology Fixed set of mandatory questions in combinations with a limited set of additional set of additional questions Interviewers from UiB, SND, UGOE and DANS Interviewees from BAS, UFAL/LINDAT, TextGrid, DRI, DDA, and ADP Final DASISH Meeting, November 2014, Gothenburg 21

Technical infrastructure DASs Techniques used not uniform Functionalities offered quite similar Authentication and Authorisation major issues Final DASISH Meeting, November 2014, Gothenburg 22

Authentication and Authorisation Infrastructure DASs are free in choosing their AAI Risk on making silos of the various ESFRIs Development of Federated Identity Management for inter-ESFRI access Final DASISH Meeting, November 2014, Gothenburg 23

Cooperation in preservation Translate the US Data-Pass model European Digital Stewardship Alliance (EDSA) DASISH initiative? Final DASISH Meeting, November 2014, Gothenburg 24

PIDs PID-services for tracing datasets Making use of a PID-service is more important than the choice for a specific service Interoperability of the PID-services is crucial See PID-workshop in Cologne in December Final DASISH Meeting, November 2014, Gothenburg 25

Primary Designated Community Two distinguished communities: Community of Depositors Community of (re-)users of deposited datasets Only for the depositors a community may be defined Re-use of data may come to various disciplines, even the natural sciences Final DASISH Meeting, November 2014, Gothenburg 26

DASs requirements Minimum set of metadata for each dataset deposited Guarantee a minimum level of Trust: DSA Availability of deposit agreements Key focus: lack of access to data management guidelines (see also Task 4.4) Final DASISH Meeting, November 2014, Gothenburg 27

Working on Best Practices Willingness to implement guidelines and practices described in WP 4.2 Key issues: Mandatory deposit agreements Obligatory usage agreements Preservation on a higher level than just bitstream Improved training facilities Tailor-made approach is needed in setting up DASs Final DASISH Meeting, November 2014, Gothenburg 28

Relation with outcomes WP 4.1 Willingness to work on Trust DSA very popular (basic certification) DIN 31644/ISO seems to be a bridge too far Exception: DRI Final DASISH Meeting, November 2014, Gothenburg 29

Selecting High-Quality DASs Set of recommendations (requirements) defined in WP 4.2 hard to meet A number of DASs has made good progress A limited number of recommendations used in the selection process Final DASISH Meeting, November 2014, Gothenburg 30

Main selection criteria for high-quality DASs (as part of the DASs contacted for the questionnaire and the DADS in 4.2) Having met minimally the DSA criteria Availability of a preservation policy Clear deposit licences Clear usage licences Clear rights manegement Final DASISH Meeting, November 2014, Gothenburg 31

High-quality DASs: A. well-known DASs UKDACESSDA GESISCESSDA NSDCESSDA DANSCESSDA, CLARIN, DARIAH TLACLARIN Final DASISH Meeting, November 2014, Gothenburg 32

High-quality DASs: B. Other high-potentials I ADSUKDARIAH BASGerCLARIN; SHARE CSDACzechCESSDA; ESS Oxford Text Arch.UKCLARIN RODARom.CESSDA TextGridGerDARIAH Final DASISH Meeting, November 2014, Gothenburg 33

High-quality DASs: B. Other high-potentials II St. Beeld & Geluid NLCLARIN UFAL CzechCLARIN DDA DenmarkCESSDA DTARe GerCLARIN Final DASISH Meeting, November 2014, Gothenburg 34

Promising DAS ADPSlov.CESSDANo DSA yet DARISSwiCESSDA/ESS/SHARENo DSA; policies not clear RéseauFraCESSDA/ESS/SHARENo DSA yet Quetelet SLDRFraCLARIN; DARIAHNo DSA yet TarkiHunCESSDA; ESSNo DSA yet DRIEireCESSDA; DARIAHFully functional in 2015 Final DASISH Meeting, November 2014, Gothenburg 35

Ideas for further service improvement I Use PID-systems (see also report 5.1B) Take concrete steps on the development of a Federated Identity Management System (see also report 5.1A) Create a European Digital Stewardship Alliance Exchange of training modules developed within the 5 ESFRIs Final DASISH Meeting, November 2014, Gothenburg 36

Ideas for further service improvement II Use certification tools both for assessing the quality of DASs as for the setting up of new DASs Harmonise deposit agreements, guidelines, procedures and requirements Final DASISH Meeting, November 2014, Gothenburg 37

Concluding remarks Only the combination of the DADs (from 4.2) and the survey/interviews has made it possible to come to a useful description of the deposit services landscape We would like to thank all the new and existing deposit services for their contributions Final DASISH Meeting, November 2014, Gothenburg 38