Presentation is loading. Please wait.

Presentation is loading. Please wait.

DIS Working Group Report LBA Science Steering Committee Meeting Manaus – AM - Brazil November 28 a 30, 2007 Laurindo Campos (MCT/INPA) Luiz Horta (CPTEC)

Similar presentations


Presentation on theme: "DIS Working Group Report LBA Science Steering Committee Meeting Manaus – AM - Brazil November 28 a 30, 2007 Laurindo Campos (MCT/INPA) Luiz Horta (CPTEC)"— Presentation transcript:

1 DIS Working Group Report LBA Science Steering Committee Meeting Manaus – AM - Brazil November 28 a 30, 2007 Laurindo Campos (MCT/INPA) Luiz Horta (CPTEC)

2 Topics Data Registration / Archive Status Data Registration status for EU and BR teams System Updates Report on 20 th SSC Recommendations

3 LBA Data Registration Status

4 LBA Overall Status: Metadata Registered in Beija-flor N=781

5 LBA Overall Status: Data Volume Archived at LBA DIS

6 Metadata Registration Status by Component N=48 N=77 N=592 N=64 There are still data sets with unavailable or restricted data and several BR and BR-EU teams have only posters registered -- no data.

7 Data Set Documentation Documentation is part of the LBA metadata file for each data set Investigator uses the LBA Metadata Editor (LME) to add this information to existing metadata Documentation fields: Data Set Overview Data Characteristics Data Application and Derivation Quality Assessment Data Acquisition Materials and Methods References Metadata (w/ documentation) is exported as a Data Set User’s Guide for the archives

8 Data Documentation Status Number of documentation fields completed in metadata Should documentation be an LBA requirement ?

9 Data Preparation for Long-Term Archive Preliminary Documented Data Maturity Final Archive-ready Project Office responsibility Investigator responsibility (including documentation

10 Data Registration & Archive Ongoing tasks… Continue the analysis of data in archive but not registered -- theory was that much of the “missing” EU/BR & BR data may actually be archived but not registered

11 Data Registration & Archive Ongoing tasks, cont. Continue the effort to get registered data into the archive In May we received final data from one LBA-ECO Phase I team for which we never received preliminary data. Many early LBA projects (BR and BR/EU teams) have still not delivered data to LBA DIS. There may not be any way to identify all data that should be delivered to the archive: LBA-ECO has used publications as the guide. As LBA-ECO data sets become final, fully quality-assured data replaces preliminary data, and the data are documented and prepared for archive at the ORNL DAAC, these final data sets & documentation will be provided to LBA DIS as well.

12 Data Registration & Archive Ongoing tasks, cont. Increase in the number of data sets archived mainly due to data ‘chasing’ activity with positive result. DIS group has been using an automated process to identify and report all broken links of metadata records enabling the discovery of de-activated/off-line servers. The process makes multiple attempts to access each URL before reporting it as a broken link. Though the process is automated, it is a time-consuming, manual process to review the broken link report and either edit typo’s in the metadata that are causing the errors, or report actual broken links to the host web sites. Peter’s comment about LBA-ECO involvement in data chasing activities. Peter, please stand up and talk.

13 Number of files in LBA DIS Archive, by disk area TOTAL Nov 2005: 349.664 TOTAL May 2006: 361.766 TOTAL Apr 2007: 384.415 TOTAL Nov 2007: 498.283 Updated November 25, 2007 Increase in number of data sets archived -- > NOTE:Dar Robert’s data

14 System Updates We are PLEASED to announce that we DO have a LBA Data backup in place (external disk drive array with 2 Tera bytes in Raid-5). Followed short range solution recommended during last SSC meeting: –IMMEDIATE SOLUTION: purchased (2 units) of 2 Terabyte of disk for data backup only. Pursuing THE ideal solution – DAAC Brazil: –IDEAL SOLUTION: purchase another system to act as a server backup (data files + Beija-flor/LME backups) - Estimated cost for 2 units (node INPA and CPTEC): R$112.000,00

15 New LBA-DIS backup unit with 2 Tera bytes (RAID-5) (part of 20 th SSC recommentation) Immediate Solution implemented Nov 2007

16 New LBA-DIS backup unit with 2 Tera bytes (RAID-5)

17 New LBA-DIS backup unit with 2 Tera bytes (RAID-5) Installed at Central Office

18 Towards DAAC in Brazil based on Industry strength Data Server * HP Server DL380G5 * 2 Intel QUAD CORE E5335; * 4 GB of Memory PC2-5300; * 2 146GB 10K SAS 2.5 Hot Plug Hard; * 1 Slim 8X/24X DVD-ROM; * Redundant Fan and Power Supply; * Storage MSA20 * StorageWorks MSA20 * 12 HP 750GB 7.2k HP SATA 1 ====  9 TERA BYTES SCALABLE SYSTEM * Smart Array 6404/256 Controller Value : R$ 56.045,00 (Price for 1 system !!)

19 Publications Management

20 Acervo2004200520062007 (Nov) Total Livros /Folhetos180423256 Dissertações e Teses 28279163209 Separatas/Reprints273435112111931 Total3194662052061.196 Publications Available

21 Search Interface (under development)

22

23 Input data from LBA (indexed and gray literatures in PDF format) Input data from LBA- ECO (from NASA external reference manager) LBA-DIS FTP Site Library Database LBA-DIS backup area Data is treated following eight steps. LBA Publications Management Library Web Site Bibliopac http://biblioteca.inpa.gov.br/ Library at INPA Request Printed Material internet Library Users

24 Mo Porã: Um sistema gerenciador de repositórios distribuídos e colaborativos no ambiente científico da Amazônia. Kleberson Serique, Laurindo Campos & Jair Maia INPA/LBA

25 Evolução do Mo Porã para Portal Colaborativo Características deste portal colaborativo: –Formação da rede de sites Mo Porã: (versão 2)

26

27 Report on 20 th SSC Recommendations

28 Report on 20 th SSC Recommendations: 1. The LBA SSC recommends that replacement of the computers used as servers by the LBA DIS be a top priority for the LBA Central Office 2. The LBA SSC recommends that the LBA DIS continue to work on the project to make meta- data be searchable by Google and similar internet search engines and that DIS personnel report on their progress at the next meeting of the SSC.

29 Decisions expected: Back-up unit for LBA server (CPTEC and Manaus) Pre-LBA CDs to be produced Upgrade Infrastructure (Regional Offices - Hardware/Software)

30 Activities LBA DIS members are involved

31 CEOP ISSUES Jair Maia working with a team at INPA and Horta to develop a system to validate data to be submitted to CEOP. Manaus surface (sfc) ready to be sent to CEOP (as of Nov 27,2007). Other data sets data validation in process. NOTE: we are behind schedule on this effort but are moving ahead.

32 LBA Data submissions to CEOP during the last 6 months: Manaus –NIL Brasilia – NIL Rondonia – NIL Caxiuana –NIL Santarem –NIL Pantanal –NIL

33 Data Integration: Parcerias/Colaborações

34 Discussing Data Sharing and Data Policy with other Amazonian Institutions and initiatives BCDAM – Belém - PA Geotechnology Meeting WG - BSB WG Data Integration – São Luís PPBio & CTPetro Meeting - Belém BCDAM 2007 Meeting – São Luís CEOP Meeting - Paris

35 Thanks! CONTACT: Laurindo Campos – lcampos@inpa.gov.br Luiz M. Horta - horta@cptec.inpe.br


Download ppt "DIS Working Group Report LBA Science Steering Committee Meeting Manaus – AM - Brazil November 28 a 30, 2007 Laurindo Campos (MCT/INPA) Luiz Horta (CPTEC)"

Similar presentations


Ads by Google