DIS Working Group Report LBA Science Steering Committee Meeting Manaus – AM - Brazil November 28 a 30, 2007 Laurindo Campos (MCT/INPA) Luiz Horta (CPTEC)

Topics Data Registration / Archive Status Data Registration status for EU and BR teams System Updates Report on 20 th SSC Recommendations

LBA Data Registration Status

LBA Overall Status: Metadata Registered in Beija-flor N=781

LBA Overall Status: Data Volume Archived at LBA DIS

Metadata Registration Status by Component N=48 N=77 N=592 N=64 There are still data sets with unavailable or restricted data and several BR and BR-EU teams have only posters registered -- no data.

Data Set Documentation Documentation is part of the LBA metadata file for each data set Investigator uses the LBA Metadata Editor (LME) to add this information to existing metadata Documentation fields: Data Set Overview Data Characteristics Data Application and Derivation Quality Assessment Data Acquisition Materials and Methods References Metadata (w/ documentation) is exported as a Data Set User’s Guide for the archives

Data Documentation Status Number of documentation fields completed in metadata Should documentation be an LBA requirement ?

Data Preparation for Long-Term Archive Preliminary Documented Data Maturity Final Archive-ready Project Office responsibility Investigator responsibility (including documentation

Data Registration & Archive Ongoing tasks… Continue the analysis of data in archive but not registered -- theory was that much of the “missing” EU/BR & BR data may actually be archived but not registered

Data Registration & Archive Ongoing tasks, cont. Continue the effort to get registered data into the archive In May we received final data from one LBA-ECO Phase I team for which we never received preliminary data. Many early LBA projects (BR and BR/EU teams) have still not delivered data to LBA DIS. There may not be any way to identify all data that should be delivered to the archive: LBA-ECO has used publications as the guide. As LBA-ECO data sets become final, fully quality-assured data replaces preliminary data, and the data are documented and prepared for archive at the ORNL DAAC, these final data sets & documentation will be provided to LBA DIS as well.

Data Registration & Archive Ongoing tasks, cont. Increase in the number of data sets archived mainly due to data ‘chasing’ activity with positive result. DIS group has been using an automated process to identify and report all broken links of metadata records enabling the discovery of de-activated/off-line servers. The process makes multiple attempts to access each URL before reporting it as a broken link. Though the process is automated, it is a time-consuming, manual process to review the broken link report and either edit typo’s in the metadata that are causing the errors, or report actual broken links to the host web sites. Peter’s comment about LBA-ECO involvement in data chasing activities. Peter, please stand up and talk.

Number of files in LBA DIS Archive, by disk area TOTAL Nov 2005: TOTAL May 2006: TOTAL Apr 2007: TOTAL Nov 2007: Updated November 25, 2007 Increase in number of data sets archived -- > NOTE:Dar Robert’s data

System Updates We are PLEASED to announce that we DO have a LBA Data backup in place (external disk drive array with 2 Tera bytes in Raid-5). Followed short range solution recommended during last SSC meeting: –IMMEDIATE SOLUTION: purchased (2 units) of 2 Terabyte of disk for data backup only. Pursuing THE ideal solution – DAAC Brazil: –IDEAL SOLUTION: purchase another system to act as a server backup (data files + Beija-flor/LME backups) - Estimated cost for 2 units (node INPA and CPTEC): R$ ,00

New LBA-DIS backup unit with 2 Tera bytes (RAID-5) (part of 20 th SSC recommentation) Immediate Solution implemented Nov 2007

New LBA-DIS backup unit with 2 Tera bytes (RAID-5)

New LBA-DIS backup unit with 2 Tera bytes (RAID-5) Installed at Central Office

Towards DAAC in Brazil based on Industry strength Data Server * HP Server DL380G5 * 2 Intel QUAD CORE E5335; * 4 GB of Memory PC2-5300; * 2 146GB 10K SAS 2.5 Hot Plug Hard; * 1 Slim 8X/24X DVD-ROM; * Redundant Fan and Power Supply; * Storage MSA20 * StorageWorks MSA20 * 12 HP 750GB 7.2k HP SATA 1 ====  9 TERA BYTES SCALABLE SYSTEM * Smart Array 6404/256 Controller Value : R$ ,00 (Price for 1 system !!)

Publications Management

Acervo (Nov) Total Livros /Folhetos Dissertações e Teses Separatas/Reprints Total Publications Available

Search Interface (under development)

Input data from LBA (indexed and gray literatures in PDF format) Input data from LBA- ECO (from NASA external reference manager) LBA-DIS FTP Site Library Database LBA-DIS backup area Data is treated following eight steps. LBA Publications Management Library Web Site Bibliopac Library at INPA Request Printed Material internet Library Users

Mo Porã: Um sistema gerenciador de repositórios distribuídos e colaborativos no ambiente científico da Amazônia. Kleberson Serique, Laurindo Campos & Jair Maia INPA/LBA

Evolução do Mo Porã para Portal Colaborativo Características deste portal colaborativo: –Formação da rede de sites Mo Porã: (versão 2)

Report on 20 th SSC Recommendations

Report on 20 th SSC Recommendations: 1. The LBA SSC recommends that replacement of the computers used as servers by the LBA DIS be a top priority for the LBA Central Office 2. The LBA SSC recommends that the LBA DIS continue to work on the project to make meta- data be searchable by Google and similar internet search engines and that DIS personnel report on their progress at the next meeting of the SSC.

Decisions expected: Back-up unit for LBA server (CPTEC and Manaus) Pre-LBA CDs to be produced Upgrade Infrastructure (Regional Offices - Hardware/Software)

Activities LBA DIS members are involved

CEOP ISSUES Jair Maia working with a team at INPA and Horta to develop a system to validate data to be submitted to CEOP. Manaus surface (sfc) ready to be sent to CEOP (as of Nov 27,2007). Other data sets data validation in process. NOTE: we are behind schedule on this effort but are moving ahead.

LBA Data submissions to CEOP during the last 6 months: Manaus –NIL Brasilia – NIL Rondonia – NIL Caxiuana –NIL Santarem –NIL Pantanal –NIL

Data Integration: Parcerias/Colaborações

Discussing Data Sharing and Data Policy with other Amazonian Institutions and initiatives BCDAM – Belém - PA Geotechnology Meeting WG - BSB WG Data Integration – São Luís PPBio & CTPetro Meeting - Belém BCDAM 2007 Meeting – São Luís CEOP Meeting - Paris

Thanks! CONTACT: Laurindo Campos – Luiz M. Horta -