The Integrated Surface Hourly (ISH) Global Database ESDIM/OGP funded, FCC effort 2 QC phases thus far Full POR online via FTP, partial POR via CDO ISH is being renamed ISD – Integrated Surface Data, to reflect its usage in the Integrated Surface Data Processing System, and inclusion of hourly, daily, etc data

ISH Quality Control Phase 1 Data comparisons as part of merge process to ensure records are for same station-time Inventory system to ensure no data loss from beginning to end of process Test data to verify all software is working properly Random checks of “Version 1” output data Reprocessing as necessary

ISH Quality Control Phase 2 57 quality control algorithms (1 or multi-checks per algorithm, fully automated) Validity checks for all data fields Extreme value checks to eliminate gross errors Temporal continuity checks (2-sided) for elements such as temperature, dew point, wind, & pressure Internal consistency checks between elements Checks for several known systematic problems Test data verification Random checks of “Version 2” output data

The Results…. ~ 20,000 stations historically. As early as 1900 to present. Available data increases in 1948, and further increases in 1973.

Future Plans Place full period of record online in CDO--now have most recent data online ( Additional online capabilities, summaries, etc Integrated Surface Data Processing System—now in development for near real-time QC of all data Merge additional data sources into ISH Improve and enhance the metadata Phase 3 quality control: more sophisticated temporal checks, spatial checks, homogeneity adjustments, etc Partnerships with other agencies and groups

Data Access Via Climate Data Online System - Access for U.S. and global digital data - Surface hourly, daily, monthly, with others planned

Impacts/Issues Rapidly changing technology Hardware implementation and problems Adequate numbers and training of personnel Better communication across Divisions Adequate funding for the tasks at hand