D.I.R.T. Training, Module 2 Universal Front-End Loader (UFEL) Houston, TX, 3/31-4/1/05 DIRT Development Team

2 Training Goals Understand when/where to use UFEL Installation and Running Data Source Configuration Mapping source to DIRT format Data Generation and Validation Upload and management in Web tool

3 Introduction - What does it do? Diverse Data Sources –CSV, etc. from spreadsheets/db’s –Databases: Oracle/SQL Server Data Mapping –Constant and cross-reference values Automatic Updates –New columns, pick-list values, validation rules auto-updated

4 When to use Web or UFEL? Web: –registration –small org. damage reporting –ADL for bulk data already in DIRT format UFEL: –Existing/historical data sets –Orgs with existing damage report infrastructure

5 Startup Install Java: Start from UFEL page, linked from damagereporting.org site Choose Data Directory Login & Proxy Configuration

6 Data Source Configuration CSV: choose file, delims, 1st row settings Database: enter URL, username, password Connect Test Disconnect to change source

7 Data Source - Lab Exercise A. Visit Download your user’s *.tsv file In UFEL, Open File…, pick delimiter as *Comma*, set 1st line is *Start of Data*. Click Connect, then Test. Note data errors. Click Disconnect. Fix errors, click Connect, then Test Note data appears to be clean

8 Mapping Basic Concepts Suggested Process –Excel: open data set for viewing –Browser: open File Upload Spec Mapping Types –Null/Empty –Constant Value - freeform or choose –Source Column - for 1:1 agreement –Pick List - for values that differ between source and DIRT spec

9 Mapping - Lab Exercise B. Click Mapping button in UFEL, after lab exercise A. Look for pink-highlights, correct by choosing & configuring mapping –Refer to File Upload Spec web page Review all Null/Empty mappings Review all Pick List Mapping values –Use Spreadsheet for distinct data values –Use “*” for wildcard match –Use vertical bar (|) for alternates

10 Generate & Validate Reviewing validation errors Correcting errors in Mapping Re-running Generate & Validate

11 Upload Data Upload button Login to Web site –Browse File Uploads –Browse Damage Reports

12 Troubleshooting Proxy Servers –Different types of proxy servers –Demonstration of checking Firefox settings Log File: –Under Data Directory –“dirtfe.log” –May need to zip before ing

13 Wrap-Up Questions?