NAPIS Data Update Last week I talked about the CAPS Services Ecosystem today I will be focusing on the data, so taking a look from the macro last week and looking at the micro this week. So over the last decade there have been an expansion in the IT tools that support the CAPS system. During this same period the data elements have remained fairly consistent. Describe NAPIS data Data entry tools Changes in content mostly around survey method Data validation mechanisms Before we go on – note the background – this is what NAPIS data looks like. NAPIS is code based. This supports performance and data validation. I remember the first time I saw NAPIS data. I was seriously bummed out. While we appreciate the benefits of a code based system, we are aware of the steep learning curve for data minders. We’ve been trying to minimize user exposure to raw data. Some of the features that I will be describing were developed to help make interactions with NAPIS data more enjoyable and useful.

NAPIS Data Code based County level Summary option * Required When Where How What Observation Date* State County* Funding Year* Pest* Observation Durationc Latitude Funding Source* Pest Life Stage Confirmation Datec+ Longitude Survey Name* Pest Status* Process Dated Site* Survey Method* Quantificationc   Crop Situationc Trap & Lurec Positive Unitsc Who Crop Life Stage Sample Descriptionc Biocontrol Target Data Source* Descriptor Unitsc Diagnostic Labc+ Total Units Checkedc Misc User IDd Confirmation Methodc+ Observation Number* Notes Code based County level Summary option These are the 30 elements that may be stored in a NAPIS data record. I’ve categorized the data elements to make it a bit easier to talk about them without getting too down in the weeds. The when and who are pretty cut and dried. The where of NAPIS data is flexible – a state can choose to summarize survey results at the county level or to report a record for each survey location. Latitude and longitude can be entered for a specific survey location. Descriptions of the survey location; site and crop situation are also included in the where category. The How of Survey has been where the most change has been occurring recently. The funding fields were added since 2012 to sew the survey plans with survey data. Survey methods underwent a significant shift when CPHST began to research and publish approved methods for pest surveillance. A couple of survey method description fields have been added in the past year and a half as the survey methods have been collapsed into general categories and the recording of survey methods brought into alignment with the approved methods. The What focuses on the heart of survey, the target and the survey result – is it found or not. Summarization elements: Total Units Checked, Positive Units. Example of * Required C Conditional requirement d Database bookkeeping + Required Positive for Status

‘My Survey’ Templates Survey Data Survey Planning Source is Survey Summary form ‘My Survey’ templates link in Home menu PSS/SSC supplements survey planning information. Funding Year Funding Source Survey Name Pest Code Survey Method Trap/Lure Sample Description/x/y Descriptor Units As the number of data elements has increased over the past few years we’ve tried to minimize the impact on data entry. ‘My Survey’ templates prevent redundant data entry as well as code exposure. Some of the information that you enter in the survey summary form is passed to the ‘My Survey’ templates, available under the Home menu. The PSS or SSC supplements the survey planning information to prepare valid NAPIS records.

My Survey Templates NAPIS data entry templates Data from from Survey Summary Describe display All surveys in Survey Summary excepting PPQ funded surveys. Honey Bee Template – the Survey name is a link to a template that contains a row for each of the twenty-ish target pests. Is this a model to expand to other survey bundles? Templates for Program pest survey etc. Karnal Bunt available Another option for creating a custom template……

Add Record/ Create Template Create a custom template ? - Data definitions Code column Label column Validation column Describe display Create a custom template – this form is the same as is used to add a record. ? - Data definitions Code column Label column Validation column Strategy - populate unchanging or serial fields When you have populated all needed – click ‘create excel template’

EXCEL Spreadsheets Easier than .csv –Order is everything Column Headers -Any order Drawback – Evil Spirts? EXCEL Spreadsheets

Survey of Priority Pests vs. Pests of State Interest CPHST researches survey methods, published in Approved Methods for Pest Surveillance. Must use approved method to report negative data Funded not Priority Pests SSC researches survey method for pests of state concern. In survey summary choose trap, sample or visual. Survey of Priority Pests vs. Pests of State Interest Priority Pests CPHST researches survey methods, published in Approved Methods for Pest Surveillance. Must use approved method to report negative data Funded not Priority Pests SSC researches survey method for pests of state concern. In survey summary choose trap, sample or visual.

Survey Method Reconciliation Seamless support of AMPS Standard descriptor units Data quality improvement Trapping surveys January 2016 Sample surveys November 2016 Visual surveys February 2017

Survey Methods General Trapping (1) +Trap/Lure Descriptor Units: Traps General Sample (4) +Sample description x/y Descriptor Units: Samples General Visual (2) + Observation description Descriptor Units: Locations One Trapping 4 General Trapping + Cerceris 2 Visual For Trapping surveys the Trap and Lure must be specified. Dictionaries. For sample surveys the sample composition must be specified. Dictionary. The descriptor units are standardized by procedure. This makes summarization of survey more meaningful in the past a summary of total units checked could include records for plants, acres, orchards, stems.

Trapping Surveys Survey Method: General Trapping Procedure + Trap and Lure with dictionaries Descriptor Units: Traps Priority Pests validated against AMPS

Sample Surveys Survey Methods: + Sample description x/y General Tissue Sample General Soil Sample General Specimen Collection Sample General Water Sample Cerceris Collection + Sample description x/y Descriptor Units: Samples Host required Crop Situation required Diagnostic elements required Sample Surveys Will you report negative data without collecting samples? Yes It is a visual survey. No It is a sample survey. There has been some uncertainty about whether a survey is a visual or a sample survey. Will you report negative data without collecting samples? Yes It is a visual survey. No It is a sample survey. There are four general sample methods; Tissue sample, soil sample, specimen collection and water sample and One specific sample procedure, Cerceris sample Each general sample method requires a sample description. 3 piece madlib. You can build it yourself or use the create a template – there is a mechanism.

Sample Description Dictionary values Sample Description x Sample Description y

Visual Surveys Survey Methods: General Visual Observation General Nursery Inspection Descriptor Units: Locations + Observation description Host required Crop Situation required A sample must be collected to report positive status. Some ideas for Observation description: 10 plants from each of 10 sites 1 square meter from each of 10 Sites Input please

Confirmation Method In 2016 transitioned from 5 digit code to In the past, the ones digit in the Confirmation Method code was either a ‘1’ for positive data or a ‘0’ for negative data. Our best guess is that this was a form of validation checking to use internal consistency to ensure that positive data was not entered in error. Errors that arise from this internal check are fairly common, not because the pest status is in error, but because the confirmation method code was perhaps copied down a spreadsheet column. We have implemented a number of external checks to ensure that erroneous positive data identified and corrected. Data entry receipt. Data entry email. Weekly data entry report – email. Data notifications. Two weeks from data entry to publication on Pest Tracker to allow the external checks time to percolate.

To be present or Not to be present Positive Survey Report within 48 hours after confirmation|CAPS agreements Pest must be reported at the species or sub-species level, exceptions may be found on “Data Entry Guides for Selected Taxonomic Groups” at http://caps.ceris.purdue.edu/resources Host (site code) must be reported at the genus, species or sub-species level, with some exceptions For 1st-ins, diseases and sample surveys must include diagnostic fields. To be present or Not to be present That is the pest detection question The rules for reporting negative and positive data are different. This has generated some confusion.

Pest Status Found Established Established by Consensus I had a recent question about the map colors for pest status. Paraphrase as ‘My SPRO and I occasional discussions about the map status’. How should I enter the status to make the maps make sense? Referred to data definitions, assignment of which requires judgement. In the 48 hours after a find (period for data entry after confirmation as per cooperative agreements) assignment of 'B', not known to be established (displayed in yellow on NAPIS maps with legend label 'found') may be the most prudent value. Established by concensus. Use survey method 81Estabished by survey ‘+1A’001 Not found ‘-’ Found

Accomplishments Report Template Dynamically generated .docx Link under the Home menu item State maps coming Make SSCs aware of this Accomplishments Report template, available under the home menu. It provides an optional framework for the final status report for your CAPS Cooperative Agreement.

AMPS Detail Data Sheet Useful? Data validation for: Target Pest Survey Method Trap Lure Validation: For Trap and Lure Or general survey method Each data sheet contains standard sections. General Information Survey – approved method Identification References Source for survey method validation Useful?

Survey Summaries Data validation for funding fields; Funding Year Fund Source Survey Name Target Pest Validation: Honey Bee

What might the future bring? Additional validation options Populate additional My Survey fields What might the future bring?