1. NAPIS
Data
Update
Last week I talked about the CAPS Services Ecosystem today I will be focusing on the data, so taking a look from the macro last week and looking at the micro this week. So over the last decade there have been an expansion in the IT tools that support the CAPS system. During this same period the data elements have remained fairly consistent.
Describe NAPIS data
Data entry tools
Changes in content mostly around survey method
Data validation mechanisms
Before we go on – note the background – this is what NAPIS data looks like. NAPIS is code based.
This supports performance and data validation.
I remember the first time I saw NAPIS data. I was seriously bummed out.
While we appreciate the benefits of a code based system, we are aware of the steep learning curve for data minders.
We’ve been trying to minimize user exposure to raw data.
Some of the features that I will be describing were developed to help make interactions with NAPIS data more enjoyable and useful.

2. NAPIS Data Code based County level Summary option * Required
When
Where
How
What
Observation Date*
State County*
Funding Year*
Pest*
Observation Durationc
Latitude
Funding Source*
Pest Life Stage
Confirmation Datec+
Longitude
Survey Name*
Pest Status*
Process Dated
Site*
Survey Method*
Quantificationc
Crop Situationc
Trap & Lurec
Positive Unitsc
Who
Crop Life Stage
Sample Descriptionc
Biocontrol Target
Data Source*
Descriptor Unitsc
Diagnostic Labc+
Total Units Checkedc
Misc
User IDd
Confirmation Methodc+
Observation Number*
Notes
Code based
County level
Summary option
These are the 30 elements that may be stored in a NAPIS data record. I’ve categorized the data elements to make it a bit easier to talk about them without getting too down in the weeds.
The when and who are pretty cut and dried.
The where of NAPIS data is flexible – a state can choose to summarize survey results at the county level or to report a record for each survey location.
Latitude and longitude can be entered for a specific survey location.
Descriptions of the survey location; site and crop situation are also included in the where category.
The How of Survey has been where the most change has been occurring recently.
The funding fields were added since 2012 to sew the survey plans with survey data.
Survey methods underwent a significant shift when CPHST began to research and publish approved methods for pest surveillance.
A couple of survey method description fields have been added in the past year and a half as the
survey methods have been collapsed into general categories and the recording of survey methods brought into alignment with the approved methods.
The What focuses on the heart of survey, the target and the survey result – is it found or not.
Summarization elements: Total Units Checked, Positive Units. Example of
* Required
C Conditional requirement
d Database bookkeeping
+ Required Positive for Status

3. ‘My Survey’ Templates Survey Data Survey Planning
Source is Survey Summary form
‘My Survey’ templates link in Home menu
PSS/SSC supplements survey planning information.
Funding Year
Funding Source
Survey Name
Pest Code
Survey Method
Trap/Lure
Sample Description/x/y
Descriptor Units
As the number of data elements has increased over the past few years we’ve tried to minimize the impact on data entry.
‘My Survey’ templates prevent redundant data entry as well as code exposure.
Some of the information that you enter in the survey summary form is passed to the ‘My Survey’ templates, available under the Home menu.
The PSS or SSC supplements the survey planning information to prepare valid NAPIS records.

4. My Survey Templates NAPIS data entry templates
Data from from Survey Summary
Describe display
All surveys in Survey Summary excepting PPQ funded surveys.
Honey Bee Template – the Survey name is a link to a template that contains a row for each of the twenty-ish target pests.
Is this a model to expand to other survey bundles?
Templates for Program pest survey etc.
Karnal Bunt available
Another option for creating a custom template……

5. Add Record/ Create Template
Create a custom template
? - Data definitions
Code column
Label column
Validation column
Describe display
Create a custom template – this form is the same as is used to add a record.
? - Data definitions
Code column
Label column
Validation column
Strategy - populate unchanging or serial fields
When you have populated all needed – click ‘create excel template’

6. EXCEL Spreadsheets Easier than .csv –Order is everything
Column Headers
-Any order
Drawback
– Evil Spirts?
EXCEL Spreadsheets

7. Survey of Priority Pests vs. Pests of State Interest
CPHST researches survey methods, published in Approved Methods for Pest Surveillance.
Must use approved method to report negative data
Funded not Priority Pests
SSC researches survey method for pests of state concern.
In survey summary choose trap, sample or visual.
Survey of Priority Pests vs. Pests of State Interest
Priority Pests
CPHST researches survey methods, published in Approved Methods for Pest Surveillance.
Must use approved method to report negative data
Funded not Priority Pests
SSC researches survey method for pests of state concern.
In survey summary choose trap, sample or visual.

8. Survey Method Reconciliation
Seamless support of AMPS
Standard descriptor units
Data quality improvement
Trapping surveys January 2016
Sample surveys November 2016
Visual surveys February 2017

9. Survey Methods General Trapping (1) +Trap/Lure Descriptor Units: Traps
General Sample (4)
+Sample description x/y
Descriptor Units: Samples
General Visual (2)
+ Observation description
Descriptor Units: Locations
One Trapping
4 General Trapping + Cerceris
2 Visual
For Trapping surveys the Trap and Lure must be specified. Dictionaries.
For sample surveys the sample composition must be specified. Dictionary.
The descriptor units are standardized by procedure.
This makes summarization of survey more meaningful in the past a summary of total units checked could include records for plants, acres, orchards, stems.

10. Trapping Surveys Survey Method: General Trapping Procedure
+ Trap and Lure with dictionaries
Descriptor Units: Traps
Priority Pests validated against AMPS

11. Sample Surveys Survey Methods: + Sample description x/y
General Tissue Sample
General Soil Sample
General Specimen Collection Sample
General Water Sample
Cerceris Collection
+ Sample description x/y
Descriptor Units: Samples
Host required
Crop Situation required
Diagnostic elements required
Sample Surveys
Will you report negative data without collecting samples?
Yes It is a visual survey.
No It is a sample survey.
There has been some uncertainty about whether a survey is a visual or a sample survey.
Will you report negative data without collecting samples?
Yes It is a visual survey.
No It is a sample survey.
There are four general sample methods; Tissue sample, soil sample, specimen collection and water sample and
One specific sample procedure, Cerceris sample
Each general sample method requires a sample description.
3 piece madlib.
You can build it yourself or use the create a template – there is a mechanism.

12. Sample Description Dictionary values Sample Description x
Sample Description y

13. Visual Surveys Survey Methods: General Visual Observation
General Nursery Inspection
Descriptor Units: Locations
+ Observation description
Host required
Crop Situation required
A sample must be collected to report positive status.
Some ideas for Observation description:
10 plants from each of 10 sites
1 square meter from each of 10 Sites
Input please

14. Confirmation Method In 2016 transitioned from 5 digit code to
In the past, the ones digit in the Confirmation Method code was either a ‘1’ for positive data or a ‘0’ for negative data.
Our best guess is that this was a form of validation checking to use internal consistency to ensure that positive data was not entered in error.
Errors that arise from this internal check are fairly common, not because the pest status is in error, but because the confirmation method code was perhaps copied down a spreadsheet column.
We have implemented a number of external checks to ensure that erroneous positive data identified and corrected.
Data entry receipt.
Data entry .
Weekly data entry report – .
Data notifications.
Two weeks from data entry to publication on Pest Tracker to allow the external checks time to percolate.

15. To be present or Not to be present
Positive Survey
Report within 48 hours after confirmation|CAPS agreements
Pest must be reported at the species or sub-species level, exceptions may be found on “Data Entry Guides for Selected Taxonomic Groups” at
Host (site code) must be reported at the genus, species or sub-species level, with some exceptions
For 1st-ins, diseases and sample surveys must include diagnostic fields.
To be present or Not to be present
That is the pest detection question
The rules for reporting negative and positive data are different. This has generated some confusion.

16. Pest Status Found Established Established by Consensus
I had a recent question about the map colors for pest status. Paraphrase as ‘My SPRO and I occasional discussions about the map status’.
How should I enter the status to make the maps make sense?
Referred to data definitions, assignment of which requires judgement. In the 48 hours after a find (period for data entry after confirmation as per cooperative agreements) assignment of 'B', not known to be established (displayed in yellow on NAPIS maps with legend label 'found') may be the most prudent value.
Established by concensus. Use survey method 81Estabished by survey ‘+1A’001
Not found ‘-’
Found

17. Accomplishments Report Template
Dynamically generated .docx
Link under the Home menu item
State maps coming
Make SSCs aware of this Accomplishments Report template, available under the home menu.
It provides an optional framework for the final status report for your CAPS Cooperative Agreement.

18. AMPS Detail Data Sheet Useful? Data validation for: Target Pest
Survey Method
Trap
Lure
Validation:
For Trap and Lure
Or general survey method
Each data sheet contains standard sections.
General Information
Survey – approved method
Identification
References
Source for survey method validation
Useful?

19. Survey Summaries Data validation for funding fields; Funding Year
Fund Source
Survey Name
Target Pest
Validation:
Honey Bee

20. What might the future bring?
Additional validation options
Populate additional My Survey fields
What might the future bring?