New Capabilities for SDMS: Entity Data Loader Presenter: John Evans
Current Entity Loader Has worked well Many features Can insert, update, or both Allows entities to have unique locations and/or projects Supports XLS, XLSX, and tab-delimited TXT files Barcodes assigned sequentially down the data file Data file attached to all created/updated entities Can assign barcodes and/or names for created entities
Why a New Version? Customer feedback/requests Internal innovation
What’s New? All features previously listed still supported, plus: Mapping file allows flexible data file formats across all entity types Support for instrument files without re-formatting exported file Create multiple entity types with one file Create new entity to associate to as well as the association itself Can use regular expressions to check valid format on data types Supports more file formats as well as multiple worksheets in Excel Parsing feature provides more feedback to fix and prevent errors Load files manually or hook up to jobs for scheduled, automated loading Updates support integrity lookup Multi-threading option to increase performance
New Workflow Create/modify XML mapping file Create new DATA LOADER entity Load XML mapping file Load data file Manual load Automated load through SDMS Optional parse to check for errors Repeat as desired
XML Mapping File Defines data file to the LIMS Created with any editor from scratch Modified from existing maps (more likely)
Parsing Apply the XML mapping file to your data file without making changes More detailed error messages Test your map Multithreading
Loading Manual using Create File button Connect to file system job
EDI File EDI entity created Data file attached Status Log
Examples #1: Simple create #2: Simple update
XML Mapping File Options General Options Type (PLAINTEXT, MSEXCEL) Command (INSERT, UPDATE, UPSERT) Start/end/sheet Attribute Options Patterns (for dates) Datatype (DECIMAL, FLOAT, INT, STRING, BOOLEAN,DATE, DATETIME, TIMESTAMP, CURRENCY, and PERCENT) Valid/Invalid Between Regex (example to check for email: ^\\w+[\\w-\\.]*\\@\\w+((-\\w+)|(\\w*))\\.[a-z]{2,3}$)) Identifier (mark this attribute to find entities) AssociatedTo/AssociationContext
Examples #3: Advanced create
Questions? Questions? Challenge Examples 4 & 5 Thank you!