Presentation on theme: "SolidWorks Enterprise PDM Data Loading Strategies"— Presentation transcript:
1 SolidWorks Enterprise PDM Data Loading Strategies Marc Young, CEOxLM Solutions, LLC
2 SolidWorks Enterprise PDM Data Loading Strategies Strategies to ease the migration pain…Loading, or migrating, data into EPDM can be a daunting task…With diligent planning and thorough testing, the process can go smoothly
3 SolidWorks Enterprise PDM Data Loading Strategies Data Clean-up and Process ReviewData FormatsData Loading RulesMigration Cost Estimation1. Pre-Migration Data AnalysisManual ProcessingEPDM Import and Export ToolsCustom Scripts (executables, add-ins, etc)Combined Manual Processing and Custom ScriptingPre-Developed Data Migration Programs2. Data Loading OptionsTesting the Migration ProcessData VerificationPre-Data Load PlanningProduction Data Load3. Execution
4 Analyze the Data to be Loaded Data AnalysisAnalyze the Data to be LoadedDetermine legacy data nature and locationFile-/Folder-basedLegacy systems (databases, vaults, etc.)Hard copy (e.g., aperture cards)Type of data: CAD (with internal links), office, etc.Anticipate data access issuesAll sources available?Third-party systems accesses?Additional experts?Additional resources?Is CAD data conversion needed?e.g., ProE → SolidWorksData volume and estimated time to loadWill/Can downtime be scheduled for data loading?
5 Analysis Data Clean-Up Opportunity for Data Clean-UpTypically involves human intelligenceMay be time consumingMay not be worthwhile
6 Analysis Data Clean-Up What types of data clean-up are required?Duplicated part numbers per fileDuplicated file namesMissing or incorrect file attributesMissing or incorrect file associations or linksFile revision not currentNon-current parts in current assembliesNon-compliance or old revision/versioning schemeValidate data accuracy
7 Analysis Process Reviews and Updates An opportunity to review business processesOpportunity to evaluate and update user experiencesImportant: new changes to the underlying data model must be verified with the migration processes
8 Analysis Data Formats CAD Data CAD Data File-basedTypically has relationships among filesAttributes and properties contained within the fileMeta Data to be Loaded or AddedText description of data external to the associated (CAD) fileUsersEstablish a list of users that needs to be loaded into the systemDetermine and collect the information required for each userManually create or import the user informationImport by automationImport from existing Active DirectoryListsCombined DataCAD data with embedded relationships; but…Attributes and properties reside outside of the CAD filee.g., in an Excel spreadsheetConstruct a link between the CAD file and attribute dataCAD DataMeta Data to be Loaded or AddedCombined Data
9 Analysis Determine the Data Loading Rules What are the rules to determine where the data goes?How will data fields be mapped from legacy system to EPDM?What state(s) will the data be loaded to?Will the data be linked to other PDMWE data?How to handle the cases with missing data?Which data revision to load: latest or full history?Should the data be located in a folder?Should a folder be automatically created for the data?Text, serial number, special values (date, time stamp, etc.)If so, what is the ruleset?If a full data history is desired, determine how the revision history is maintained in the legacy system
10 Analysis – Effort and Cost Estimations Data Load Project Cost QuantificationTime (data loading tools development and testing)PriceResources involvedImpact of downtime for users
11 SolidWorks Enterprise PDM Data Loading Strategies Data Clean-up and Process ReviewData FormatsData Loading RulesMigration Cost Estimation1. Pre-Migration Data AnalysisManual ProcessingEPDM Import and Export ToolsCustom Scripts (executables, add-ins, etc)Combined Manual Processing and Custom ScriptingPre-Developed Data Migration Programs2. Data Loading OptionsTesting the Migration ProcessData VerificationPre-Data Load PlanningProduction Data Load3. Execution
12 Data Loading Options Manual Processing – Load Data as Needed Legacy SystemEPDMUpdate/Verify Attributes:Part no.RevisionDescriptions…ReadWriteExecute
13 Data Loading Options Manual Processing – Load Data as Needed ProsProsEliminates migration software development cost and timeData is manually verified during the process forValid and correct intra- and inter-file relationships (e.g., drawing is linked to the latest revision of model)Updated attributes (part number, revision, descriptions, etc.)ConsNeed to maintain two PDM systems for an extended period of timeConfusion in data physical locationIncreased processing time for the user in organizing and moving file(s)Only the latest revision is migrated into EPDMCons
14 Data Loading Options Manual Processing – Drag-and-Drop EPDMConditionsMigration approach is limited to pre-defined variable mappings with consistent data propertiesSolidWorks, Inventor, AutoCAD, PROEAlternatively, perform queries and check-in returned results
15 Data Loading Options Manual Processing – Drag-and-Drop ProsSimple method to load data, with minimal time consumptionConsOnly latest data revisions can be loadedEPDM data attributes must already exist in legacy file propertiesAssumes valid CAD references and that they reside properly in the respective EPDM folder(s).May become complicated if a large number of folders need to be loaded and/or the legacy folders contain corrupted dataProsCons
16 Update/Verify Attributes: Data Loading Options Combined Load Data as Needed and Drag-and-Drop ApproachEPDMLegacy SystemLegacy FolderReadWriteExecuteUpdate/Verify Attributes:Part no.RevisionDescriptions…ReadWriteExecuteProduction Folder(s)
17 Data Loading Options Combined Load Data as Needed and Drag-and-Drop Approach ProsA single location for all data accesses and searchesConsData copied from the Legacy Folder to Production Folder are disassociated (no revision history between the two data versions)Still a manual process in moving the filesProsCons
18 Data Loading Options EPDM Import and Export Tools EPDM Import and Export tools – Originally developed for communicating with other enterprise applications such as ERP/MRP systemsImport tool can also be used to import or update data in EPDM for migration purposesSolidWorks plans to expand the tools to become the main conduits for importing and exporting data for EPDMDescriptions on the Import and Export tools as well as the associated XML format are in pages of the PDMWorks help manual
19 Data Loading Options EPDM Import and Export Tools ProsCan update attribute information with minimal to no codingAttributes are updated using built-in EPDM functionalitiesConsAt present, an Import can only be triggered from a workflow trigger eventDifficult to update revision historyProsCons
20 Data Loading Options EPDM Import and Export Tools – An Import Example Drag-and-drop the legacy files into EPDMUse the export tool to create the base XML fileModify the XML file with legacy attribute informationRun import tool to update EPDM with the legacy attribute informationExample…
21 Data Loading Options Overview of Custom Scripts and Programs Best suited for larger data volume migrationsManipulates both meta data and data files simultaneouslyData relationships and links may be created programmatically in the systemSupports custom logging and error handlingHighly suitable for implementing complex data load scenariosSupports all data loading rulesBest suited for larger data volume migrationsManipulates both meta data and data files simultaneouslyData relationships and links may be created programmatically in the systemSupports custom logging and error handlingHighly suitable for implementing complex data load scenariosSupports all data loading rulesSupports all data loading rulesDynamic determination of target data directoryModification of incoming data based on existing data in the systemMay optionally reformat the data before entering into EPDMAllows updating the revision number and workflow state of the data if the entire data history is importedetc.
22 Data Loading Options EPDM Custom Script Tool Examples of Custom Script FunctionsDefine target folder structureAutomate variable mappingsChange and increase the data revision number programmatically if full history is importedCreate links among filesLoad data from legacy databasesAnd more…A Scripting ExampleGiven a set of legacy folders containing files with multiple revisionsEach file name contains attribute informationExcel files should go into a Manufacturing folderWord documents should go into an Engineering folderAll files are to be loaded in “Release State”Examples of Custom Script FunctionsA Scripting Example
23 Data Loading Options Pre-Developed Data Migration Tools Requires a basic, one-time configurationWhen properly configured, tool execution requires no operator interventionMost tools support fullMigration of revision historyAttribute mappingsEvents loggingAnd more…Existing toolsPDMWorks Workgroup Enterprise PDM (www.solidworks.com)SmarTeam Enterprise PDM (www.xlmsolutions.com)Pro/Intralink Enterprise PDM (in progress?)
24 SolidWorks Enterprise PDM Data Loading Strategies 1. Pre-Migration Data AnalysisData Clean-up and Process ReviewData FormatsData Loading RulesMigration Cost Estimation2. Data Loading OptionsManual ProcessingEPDM Import and Export ToolsCustom Scripts (executables, add-ins, etc)Combined Manual Processing and Custom ScriptingPre-Developed Data Migration Programs3. ExecutionTesting the Migration ProcessData VerificationPre-Data Load PlanningProduction Data Load
25 Execution Testing the Migration Process Test the migration process!!!Mitigate all discovered issuesLegacy data issuesMissing data filesOrphan links and/or blank fieldsInconsistent legacy data such as revision schemaBad formatsE.g., Attempts to load characters into integer fieldsClass determination rules failRepairing the legacy dataManual clean-upChange data load rules (i.e., change the code)Modify the EPDM data model to better accommodate the legacy dataBug(s) in the migration tool codeData loading procedural issuese.g., failure to delete all files with a creation date before 12/31/1999Document the migration procedure or update the tool to automate the migration processTest again!!!
26 Execution Data Verification Crucial to implement a data verification strategyAnalyze migration process log filesSpot-check dataRandomly verify the data objects loadedCheck at least 10% of dataUser validation (done through testing with the pilot system) – an important part of the verification processUser validations >> IT/CAD administrators sign-offsDevelop a tool to compare and analyze the data in EPDM and legacy system(s)Verify the number of records between systemsEnsure pertinent fields and data are preserved in both systems
27 Execution Pre-Data Load Planning When will the legacy system be turned off?How long will it take to load the data?Will the data loading occur during non- business hours?Specify the data load process:What are the required pre-data loading activities/events?e.g., legacy data clean-upDocument the data load sequencePopulate the lookup tablesImport users before documentsImport projects and documents, followed by the associated linksCreate references to class dataIdentify personnel responsible for the various parts of the data load process
28 Execution Final Data Load With proper planning and testing, the final data load process “should” go smoothlyAdvices:Follow the documented proceduresAllocate buffer time for unexpected issuesPrepare to support users in the new system
29 SolidWorks Enterprise PDM Data Loading Strategies Thank you!Questions?Script example shown is available at:Marc YoungxLM Solutions, LLC.