1.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® Metastorm PM4Data Managed File Transfer Chris Howarth chowarth@metastorm.com

2.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 2 Product History First developed as FTF/MQ in 1994 The first commercially available product for MQ IBM ISV of the year 3 times Currently version 8 300+ customers Previously CommerceQuest/MessageQuest Sold by IBM just like any WebSphere product Also sold as part of Metastorm BPM Suite

3.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 3 WebSphere Business Integration Reference Architecture Infrastructure Services Application and Data Access Services Business Application and Data Services Business Performance Management Services Business Application Services Process Services Information Services Development Platform Enterprise Applications and Data Interaction Services Partner Services ESB WMQWBIMBPM4DATA and PM4CICSWMQWBIC

4.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 4 B2B Interactions PM4Data is the File and Database Adapter for the Enterprise Service Bus Data Service Flow Existing Applications New Service Logic Portal Service SOAP Service Request (e.g. J2EE,.NET) Utilize MQ Messaging to access and provide managed transfer facilities for Files and Databases XML enable Files, Databases WMQ & XML Onramp

5.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® Metastorm What is PM4Data?

6.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 6 What isn’t PM4Data? PM4Data is not: –A simple F2M/M2F utility –An MQ file adapter –An FTP wrapper –A point solution

7.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 7 What is PM4Data? PM4Data is: –A high-performance, highly scalable solution for “managed” high volume data transfer of almost any type of data between two or more distributed heterogeneous systems (Managed File Transfer Solution). –A solution that leverages the award winning IBM transactional MOM (WebSphere MQ ®) for assured, high performance, reliable and secured asynchronous delivery of data. –A extendible, customizable, reliable and scalable foundation for a modern visible process-centric WMQ based data transfer & integration solution. –A powerful WBI companion and WMQ implementation accelerant tool –A WebSphere MQ and XML Power Tool.

8.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 8 Supported Platforms Mainframe z/OS (running OS/390, MVS or z/OS) Unix –AIX –HP-UX –Sun Solaris –Linux OS/400 (i5) Windows –NT, 2000, XP, 2003 HP (Tandem) NSK IBM 4690 Point of Sale System –Optional “Continuous Extract Facility” for TLOG Trickle Feed Both WebSphere MQ Client or Server supported

9.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 9 Features and Functions Summary High performance, secured, bulk data transfer solution that delivers real-time and batch File or Database Integration capabilities. Usability Eclipse® based Workbench IDE for developing and testing multiplatform integration Scripts & XML Policies Centralized management Built-in Status and Statistics Tracking Common multi-platform scripting language Web based Command/Control Center and Status User profile and access control File and Database Integration Service File Transfer request repository Interactive retry / fail selection of failed transfers Performance analysis reports and graphs Native multi-platform Interface TSO, JCL, Command, Message, Shell script, bat/cmd Directory Monitoring: Sense creation/arrival of file to initiate a file transfer Features Customizable process flows for end to end status tracking. Accelerates file and message based integration. XML-enabler (Files and Databases). XML Control interface. Distribution list for one-to-many transfers. Transfer list support for many-to-many transfers. Service-oriented architecture. Accelerates integration with IBM WMQ Broker Logical record processing SSL based data encryption (WMQ SSL) Policy driven I/O: File or Database to Message Message to File or Database Simple file extract, transfer, and load capabilities. Highly scalable, both in volume and platform capabilities Automated exception handling facility

10.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 10 –Central Registry Management and configuration artefacts –MQ Dashboard Easily Monitor Enterprise MQ load and Usage Daily Summary reports –Process Flow Editor to create customized Process Flows –JMX based Systems Management infrastructure JMX (Java Management Extensions) infrastructure and support –Web Browser Component Launcher Console LOG4J (STDOUT / STDERR) log management Email notifications for exception Alert Management integration to Tivoli Console PM4Data new features List in V8

11.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 11 Managed Data Movement Simplified Data Movement Scenario Target platform  Far more sophistication, reliability and performance than putting a data in a single message  Platform file differences handled automatically during transfer  Extended functionality with customizable exits  End-to-end data transfer visibility Source Platform Data broken into messages End-to-end detailed transfer status Messages received and assembled Message

12.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 12 PM4DATA Files, Databases and Queue Integration Simple Example Example –Source Data needs to be moved to one or more targets –This can be caused by application updates and sensed by PM4DATA –End-to-end visibility with Status and Notification or DB File Queue Data transfer request PM4Data New or Append file Database update or Queue PM4Data New file Database update or Queu e

13.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 13  Example –The Application makes a change –The update is detected and captured –One or more target systems are updated –With transformation in route inside the Message Broker –End-to-end visibility with Status and Notification Detect update immediately PM4Data Application File DB PM4Data IBM WBI Message Broker New or Append file Database update or Queue New or Append file Database update or Queue PM4DATA Files, Databases and Queue Integration Complex Example

14.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 14 Process Flow Editor Exception Handler Business Provides the “What needs to be done” Routing IT provides the “How it gets done” File Transfer as a sub Flow Activity

15.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 15 –Central HFS based Artifact Registries Eclipse Workbench IDE –Web Browser access for transfer request / policies Version and Change Control Support (CVS or similar product) Customized or template based Node configuration support Support for “Application” or “Project” level Registry Support for MQ / TCP and File based registry drivers Support for Registry chaining and search order control Emergency Application1 Application2 Application3 CommerceQuest Process XML Application1 Request Group2 Policies Programs XMScript Messages Group1 Search Order Physical Location “Registry Name” Typically used to group artifacts for a project or “Application” Registry Contents PM4Data Registry

16.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 16 Transfer Process Monitor Web Server support for: WebSphere, JBOSS (included) –Status –Component Configuration / Management (JMX) –Component Logs (LOG4J) Status display –End-to-End transfer status Access Control –User management, with roles & rights Transfer request management –Ping nodes –Create, save, and submit transfer requests –Transfer grouping –Distribution List Management –Directory monitoring

17.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 17 WMQ Dashboard WebSphere MQ Enterprise Dashboard –Component / Application Level Queue Statistics –Graphical views per Application / Queue –Daily Summary –Operational Views –Queue Content views –Problem determination aids. –Application Queue Grouping

18.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 18 Conclusion Satisfies Enterprise Managed File Transfer requirements Strategic Component of the Enterprise Service Bus Architecture Accelerates the On Demand Strategy

19.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® Metastorm Process Manager for Data Architecture Overview

20.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 20 PM4Data Architecture

21.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 21 Process Flow Manager (Coordinator) Request Message 1 Process Flow Definition 2 Initiating Application Process Flow Manager Business Process Definition Repository Asynchronous Workflow Enabled Component (response required) Asynchronous Workflow Enabled Component (NO response req) Synchronous In-line Workflow Enabled Service Program Or Shared Library Message 3 Response 4 Message 5 3 Response 4 Synchronous External Service, including WS, EJB Message Response 5 6 WBI Message Broker Status Tracking Audit Sub System

22.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 22 PM4Data Auditor Sub System Process Flow (Coordinator) Server MQ XML Status Datagram MQ XML Status Datagram MQ XML Status Query Request MQ XML Status Query Response Control Center JSP Application Apache Web Server DB2 Status Query Server Status Loader User Components

23.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® Metastorm PM4Data Components

24.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 24 Registry Service Stores transfer-related artifacts created in the Process Monitor –Transfer requests –Destination entries –Destination lists –Directory Monitor entries –Policies Object –Scripts –Process Flows –Message Object –Meta Data

25.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 25 Coordinator Service Directs all file-transfer activity –Receives transfer request in XML format from the PM4Data interface Process Coordinator Command Line XML Interface –Manages file transfers from end to end Sends transfer request to sending File Transfer Service (FTS) Uses XML to direct file transfer processing Receives status information back from the receiving FTS At least one must exist in the enterprise –More than one can exist in the enterprise –More than one can exist on a host

26.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 26 File Transfer Service (FTS) Can send and receive files, based on direction from the Coordinator –A single instance of the FTS can both send and receive files Each host that performs transfers must have at least one FTS –The FTS must have access to the source and destination file system Multiple instances of the FTS can run on one host –Typically, two instances of the FTS are placed on a host at installation –More instances of FTS can be added to provide additional throughput

27.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 27 Exit Service Responsible for running PM4Data exits Can be accessed from any exit point in the transfer process –Receives XML message directing execution –Contains name of script and entry point in script –Returns result element to PM4Data Uses XMScript modules –User can easily add additional methods Exits run at any node –Sender, Receiver, Process Coordinator –Pre-process, Post-process Multiple exits at any exit point –Exits can be chained

28.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 28 Auditor Service – Status Query Server Provides interface between the GUI interface and the status database –Process Monitor – web-based –Explorer – MMC-based Obtains status information for display

29.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 29 Auditor Service – Status Logger Provides interface between each component that reports status and the status database –Receives status information from the following components: Process Coordinator Sending FTS Receiving FTS Exit Service –Puts header and detail status information in the status database

30.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 30 User Service Provides interface between the Process Monitor web interface and the user database Manages user accounts for the web interface –Govern access to create and submit transfers and view status Typically only used in planning and administration

31.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® Metastorm Policy based I/O

32.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® 32 Why use policy based I/O? IssuesSolutionsBenefits Integration requires custom “glue” code at the end points. Describe end points or data stores with a policy. Improve time to market by replacing coding with configuration. Files are “familiar” and non- transactional, while databases, queues or other data targets require transactional properties for integration. Use file metaphor for all data targets including databases, queues, TCP/IP sockets, HTTP protocol. Bridge file based “legacy” applications with queue, database, or other data stores applications. File based integration requires costly operational support. A managed file transfer with flexibility for non-file based data stores. Simplifies development, without burdening operations.

33.  2005 Metastorm, Inc. Powering Enterprise Process Advantage ® Metastorm PM4Data Managed File Transfer Chris Howarth chowarth@metastorm.com