Presentation on theme: "Using & Accessing Historian Data"— Presentation transcript:
1 Using & Accessing Historian Data Understanding the Proficy Historian and how to use the Excel Add-in to view plant dataStephen Friedenthal(w) / (m)
2 Agenda System Overview Excel Interface Wrap-up & questions Quick introduction to the Proficy HistorianGreenFuel system architectureExcel InterfaceInstallation and configurationBasic queries (to get our feet wet)A primer on data storageData retrieval modesAdvanced analysis and interactive spreadsheetsWrap-up & questionsPlus! A cool (?) bonus… a sample Excel report you can use when you’re done!
3 Introduction to the iHistorian Key featuresHigh-speed collection & retrieval (20k/sec)“Understands” time-series dataAble to provide time-based data aggregation (min, max, average, etc.)Data compression (“dead banding”)Robust data collection from plant floorEvent & time-driven calculations on historical dataNear real-time access to plant dataStore/add comments with data
4 Historian Introduction (cont’d) Additional FeaturesEasy-to-useTHE easiest to use, fastest to install and configure, and lowest maintenance historian available in the world today (really!)Information access is easy without requiring any specialized training, programming or database skillsSecurity, auditibility & traceabilitySecure, 21CFR11 compliant applicationUser & role-based security & 100% auditing 100% of the timeAnalysis and enterprise connectivityA fast, flexible, easy-to-use Client Tools include, Excel, web portal, Plant Applications™, SDK, and OLE DB
5 Why not use a Relational Database? RDBs are designed for transactional and business-oriented dataNot designed to store, retrieve and keep on-line the tremendous volumes of data generated from a plant or production facilityThey are very good at answering:What are my monthly sales by product and region?What are the costs associated with a batchVery poor at addressing basic “time-series” data :What was the hourly average/min/max for a tag – regardless of how often it was stored?Storing data only when a relevant change occursHow does the current batch compare against past performance?Keeping years of data on-line & readily available without impacting performanceSome vendors build their historian around a relational database, but these systems simply do not meet customer requirements. Relational databases are designed for transactional and business-oriented data, and they are very good at that. They are not designed to store, retrieve, and keep on-line the tremendous volumes of data generated from a plant or production facility.Relational databases are extremely good at answering questions such as “What are my monthly sales by product and region?”, “Which consumer locations have the highest sales volume per square foot?”, “Who are my most profitable customers?”, and more.However, when it comes to addressing the most basic plant information needs, they fail. Answering “What was the hourly average/min/max for a tag – regardless of how often it was stored?” or “How does the current batch compare against past performance?” are extremely difficult tasks. Trying to keep years of data on-line and readily available in a relational database is not practical and impacts performance. Further, a requirement is to be able to make all changes on-line without any stop and re-start. Doing this is difficult or impossible with relational databases.
6 Installing the Excel tool Getting StartedInstalling the Excel tool
7 How to install… Step 1: Insert the CD or run the network install 2. Go through the usual prompts and select the Excel add-in, then press Next..3. Enter the server name and continue with the setup. Example below connects to the server called, “NANO”
8 How to Configure Excel To add the iHistorian Excel “add-in”” Select “Tools”, from the menu bar, then “Add-ins”Select “Proficy Historian Add-in” and press OKNote: If you don’t see the Proficy Historian listed, search for the file, iHistorian.xla and then use the Browse button to select it.
9 Configuring Excel (cont’d) After selecting the add-in, Historian will be a new menu item on your toolbar whenever you start Excel.
10 Historian FunctionsAn overview of some of the thing you can do with the historian Excel add-in
11 A Quick Example – Search Tags A tag search lets you quickly find and display process variablesThis is usually the first step to retrieving data, since the data is accessed by the tag nameEx.:The tag name for a bio reactor CO2 monitor is GFAZ1.200_AE_245H.F_CVThis is then used to retrieve data
12 Performing a tag search 6 Easy StepsFirst, select Search Tags from the add-in menuEnter the search criteria for the tagname (blank for all)Select the tags for the reportSelect outputsType or select the spreadsheet locationPress OK
13 Historian Excel add-in functions Just as with the tag search, the add-in can be used to:Search TagsQuery Current ValuesQuery Calculated ValuesQuery Raw DataQuery Alarms & Events (NA for GreenFuel)Query Calculated DataQuery Filtered Data
14 Tag Search Purpose: To retrieve tag names, description, units, etc. Features:Search by tag name or descriptionDynamic searching by using a cell address vs. a string (i.e., cell A2 is used for the tag mask)
15 Advanced Tag SearchThe text in cell $B$2 is used to retrieve tag namesInstead of searching each time, just type a new entry in $B$2
16 Advanced Tag Search IIAfter you create a dynamic search based on tag name, you can edit the formula in Excel to add the tag description as a criteriaNotes:Tag name & description are a Boolean ANDBlank = AllWild card characters:* = ALL chars to right? = single character
17 But first… we need to learn a little about data storage Retrieving DataBut first… we need to learn a little about data storage
18 Time-series data storage conundrum Data is not typically stored at even intervals, but…We may need evenly spaced reports (e.g., hourly avg.)We need to know what the value is “now” even though new data may not have been stored for a long timeWe need a way to know “what happened” & when without looking at MB (or GB!) of dataRed marks are raw samples that were stored. (Note different intervals)
19 Historian data retrieval The historian “understands” the nature of the data and:When you ask for the “current value” it returns the last good value (even if it’s hours or days old)When you ask for evenly spaced samples it interpolates the raw data*When you ask for data in between real samples it gives the best interpolated result (e.g., if you ask for the maximum it will return an interpolated maximum)* Note that Lab data and Trend Sampling do not interpolate or smooth the data
20 Example: Retrieving current values Select Query Current Values from add-in menuEnter the tag names, or use a cell reference from the tag searchSelect outputs and location
23 Different ways to retrieve data Sampling ModesInterpolated – Just like it sounds, historian interpolates between raw samples and return results based on the time interval (e.g., every 30 min.) or number of samplesCalculated – Historian will perform one of several aggregate calculations (min., max., avg., etc.) on the data and return results (more on this in a bit)
24 More ways to retrieve data Lab – Strangely named, but Lab sampling returns “raw” values, evenly spaced by a user selected interval.For each interval it returns either (1) a raw sample that was stored at that time, or (2) the last good value that was storedVery useful when you don’t want any interpolation or smoothingPrimarily used to trend “raw data”, with evenly spaced samples to make nice charts
25 Lab sampling Example Lab Sampling, 5 Min. Interval Actual raw data storedTimeValue9:0025.09:0530.09:3115.5TimeValue9:0025.09:0530.09:109:159:209:259:309:3515.59:40
26 Trend SamplingTrend Sampling solves a problem that few realize is there, but can be critical: How do know that you are seeing all of the extrema of a process?Not necessarily an issue over short time periods with short retrieval intervals, but what about longer time periods?
27 Trend sampling Example Lab Sampling, 5 Min. IntervalActual raw data storedTimeValue9:0025.09:06125.09:1050.09:15TimeValue9:0025.09:059:1050.09:15See the problem??With 5 Minute sampling, we see a smaller peakWith 30 minute sampling we don’t see the peak at all!Lab Sampling, 30 Min. IntervalTimeValue9:0025.09:30
28 Trend sampling (cont’d) Trend sampling solves the dilemma by returning a High-Low pair for each time intervalTrend sample divides the interval in half and returns the high or low value (whichever occurred first) for the middle time sampleWe never miss a maximum or minimum extrema – regardless of the sample intervalAble to get a very good view of the process with only a small sample of data (e.g., review a year of data with month-long intervals)Note that the time of the min/max is NOT the actual time of the raw data
29 Historian calculation modes DescriptionAverageReturns the interpolated average of the data collected during the sample periodMinimumReturns the interpolated minimum value during sample periodMaximumReturns the interpolated maximum value during the sample periodStandard DeviationReturns the interpolated standard deviation of the data during the sample periodTotalReturns the integrated total of a process value based on a 24 hour sample period (e.g., calculate the total flow through a flow meter with a given flow rate) NOTE that this is NOT the same as adding up the raw values
30 Historian calculation modes DescriptionCountReturns the number of samples stored during the sample periodRaw AverageReturns the arithmetic average of the raw data stored during the sample periodRaw Standard DeviationReturns the actual, non-interpolated standard deviation of the data during the sample periodRaw TotalReturns the arithmetic total of the raw data stored during the sample periodTime of Minimum valueReturns the time of the minimum value
31 Historian calculation modes DescriptionTime of Maximum valueReturns the time of the maximum valueTime GoodReturns the total time in milliseconds that the data was of good quality during the sample period. Useful for calculating pump run times and the like
33 When you just want the beef Raw Data QueriesWhen you just want the beef
34 Raw Data QueriesRaw data queries let you access the raw, unfiltered dataVery fast, but some caveats:A typo can cause A LOT of data to be requestedExcel can’t handle more than 64,000 rowsBecause the source data is stored only on a change, raw data can be confusingYou may get no data back based on your start & end dates
35 Raw Data Query Options Options Select start & end dates (but you must select an output range large enough to hold the data)Select a time and ask for a number of samples forward or back from that point (you only need to select the first cell of the output range in this case)
37 Filtered Data QueriesFiltered queries let you retrieve data (lab, interpolated, calculation, or trend) for one or more tags, based upon the value of a different tagFor example, retrieve conductivity based upon pH or temperature
38 Filtered Data Query Menu Same as Query Calculated Data menuEnter the filter tag (e.g., algae temperature), and the condition (e.g., <= 90)
39 Create Tags, Import and Modify Data Administration functionsCreate, modify tag propertiesView on-line archives and storage statusData storage functionsExport data, import new data, modify stored data*, even add comments to stored dataAudit functionsExport and search audit trail, import new audit messages*But, don’t worry.. The original value is still retained