Human Systems Integration Metrics (HSI-Metrics) Training Documents Reports ~ Q W E R T Y U I O P { } | A S D F G H J K L : " Enter ; ' Z X C V B N M < > ? / Shift . , ESC 1 2 3 4 5 6 7 8 9 10 11 12 Insert Delete Scroll Print _ + \ ] [ Alt - = ` Tab HSI-Metrics Portal Web Services IBFT SPIDER COST TORIS Graphics Data Metrics

Introduction and Methodology The Human Systems Integration Metrics (HSIM) pilot project focuses on the data required to support the Human Systems Integration (HSI) elements of Command, Control, Communications, Computers and Combat Intelligence (C5I) training. HSIM will provide a Measures of Effectiveness (MOE) not now available by pulsing data from the Afloat Training Group Pacific (ATGPAC) Operational Readiness Hub. This data, along with data from Space and Naval Warfare (SPAWAR) sources, such as the Integrated Battle Force Training (IBFT) and the Enlisted Manpower Report (EMR) will be analyzed through Computer Aided Software Engineering (CASE) or similar process. The SPAWAR-PEO Integrated Data Environment & Repository (SPIDER) is SPAWAR’s secure web environment where the HSI-Metrics portal functions and resides. The HSIM Project is intended to demonstrate both the ability and utility of web services protocols to acquire and process information residing on multiple Department of Navy databases. It does this by providing a pilot web services based application (HSIM) intended for use by a subset of U.S. Navy data consumers. HSIM was designed to allow an Acquisition Program Manager responsible for a C5I system to view a metric reflecting the contribution of required training courses for the effective operation of that system. This specific application was chosen because it provided an answer to a question that is not currently supported by U.S. Navy databases and because it required the use of data from more than one U.S. Navy database.

Introduction and Methodology To form this metric for a particular system, HSIM uses data from three separate databases. First, the Training and Operational Readiness Information Services (TORIS) database, maintained by the ATGPAC provides a score for a sailor’s operation of the system. Second, the IBFT provides a list of the courses that the sailor took and that are related to the system. Third, because TORIS identifies sailors by pay rate, last name, and their assigned ship at the time of evaluation, the Enlisted Manpower Report (EMR) is used to identify the sailor in the TORIS database so that he can be found in the IBFT. Finally, training cost is the cost of the type of training per day times the actual number of days training provided. In the first step of the algorithm, the sailors found in the TORIS database who were evaluated on the requested system are identified and a score calculated from the data within TORIS. This data contains, for each system, the steps required to operate the system were completed and the amount of time taken by the sailor. The score is calculated by Dividing the number of steps completed by the sailor with the number of steps required and multiplying that by a weighting factor w1, Dividing the minimum amount of time expected to perform the tasks by the amount of time taken by the sailor and multiplying that by a weighting factor w2, And adding the quantities.The weighting factors are chosen by HSIM for each system to produce a maximum score of 100.The TORIS database does not identify sailors by Social Security Number (SSN) or a unique employment id. Rather, they are identified by their pay-grade, rate, last name, and the ship to which they are assigned when evaluated. In order to convert that information to an identifier that can by used to look up the sailor in the IBFT, the EMR is consulted to find their SSN so that can be used with the IBFT for the next step. The SSN is used internally while generating the report and is never made available to any user. The next step consults the IBFT to determine the training completed by the sailors at the time they were evaluated. Only training that the IBFT list as for the system is considered. Note that the IBFT table consulted holds all training courses related to a system, not just the training required. Thus, among a set of sailors operating a system, even if all have received the required training by the time they are evaluated, some sailors will have received additional training related to the system. The HSIM algorithms sorts the sailors into groups so that all sailors in a group have all received the same system related training. For each of these groups, an average and a median of their scores are calculated. To produce a metric reflecting the cost effectiveness of training, the average scores are divided by the cost of all the training they received. Finally, these results are displayed in a table, each row of which corresponds to one of the groups of identically trained sailors. The total training cost is the cost of the type of training per day times the actual number of days training provided. Other reports are available from the HSIM web site. They include lists of training available that related to a given system and lists of training that relate to any system on a given ship. These are described later in this document.

TABLE OF CONTENTS Human Systems Integration Metrics (HSI-Metrics) Introduction and Methodology Introduction Methodology Use of the HSI-Metrics System HSI-Metrics Portal: Opening Screen HSI-Metrics Portal: Obtaining an Account HSI-Metrics Portal: Logging On HSI-Metrics Portal: Selecting the HSI-Reports Menu HSI-Metrics Portal: Selecting Training Effectiveness HSI-Metrics Portal: Selecting the Ships System HSI-Metrics Portal: Selecting a Ship HSI-Metrics Portal: Selecting All Training Available to a System HSI-Metrics Portal: Selecting Course Details HSI-Metrics Portal: Selecting List of All Training Courses in the IBFT to a System or a Ship