Presentation is loading. Please wait.

Presentation is loading. Please wait.

MITRE Intelligent Decision and Training Systems An Assessment of ITO Projects for Potential ISO Transition: Preliminary Leo Obrst, Ph.D. July 24, 1998.

Similar presentations


Presentation on theme: "MITRE Intelligent Decision and Training Systems An Assessment of ITO Projects for Potential ISO Transition: Preliminary Leo Obrst, Ph.D. July 24, 1998."— Presentation transcript:

1 MITRE Intelligent Decision and Training Systems An Assessment of ITO Projects for Potential ISO Transition: Preliminary Leo Obrst, Ph.D. July 24, 1998

2 2 09/10/97 10:08 AM MITRE Outline l Background l Assessment Approach l Presentation of results l Conclusions

3 3 09/10/97 10:08 AM MITRE Background l In 1997, MITRE reviewed the ITO Human Systems Integration area l In 1998, MITRE asked to review the following areas of the ITO research program: –CORBA-related projects in all of ITO but focusing on Quorum (C&N) –Other Quality of Service projects in Quorum –Intelligent Systems & Software: l Evolutionary Design of Complex Software (EDCS) –Computing & Networking: l Global Mobile Information Systems (GloMo) l Quorum Evolutionary Design of Complex Software GloMo CORBA: Quorum & QoS CORBA:Other Computing & Networking CORBA:Other Intelligent Systems & Software

4 4 09/10/97 10:08 AM MITRE Reason for Assessment l ITO research is resulting in demonstration systems that are being used in various places l Would like to facilitate transition mechanism of projects –ITO -> ISO( -> ACTD) -> JPO -> DISA –May not go through all steps l Difficult for ITO PMs to make all connections with appropriate ISO PMs l Difficult for ISO PMs to identify those ITO projects applicable to their program

5 5 09/10/97 10:08 AM MITRE Improve the Technology Transition Path AITS Integration Environment APII LES DII DARPA C4I Programs GCCS GCSS Service C4ISR GCCS GCSS Service C4ISR JTA emerging standards DII COE recommendations DII ISO ITOTechnologies DARPADISA AITS JPO

6 6 09/10/97 10:08 AM MITRE Improve the Technology Transition Path (concluded) l Benefits to ISO –Quick reference to research being conducted that can potentially transition into programs –Identify appropriate PMs, PIs to include in discussions –Determine holes in the program not being addressed by research program –Identify commercial solutions that may solve the need l Benefits to ITO –Get feedback on transitionability of projects –Get feedback on how to improve research –Identify holes for potential new research areas l Benefits to both –More efficient mechanism than having every PM trying to connect with correct PIs

7 7 09/10/97 10:08 AM MITRE Assessment Approach l Two-sided approach -ISO/DoD program technical requirements -ITO project assessment l ISO program requirements -Rely on current, published knowledge -Rely on MITRE personnel, when available -Talk with DARPA PMs and contractors as appropriate

8 8 09/10/97 10:08 AM MITRE Approach (concluded) l ITO project assessment -Technology description -Applicability to program requirements l To fill a technological need l To demonstrate a potential operational solution -Maturity l Paper/theoretical (e.g., algorithm analysis) l Prototype (laboratory vs. demonstrated vs. tested) l Operational (freeware or component of commercial product) -Applicability to development cycle in a prospective ISO new start (for EDCS) -Heuristics for assessment of projects

9 9 09/10/97 10:08 AM MITRE Overall Assessment Results on IS&S and C&N Research Areas (Partial) Key: ITO Research Programs In Study (194 projects total, concentration on EDCS & Quorum:120 projects) Near Long Immediate Color-coded by Program and Maturity Level Time ProgramProgram 22 projects 21 projects 18 projects Evolutionary Design of Complex Software GloMo CORBA: Quorum & QoS CORBA:Other Computing & Networking CORBA:Other Intelligent Systems & Software 61 14/

10 10 09/10/97 10:08 AM MITRE Algorithm, h Heuristics for Assessment of Projects l When did project start? If new start, probably not ready. l If a restart or change in direction, probably not ready. l Prototype available yet? l Extent of prototype, I.e., versions, applications being built by universities? Industry? l If set of tools, general maturity of individual tools and integration? l Used in any EDCS integration efforts?

11 11 09/10/97 10:08 AM MITRE Potential Immediate Transition Projects (22) l Aleph/Desert, Evolutionary Design of Complex Systems, Brown University l Ensemble, ML/Nuprl Logical Environment: Construction Methodologies for Improving Distributed System Security, Cornell University l Orbit: Collaboration Support for Complex Systems, University of Illinois [see Atlantis] l Atlantis: An Open Architecture for Synergy of Process-Centered Environments and Computer-Supported Cooperative Work, University of Illinois [see Orbit] l STeP: Software Development Technologies for Reactive, Real-Time, and Hybrid Systems, Stanford University l UniCon, etc.: A Technology Investigation Supporting Software Architecture and Analysis for Evolution, Carnegie Mellon University l RAPIDE: Architecture Definition Languages, Stanford University l DylanWorks: A Dylan Development Environment, Harlequin, Inc. l PVS, Murphi: An Integrated Environment for Efficient Formal Design and Verification, Stanford University

12 12 09/10/97 10:08 AM MITRE Potential Immediate Transition Projects (continued) l I-SPECS: Integrated System for the Predicable Evolution of Complex Software Systems, Software Productivity Solutions, Inc. (an integration project) l ADAM: Architectural Design, Analysis, and Measurement, Lockheed Martin C2 Integration Systems (an integration project) l QUEST: Quality Enabling Software Technologies, Microelectronics and Computer Technology Corporation l DEMETER: Evolution of Software Via Adaptive Programming, Northeastern University l CPAS: Capability Packaging for Avionics Systems, Northrop Grumman Corporation (an integration project) l TAOS, ProDAG, Chimera: Research in Advanced Environments, University of California, Irvine l Endeavors, EDEM (Expectation-Driven Event Monitoring): Open Technology for Software Evolution: Hyperware, Architecture, and Process University of California, Irvine

13 13 09/10/97 10:08 AM MITRE Potential Immediate Transition Projects (concluded) l Flavers, JIL, Julia, IRIS, Pleiades, JESS - UMASS ARCADIA: Support for Advanced Software Engineering Environment, University of Massachusetts l WinWin, A4/ACT-I, AAA: Collaborative WinWin System Definition Technology, University of Southern California, Center for Software Engineering l ACME, USC/ISI l MediaDoc, USC/ISI l MICE: Model-Integrated Computing Environment, Vanderbilt University l SECC: Software Evolution by Component Consolidation, Xinotech Research, Inc.

14 14 09/10/97 10:08 AM MITRE Actively Monitor for Near-Term Transition Projects (21) l Arcadia: Software Environments in Support of Wide-Area, Development University of Colorado l ADC/Rapide: Architecture Driven Construction and Monitoring of Distributed Object Systems, Stanford University l Sanctuary: Evolving Large Information Layers, University of Colorado at Boulder l Maude: Semantic Interoperation of Open Systems, SRI International l FAMILIAR: Formal Alternative Management Integrating Logical Inference and Rationales, Knowledge Evolution l CHAIMS: Compiling High-Level Access Interfaces for Multi-Site Software, Stanford University l EVOLVER: Evolutionary Views of Lifecycle Versions, Elements, and Rationales, Lockheed Martin (an integration project) l AppletMagic for EDCS, Intermetrics, Inc.

15 15 09/10/97 10:08 AM MITRE Actively Monitor for Near-Term Transition Projects (continued) l OzWeb: A New Infrastructure for Evolutionary Design and Implementation, Columbia University l CLOS as a Substrate for EDCS, Franz, Inc. l CLIM 3.0: A High Level User Interface Definition, Dynamic Object Language Labs, Inc l EMMA: Evolution-Memory Management Assistant, CoGenTex, Inc. l FLEA (Formal Language for Expressing Assumptions): Software Evolution Through Automatic Monitoring, Cs3: Computing Services Support Solutions l MORALE: Mission Oriented Architectural Legacy Evolution, Georgia Institute of Technology l RTDL: Real-Time Dynamic Languages for Embedded Processors, IS Robotics l EBPSDR: Evolution Based on Precise Semantic Design Records, Kestrel Institute (SpecWare 2.02 immediately available)

16 16 09/10/97 10:08 AM MITRE Actively Monitor for Near-Term Transition Projects (concluded) l SADL (Structural Architecture Description Language), IVM (Internet Virtual Machine): Incremental Evolution of Network-Wide Dynamic Systems, SRI International l EASOF (Execution-time Analysis of Specification-based Oracle Failures): Perpetual Testing, University of California, Irvine l Jakarta: A Tool Suite for Constructing Software Generators, University of Texas at Austin l SE-HOT: Software Evolution Using HOT Language Technology, Yale University l MetaH: High Assurance Evolution of Software Architectures, Honeywell Technology Center

17 17 09/10/97 10:08 AM MITRE Monitor for Long-Term Potential Projects (18) l Metaphor: Technology for Analyzing Change & Composing Reusable Real-Time Software Components and Applications, Carnegie Mellon University, Robotics Inst. l GWYDION: An Integrated Environment for Evolutionary Software Development & Maintenance, Carnegie Mellon University l ACT: Adaptation and Commitment Technology for Evolutionary Software Development, Carnegie Mellon University l INSERT: Incremental Software Evolution for Real-time System, Carnegie Mellon University l EXPRESS: A Programming Environment for Evolutionary Software Development, MIT l MULTI-GEN: Multi-Targeted Program Generators, USC/ISI l SSC: Software Security through Certification, Cornell University l FABASIT-UCol: A Formal Architecture-Based Approach to Software Integration Testing, University of Colorado, Boulder l SE&I: Software Evolution and Interleaving, Georgia Institute of Technology

18 18 09/10/97 10:08 AM MITRE Monitor for Long-Term Potential Projects (concluded) l DECR: Dynamically Extensible Computational Reflection, Indiana University l HASE: High-Assurance Software Evolution, Kansas State University l PT/P: Perpetual Testing, Purdue University l Darwin/Moses: Architectural Invariants of Evolving Systems, Rutgers University l EDCRTS: Evolutionary Development of Complex Real-Time Software, Charles Stark Draper Laboratory, Inc. l FABASIT-UCI: A Formal Architecture-Based Approach to Software Integration Testing, University of California, Irvine l PT/UMass: Perpetual Testing, University of Massachusetts l AOP: Aspect-Oriented Programming, Xerox Palo Alto Research Center l F-HOT: Foundations of HOT Languages and Software Evolution, Yale University

19 19 09/10/97 10:08 AM MITRE Potential Reassignments of Maturity l To Immediate: –From Near: l FAMILIAR: Formal Alternative Management Integrating Logical Inference and Rationales, Knowledge Evolution l MetaH: High Assurance Evolution of Software Architectures, Honeywell Technology Center –From Long: l INSERT: Incremental Software Evolution for Real-time System, Carnegie Mellon University l To Near: –From Long: l AOP: Aspect-Oriented Programming, Xerox Palo Alto Research Center l GWYDION: An Integrated Environment for Evolutionary Software Development & Maintenance, Carnegie Mellon University l ACT: Adaptation and Commitment Technology for Evolutionary Software Development, Carnegie Mellon University

20 20 09/10/97 10:08 AM MITRE ITO Projects in a Technology Program Framework

21 21 09/10/97 10:08 AM MITRE Technology Program Framework: 22 Immediate EDCS Projects Aleph/Desert STeP PVS/Murphi Atlantis/Orbit UniCon Rapide ADAM Integration ADAM Integration DylanWorks AppletMagic Ensemble/ Nuprl Ensemble/ Nuprl Quest Demeter CPAS Integration CPAS Integration CPAS Integration CPAS Integration TAOS ProDAG TAOS ProDAG TAOS ProDAG Endeavors EDEM Endeavors EDEM Endeavors EDEM Endeavors EDEM Umass Arcadia Umass Arcadia Umass Arcadia Umass Arcadia Umass Arcadia WinWin ACME MediaDoc MICE SECC

22 22 09/10/97 10:08 AM MITRE Technology Program Framework: 21 Near Term EDCS Projects OzWeb UColorado Arcadia UColorado Arcadia UColorado Arcadia UColorado Arcadia UColorado Arcadia Sanctuary ADC/Rapide EMMA Maude FAMILIAR CHAIMS EVOLVER integration EVOLVER integration EVOLVER integration EVOLVER integration OzWeb CLOS substrate CLIM 3.0 FLEA MORALE MetaH RTDL EBPSDR SADL EASOF Jakarta SE-HOT

23 23 09/10/97 10:08 AM MITRE Technology Program Framework: 18 Long Term EDCS Projects ACT Metaphor Gwydion INSERTACT INSERTGwydion MULTI- GEN MULTI- GEN ExpressSSC FABASIT -UCol SE&I DECRHASE PT-P Darwin/ Moses Darwin/ Moses Darwin/ Moses EDCRTS FABASIT -UCI AOPF-HOTPT-UMass

24 24 09/10/97 10:08 AM MITRE ITO Projects in a Development Cycle Framework: EDCS Cluster Overview EDCS Rationale Capture & Software Understanding Architecture/ Generation High Assurance & Real-Time Dynamic Languages Design Management Formal Verification Wrappers & Composition Information Survivability

25 25 09/10/97 10:08 AM MITRE Development Cycle Framework Design Testing Requirements Implementation Deployment Maintenance Run-Time Full Cycle

26 26 09/10/97 10:08 AM MITRE Development Cycle Framework with EDCS Clusters Design Testing Requirements Implementation Deployment Maintenance Run-Time High Assurance & Real-Time Dynamic Languages Rationale Capture & Software Understanding Design Management Architecture/Generation Formal Verification Wrappers & Composition Full Cycle

27 27 09/10/97 10:08 AM MITRE Development Cycle Framework: 22 Immediate EDCS Projects Design Testing Requirements Implementation Deployment Maintenance Run-Time High Assurance & Real-Time Dynamic Languages Rationale Capture & Software Understanding Design Management Architecture/Generation Formal Verification Wrappers & Composition Full Cycle Aleph/Desert Orbit Atlantis PVS/Murphi STeP Rapide DylanWorks AppletMagic Ensemble/ Nuprl Quest Demeter TAOS/ ProDAG TAOS/ ProDAG Endeavors/ EDEM Endeavors/ EDEM UMass/ Arcadia WinWin ACME MediaDoc MICE SECC I-SPECS integration CPAS integration ADAM integration MediaDoc

28 28 09/10/97 10:08 AM MITRE Development Cycle Framework: 21 Near Term EDCS Projects Design Testing Requirements Implementation Deployment Maintenance Run-Time High Assurance & Real-Time Dynamic Languages Rationale Capture & Software Understanding Design Management Architecture/Generation Formal Verification Wrappers & Composition Full Cycle UColorado Arcadia UColorado Arcadia UColorado Arcadia Sanctuary ADC/Rapide EMMA Maude FAMILIAR CHAIMS EVOLVER integration EVOLVER integration OzWeb CLOS substrate CLIM 3.0 FLEA MORALE MetaH RTDL EBPSDR SADL EASOF Jakarta SE-HOT

29 29 09/10/97 10:08 AM MITRE Development Cycle Framework: 18 Long Term EDCS Projects Design Testing Requirements Implementation Deployment Maintenance Run-Time High Assurance & Real-Time Dynamic Languages Rationale Capture & Software Understanding Design Management Architecture/Generation Formal Verification Wrappers & Composition Full Cycle GwydionMetaphorGwydion ACT INSERT MULTI-GEN Express SSC FABASIT- UCol SE&I DECR HASE PT-P Darwin Moses EDCRTS FABASIT- UCI AOP F-HOT PT-UMass

30 30 09/10/97 10:08 AM MITRE Development Cycle Framework: Detailed Design Testing Requirements Implementation Deployment Maintenance Run-Time Full Cycle Software Design & Architecture Meta-modeling Object-based ModelingBehavior-based Modeling Generic ADL Domain-Specific ADL Interchange/neutral ADL Simulation Animation Executable Generative Constraint-based Event-pattern Rules Run-time Support Multiple Styles Legacy Support DesignTesting Requirements ImplementationDeployment Maintenance Run-Time Implementation, Configuration & Deployment Dynamic UpgradingReal-time Support Alternatives/Change Management Reengineering Adaptive/Aspect Programming Dynamic Language Rationale Management Optimization Code-generating Run-time Constraints Reverse Engineering Software Analysis Validation (post) Conformance (mapping) Verification(pre) Model Analysis Component Analysis Static Analysis Connector Analysis Run-timel Analysis Event-monitoring Legacy Analysis Model Checking Dataflow Analysis Regression Testing Theorem-proving

31 31 09/10/97 10:08 AM MITRE Development Cycle Framework: Detailed Immediate Design Testing Requirements Implementation Deployment Maintenance Run-Time Full Cycle Software Design & Architecture Meta-modeling Object-based ModelingBehavior-based Modeling Generic ADL Domain-Specific ADL Interchange/neutral ADL Simulation Animation Executable Generative Constraint-based Event-pattern Rules Run-time Support Multiple Styles Legacy Support DesignTesting Requirements ImplementationDeployment Maintenance Run-Time Aleph/Desert Orbit Atlantis UniCon Implementation, Configuration & Deployment Dynamic UpgradingReal-time Support Alternatives/Change Management Reengineering Adaptive/Aspect Programming Dynamic Language Rationale Management Optimization Code-generating Run-time Constraints Reverse Engineering UniCon Software Analysis Validation (post) Conformance (mapping) Verification(pre) Model Analysis Component Analysis Static Analysis Connector Analysis Run-timel Analysis Event-monitoring Legacy Analysis Model Checking Dataflow Analysis Regression Testing Theorem-proving Aleph/Desert UniCon PVS/Murphi STeP Rapide AppletMagic DylanWorks Rapide AppletMagic Ensemble/ Nuprl Ensemble/ Nuprl Ensemble/ Nuprl Quest Demeter TAOS/ ProDAG TAOS/ ProDAG TAOS/ ProDAG Endeavors/ EDEM Endeavors/ EDEM Endeavors/ EDEM Endeavors/ EDEM Endeavors/ EDEM Endeavors/ EDEM UMass/ Arcadia UMass/ Arcadia UMass/ Arcadia UMass/ Arcadia WinWin ACME MediaDoc MICE SECC UniCon

32 32 09/10/97 10:08 AM MITRE Summary of UniCon Visualization and presentation - graphical editor for ADL modeling and taxonomy for many visualization techniques for architectures Data services - connections for database components to applications Object-based information representation with "drill down” Tools to better manage and visualize workflow Generic architectural modeling Generative modeling capability Model analysis Verification Validation Reverse Engineering Technology program frameworkISO program requirement Operational context Development cycle

33 33 09/10/97 10:08 AM MITRE Conclusions l These are preliminary findings l Study undertaken in necessarily breadth-first fashion l If you have additional information or question where your project is wrt maturity level or technical or lifecycle judgment, please contact me l Intended as a continuing process for technology transition -Provides feedback to ITO PMs on benefits of research program -Provides ISO PMs quick access to upcoming research l Immediately applicable to DARPA architectural efforts l Real possibility this could engender a new start in ISO next year: a focused application program which would employ methods and tools from EDCS for full development cycle


Download ppt "MITRE Intelligent Decision and Training Systems An Assessment of ITO Projects for Potential ISO Transition: Preliminary Leo Obrst, Ph.D. July 24, 1998."

Similar presentations


Ads by Google