1. ISD Production Process: Shifting to Virtual Production Building a Virtual ISD Application Called “C2 Gateway” Ken Matesich and Ryan Brown Davis-Monthan AFB, Tucson, Arizona C2 Technologies, Inc. Vienna, Virginia

2. Davis-Monthan Site Overview Air Force Pilot and Aircrew training for the A-10 and EC-130 aircraft Traditional lecture based lessons Web-based online training (CBT) Blended Learning lessons Special software applications (CAI) 250 A-10 and 470 EC-130 lessons

3. Spatial Awareness

4. Traditional Development Model Large Microsoft Excel spreadsheets Extensive use of email Multiple documents on network shares Many client feedback documents on hundreds of product deliverables Limited historical accountability Difficulty reporting on metrics over the long term

5. ISD Process Overview

6. C2 Gateway Software Application Shift to Web-based virtual Instructional Systems Design Application acts as a one-stop Portal Three tier approach: ◦ Inventory Archive ◦ Scheduling Management ◦ Production Review Feedback SQL Database content management

7. ISD Process in Gateway Sandbox Critiques Production

8. OMAR (Objective Media Analysis Report) ◦ LMS Student Critiques ◦ Instructor Critiques ◦ Air Force Critiques ISD Production Process Details LSRRDFDACOMAR

9. Inventory Archive 700+ Inventoried lessons Student and instructor critiques The Inventory drives the ISD cycle Available for off-site access Roles-based and secure logon

10. Scheduling Management 900+ deliverable stages (documents) produced and reviewed annually Centralized management of projects ISD (EdTech) and Instructor tasking Tally of work accomplished

11. Production Review Hyperlinked lessons for review Categorized by stakeholder Comment Tool ◦ Role-based feedback ◦ Forum thread and response concept ◦ Intuitive interface tracks stages

12. NLEs (the Cash Register) New Lesson Equivalent calculations: ◦ During ‘Sandbox’ scheduling and tasking ◦ During production cycle (quarterly / yearly) Statement of work (SOW) tracking Delay tracking: production & review

13. Software Environment C#, ASP. Net, HTML, JavaScript Compiled Web application N-tier architecture Programmed and designed in-house ◦ Custom data forms with Ajax Dedicated Windows 2003 Server Hosted and managed environment

14. Database Design Microsoft SQL Server 2008 ~ 50 relational database tables ~ 150 stored procedures Custom Object Relational Mapping (ORM) interface code Database structure (link)

15. Software Concerns Code maintainability Application accessibility Web site security Data confidentiality Site and database backup Application extensibility

16. Some Realized Metric Gains 4 % deficit historically (3-6%) 3 % ahead of schedule currently (1-4%) Early Perspective: ◦ Site produces 255 lesson hours annually ◦ Up to 8% gain, or ~20 lesson hours

17. Summary - Improvements Moving from analog to digital Centralized location for production Tracking of customer feedback Improved evaluation visibility Reduced administrative busy work Eliminated multiple source reliance Improved stakeholder connectivity C2 Technologies, Inc. Vienna, Virginia