Submarine Electro-Optical Imaging: Future Imaging System Architecture Presented to: National Defense Industrial Association 2002 Joint Undersea Warfare Conference Presented By:Mr. Swarn Dulai, PMS 435 I&EW Chief Engineer Naval Sea Systems Command Submarine Sensor Systems Program Office Imaging and Electronic Warfare Telephone:(202) UNCLASSIFIED

NDIA SEP 02 2 UNCLASSIFIED Submarine Imaging Systems Tomorrow Yesterday Today

NDIA SEP 02 3 UNCLASSIFIED Imaging System Overview Background Object Optics Sensor General Purpose Processor Video Front-end Processing Image Display Human Observer LOS training, vibration/motion compensation Imagery Storage ATMO TC/ IM Utilize an end-to-end system approach to ensure a balanced technology insertion program

NDIA SEP 02 4 UNCLASSIFIED Submarine Imaging Systems Current Systems –Submarine Imaging System (SUBIS) »Implemented as Type 18 subsystem »Color TV Camera – Sony XC-999 (768X494 pixels) »Color Still Pictures – Nikon D1 (2000X1312 pixels) »Low Level Light Television (LLLTV) Camera – Xybion ISS-850 (480 TV Lines) »Workstation for Capture / Storage / Recall –Photonics Mast Program (PMP) (VIRGINIA CLASS Only) »Non-Penetrating Mast »Color TV Camera - Sony 007 (640X480 pixels) »Monochrome – Sony XCH1125 (1940X1040 pixels) »IR Cameras - Cincinnati Electronics Night Conqueror (640X512 pixels) »Automatic 360-degree sweep »Imaging Processing / Storage / Recall Near Term Demonstrations –Integrated Imaging System (I 2 S) Future Systems –UAV/UUV Sensors

NDIA SEP 02 5 UNCLASSIFIED Planned Installations SUBIS –26 Systems Procured 14 Installed 12 Completed By End of FY03 –Planned Procurement for All Submarines In Process Photonics –VIRGINIA CLASS (Forward Fit) Integrated Imaging System –Automatic Rangefinder, IR, Video Mosaic Remote Control Imaging Sensor, Automatic Object Detection and Tracking, Super Resolution, Image Fusion, Etc. –Development completed in FY04, Installations Start FY05 –Backfit all In-Service Submarine Classes

NDIA SEP 02 6 UNCLASSIFIED Imaging as Part of Submarine Modernization Secret & below Potentially S+ Gate Guard Modem ECS Time Data TFDS Sensor Data Radar Sensor Data ARCI Contact Data ECP-4 Contact Data GCCS-M Sensor Data Imaging NAV Data RLGN Sensor Data ESM NTCSS SEA-08 Users IT-21 Users Central Mgr, IPSec & DAR SIPRNET TIDS Tactical LAN TS / SCI Modem ECS Imaging system sensors provide ‘eyes’ to the tactical picture –Raw Imagery (Present) Color Video Digital Still Frames Low Light Level Video –Near Term Demonstrations (I 2 S) Video Mosaic (wide field of view) Remote Control Imaging Sensor Automatic Object Detection and Tracking Contact parameter estimation Super Resolution Image Fusion Infrared Sensor Supports push/pull to/from other SWS subsystems Automated Rangefinding

NDIA SEP 02 7 UNCLASSIFIED Objectives Address Fleet’s Imaging Requirements –Develop an Open System Architecture for Imaging System Technology Insertion –Establish Process to Enable Rapid Insertion of New Technologies into Submarine Imaging Systems. –Define Hardware and Software Architecture to Support COTS Imaging Sensors, Image Processing Algorithms, and Advanced Displays. –Fuse Sensors Data to Provide an Enhanced Common Tactical Picture. –Balance Performance, Cost, and Schedule

NDIA SEP 02 8 UNCLASSIFIED Building Upon the Imaging System Architecture Imaging Sensors Remote Control Mosaic generation Image Fusion Tactical Control Information Manager Workstation Automated contact detection, Classification, Parameter extraction ONI Ship Characteristic Database Image Enhancement Image and Video Indexing

NDIA SEP 02 9 UNCLASSIFIED Future Integrated Imaging System (I 2 S) KBDTRKGRIP Interfaces Periscope Function Image Processing HMI Display Processing Imaging Database Display Video Multiplexer SUBIS Color LLLTV Digital Still Photonics Color B&W IR Other / Future Video IR Panoramic Etc. SWS/TIDS Nav Data Range ESM Data Sonar Data Sensor Control FOV, AZ, EL, LOS Control, Camera Select Contact Analysis G/G

NDIA SEP UNCLASSIFIED Video and Image Processing Frame-to-Frame Image Stabilization Real Time Video Processing Real Time Video Image Fusion Image Mosaic Super Resolution Frame Integrate Display Systems Contact Analysis Video (Color)Video (IR) Digital Still Frames

NDIA SEP UNCLASSIFIED Contact Analysis Flow Manual Target Mensuration Manual Contact Report Generated Automatic Target Bounding Ship Database Contact Report Remote Control Automatic Target Mensuration Target Tracking Automatic Target Detection Contact Report Video/Still Image Processing Start Contact Analysis Search -Mosaic -Super Resolution -Frame Integrated -Image Enhanced -Video Frame Grab -Digital Still -Enhanced Video Frame Grab -Fused Video Frame Grab -Super-Resolution Frame Classification Range Angle on Bow Bounding box and/or target contour Bearing Hi Priority Targets Available in Photonics Mast Geosit & Trip Wire Display Time Bearing Programmed search

NDIA SEP UNCLASSIFIED Mapping New Capabilities to Imaging System Architecture High Speed Imaging Sensor Processor (front end) –Frame-to-frame registration –Frame store and distribution –Video rate image fusion General Purpose Processor –Video rate processing (simple FIR filtering) –Contact analysis capabilities –Remote control of periscope functions –External interface management –Video and image database management –Video and image server –GUI and support function processing Display Processor –Display processing –Head Up Display –Virtual Reality

NDIA SEP UNCLASSIFIED Sensor Upgrades & APB Process

NDIA SEP UNCLASSIFIED Challenge To Our Industry Partners Push Technology to Improve: Advanced Imaging Sensors For Comprehensive Spatial, Temporal, and Spectral Coverage High Data Rate Interface Modular Signal and Data Processing Equipment High Resolution Displays Applications Software (image processing, target acquisition, display processing) Software Reuse Industry Participation is KEY to Achieving Our Submarine Imaging Goals