Presentation is loading. Please wait.

Presentation is loading. Please wait.

UNCLASSIFIED DoD Metadata Registry Dr Glenda Hayes MITRE/DISA PEO-GES 9 Oct 2008 Presentation to Federal Data Architecture Subcommittee.

Similar presentations

Presentation on theme: "UNCLASSIFIED DoD Metadata Registry Dr Glenda Hayes MITRE/DISA PEO-GES 9 Oct 2008 Presentation to Federal Data Architecture Subcommittee."— Presentation transcript:

1 UNCLASSIFIED DoD Metadata Registry Dr Glenda Hayes MITRE/DISA PEO-GES 9 Oct 2008 Presentation to Federal Data Architecture Subcommittee

2 UNCLASSIFIED 2 Agenda Net-Centricity –DoD Net-Centric Data Strategy What is Metadata? –Structural and Semantic Metadata –Discovery Metadata DoD Metadata Registry and Clearinghouse (DoD MDR)

3 UNCLASSIFIED 3 Recipe for Agility Net-Centric TenetsDoDNet-Centric Data Strategy InformationAssuranceStrategy Global Connectivity (TransformationalCommunications) Core Enterprise Services(NCES)

4 UNCLASSIFIED 4 DoD Net-Centric Data Strategy 4 Trusted Interoperable Responsive Accessible Understandable Visible Is an information resource discoverable by most users? Is it available on the network, and are tools readily available to use it? Can it be intelligibly used? Are the semantics well documented? Can it be combined or compared with other information? Can it be mediated? Are the source, security level and access controls of the data available to users? Is the data what users need? Are robust user feedback mechanisms in place to improve it? The DoD Net-Centric Data Strategy, issued by the DoD CIO May 9, 2003, is the plan to make the Departments information resources: CC/S/As must institutionalize processes to accomplish these goals

5 UNCLASSIFIED 5 Quiz: Which of these is Metadata? An XML Schema? A WSDL? A database structure? A picklist? An index card in the library? MS-Office products properties? classification and release conditions? Notes on the back of a photo? iPod playlist? Date and reviewer for a taxonomy? Product ratings & comments on Amazon?

6 UNCLASSIFIED 6 Structural & Semantic Resource Topical Assertions Visible Accessible Understandable Trusted Interoperable Responsive Metadata Supports NCDS Goals Title: ~~~~~~~~~~ Description: ~~~~ ~~~ ~~~ Author: ~~~ ~~ ~~~~~~ Subject: ~~~ ~~~ ~~~~ Information Resource Metadata Structural & Semantic Metadata book index card template, dictionary, thesaurus Analogy = = =

7 UNCLASSIFIED Additional questions, please use the Comments and Feedback link at 7 PEO – GES Data Services Office Mission –Provide tools, techniques, and performance standards to enable the DoD Data Strategy –Support DISA DoD Data Strategy compliance effort Products & Services –Chair DoD Metadata Working Group –Provide NCES Metadata Services support –Oversee operation of the DoD Metadata Registry –Develop and promote Data Strategy Enablers for Communities of Interest (COIs) –Provide Data Strategy input to NCES Acquisition Milestone Documents –Support NCES Product Branch, Testing & Evaluation, Operations, Sustainment, and NetOps activities –Support DISA CIO in extending the Enterprise Information Environment (EIE) technical procedures and standards for DISA internal systems

8 UNCLASSIFIED 8 Make Data Understandable I need a tank What does it mean? Register Terms, Definitions, & Relationships One reason Government Agencies and Military Services have trouble operating jointly is that they speak different languages. Registering and using taxonomies improves precision search and recall

9 UNCLASSIFIED 9 DoD Metadata Mgmt Engineering-level Processes DOD Developer Namespace Managers & WGs DoD Metadata Registry Participates in Consults, Subscribes to & Submits to/Downloads from Metadata Registry Namespace Managers & WGs DISA Data Services Office Governs/Coordinates Within Namespace Operates, DoD Metadata WG Maintains Hosts Discusses DoD MDR Focus Group DDMS Focus Group Taxonomy Focus Group

10 UNCLASSIFIED Distributed Configuration Management 7 Super Namespaces 10 MDR Governance Namespaces

11 UNCLASSIFIED 11 DoD MDR v7.0 Public areas Public areas


13 UNCLASSIFIED Advanced Search 13

14 UNCLASSIFIED Search Results 14 ratings Add to Briefcase

15 UNCLASSIFIED Information Resource Details 15 User-defined URLs

16 UNCLASSIFIED 16 Navigate through Relationships

17 UNCLASSIFIED 17 MDR Support for Mediation tacrep-2-kml.xsl (stylesheet) tacrep.xsd (schema) MDR Organizes Components for Mediation HasXSLT notional Leverage Registered Components & Associations tacrep.xml ebXML Registry Query service tacrep.kml schemaLocation=.../tacrep.xsd

18 UNCLASSIFIED 18 DoD Metadata Registry (MDR) Purpose –Provide an on-line repository which enables developers to reuse, understand, integrate with, and share existing data assets (metadata) Targeting web services, databases, and vocabularies –Mandated for the publishing of semantic and structural metadata DOD Directive –Provides a portal for developer access and web services for machine-to-machine access Key Facts –Over 8,000 users and 180,000 assets registered –Over 900 Programs of Record supported –Serving the DoD, DHS, IC, NASA and NATO –Hosted on NIPR, SIPR, and JWICS (in progress) –User driven via DoD Metadata Working Group and Feedback links –Implements the ebXML standard for Metadata Registries (in DISR) –User Name/Password or Single Sign-On through DKO –Governance structure provided by Joint Enterprise Services ERB Primary Benefits –Enables reuse and governance of data assets –Foundation for other services; e.g. mediation –Allows the COI data assets to exist after the COI disbands Primary Audience –DoD Capability Developers, COIs

19 UNCLASSIFIED 19 DoD MDR History COE XML Registry DoD XML Registration Memo DoD Metadata Registry MDR on SIPR v2.1 v3.1 v4.1 IC Info Sharing Data Standards Coordination Activity (DSCA ) v7.0 MDR Implements ebXML RIM & RS v5.0 v1.0 v6.1

20 UNCLASSIFIED 20 MDR Users Developers –Re-use and subscribe to registered data components, and/or register new ones they have created Community of Interest (COI) Metadata Governors –Configuration Manage (CM) registered component (e.g., posting new metadata versions, version change notification etc.) Acquisition Policy Makers –Use Metadata Registry metrics for acquisition oversight (e.g., reflecting program participation, specific data component re- use etc.) Applications –Interface with registered components via Metadata Registry Web Service (ebXML) to exploit reference tables, transformations, and XML schemas at Run Time

21 UNCLASSIFIED 21 MDR Size and Scope Instances on 2 security enclaves –Unclassified and Secret Users – 10,186 Information Resources –Submission Package – 1,263 –Schemas (e.g., DTD, XSD, etc) – 4,814 –Translations (i.e., XSL, XSLT) – 180 –Services (i.e., WSDL) – 555 –XML samples – 251 –Taxonomies (i.e., OWL) – 178 –Reference Data Sets – 5,709 –Amplifying Documents (e.g., DOC, ER1, etc) – 5, Programs of Record, 700 Organizations Unclassified MDR Inventory as of 8 Oct 2008

22 UNCLASSIFIED 22 Making Data Visible, Accessible, and Understandable through Metadata Data Store Web Service NCES Service Registry Audience: developer, application program Construct & Submit Package to MDR. Contains WSDL, schemas, stylesheets, taxonomies & any other pertinent information 1 Register service metadata & endpoints DoD Metadata Registry Audience: warfighter, intelligence, business user Web Interface (HCI) Register discovery metadata IAW DDMS in Federated Search- enabled Catalog 2 MDR Submission Pkg Federated Search Interface Defense Online developer warfighter Uses registered resources NCES Enterprise Catalog 3

23 UNCLASSIFIED 23 Net-Centric Publisher XSDWSDLDDMSService Endpoint Simplifies Metadata Publishing

24 UNCLASSIFIED 24 Practical Utility for Taxonomies Applicable for –Content –Services –Structural Metadata Aid precision search via DoD Discovery Metadata Specification (DDMS) FIPS.xsdCountry.sqlISO.xsd : …/DoDCore#Terrorist_Event

25 UNCLASSIFIED 25 MDR Support for Taxonomies PoliticalOrganization TerroristOrganization ForeignTerroristOrganization AlQaida MyCOI taxonomy DoD Core taxonomy : …/MyCOI.owl#AlQaida Organization UrCOI taxonomy TerroristGroup Producer View Group al-Qaeda equals Consumer View

26 UNCLASSIFIED 26 DoD Core Taxonomy v0.75c

27 UNCLASSIFIED 27 UCore v2.0 Default Taxonomy

28 UNCLASSIFIED 28 FEA-BRM as OWL-encoded Taxonomy

29 UNCLASSIFIED 29 Framework for Registry Interoperability Inter-Registry Object References Federated Queries Centralized Authority w/Local Caching Object Relocation Architecture Products Enterprise Search Aggregator Service DDMS-based Query Service Unclassified (U) MDR Secret (U) MDR MDR UDDI Top Secret (U) MDR USTRANSCOM USMTF fully automated push Online Package Registration MDR More attention needed (S) (TS)(S) MDR Adapted from OASIS Cooperating Registries

30 UNCLASSIFIED 30 Useful Links DoD CIO Data Strategy Homepage – DoD Metadata Registry –http://metadata.dod.mil DoD Discovery Metadata Specification – NCES Techguide – NCES Developer Community – COI Toolkit – Intellipedia –


32 32 Make Data Visible Documents –Documented via Keyword, Text, RSS/Atom, DDMS –Metadata Cache (traditional) Search Index, OpenSearch (RSS/Atom) Syndication Feed, Google Data API (DDMS) Metadata Catalog, Federated Search Service Web Services –Documented via WSDL + XSD(s) –Metadata Cache ebXML Registry UDDI Registry –Styles SOAP REST REST = HTTP/HTTPS + URI + XML REST

33 UNCLASSIFIED DDMS: Leverages Industry Standards 33 DoD Discovery Metadata Specification (DDMS) Configuration managed by DoD Metadata WG DDMS endorsed by Executive Order Further Strengthening The Sharing Of Terrorism Information To Protect Americans Data Catalog (historical) * * * * * * mandatory OGC: GML W3C: Date & Time W3C: OWL IC: ISM W3C: Date & Time ISO: Dublin Core

34 UNCLASSIFIED 34 * mandatory DDMS endorsed by Executive Order Further Strengthening The Sharing Of Terrorism Information To Protect Americans DoD Discovery Metadata Specification (DDMS) Configuration managed by DoD Metadata WG Data Catalog (historical) Utility Beyond Make Data Visible DDMS is enabler to multiple Data Strategy Goals * * * * * OGC: GML W3C: Date & Time W3C: OWL IC: ISM W3C: Date & Time ISO: Dublin Core Make Data Accessible (practically) Make Data Accessible (responsibly) Make Data Understandable Enable Data to be Trusted

35 UNCLASSIFIED 35 DDMS Home Page Current Version: 2.0

36 UNCLASSIFIED 36 Federated Search Use Case FS EC NCES Fed Search Aggregator Capabilities: Enterprise Services – DECC Columbus Interfaces: EC FS Enterprise Catalog Federated SearchExternal Applications, Services, and Data Sources Users NCES Enterprise Catalog NCES Service Discovery NCES Enterprise Services Management User Logs into DOL Portal, DKO, or COI Application User Authorized by NCES Security Services User Submits Search Query Query is federated and results returned. Aggregated results returned Results viewed by user Fed Search Aggregator discovers data sources from Service Discovery NCES Security Service FS Community of Interest FS Program of Record COI, POR, C/S/A Data Sources populated from applications, databases, web content, etc. For immediate discoverability users may post metadata to the Enterprise Catalog Enterprise Web Content is crawled and indexed DS (Web Enabled) DS (Web Enabled) Data Source DS DECC Columbus & San Antonio Federated Search enables information sharing within and between PORs and COIs

37 UNCLASSIFIED 37 Make Data Accessible Considerations 1.Practical & Responsible 2.Application & Browser 3.Documents & Systems Practical Responsible Documents Common Formats ICISM, RBAC, ABAC Systems Web Services ICISM, RBAC, ABAC ICISM = IC Information Security Metadata RBAC = Role-based Access Control ABAC = Attribute-based Access Control

38 UNCLASSIFIED 38 Releasability Rules Notional Example Attribute-Based Access Control Security Clearance: S Citizenship: US Rank: Major AOR: AF classification="TS" ownerProducer="USA GBR" SCIcontrols="SI TK" FGIsourceProtected="ISR" disseminationControls="OC REL PR" releasableTo="USA AUS CAN GBR" declassDate=" " derivedFrom="Source Document"

39 UNCLASSIFIED 39 Enterprise Metadata Initiatives Senior Enterprise Services Governance Group (SESGG) [DoD & IC] –DoD Metadata WG DoD Metadata Registry (DoD MDR) DoD Discovery Metadata Spec (DDMS) –Service Registry & Governance WG (SR&G WG) –Content Discovery IPT Ucore v2.0 [DoD, IC, DHS, DoJ] Automated Metadata Population Service (AMPS) [AF lead] XML Cross Domain Services [DISA-NSA] Controlled Unclassified Information (CUI) – [Federal]

40 UNCLASSIFIED 40 UCore V2.0 Vision, Scope and Governance Development and Configuration Management (DoD, DoJ Lead) Policy Implementation (IC Lead) Outreach and Communications (DHS Lead) Executive Steering Council (ESC) (Rotating Chair between DoD, IC, DoJ, DHS and State/Local Representative) DoD CIO Initial Chair Business Case Design / Build Pilot Test and Eval Config Mgmt

41 UNCLASSIFIED 41 Automated Metadata Population Service (AMPS) Pilot Outcomes Annotators for DDMS elements –Creator –Description –Date –Format –Geospatial –Identifier –Security –Subject –Title –Type Annotators for Asset Types –Microsoft Office –PDF –Position-Location Indicators –Information Exchange Schemas –HTML Information Asset COI Vocabularies AMPS ID: Title: Cyber Awareness Campaign Creator: Jim Smith Subject: cyber warfare; information assurance; non-kinetic effect; security; cyber threat; infrastructure Description: A campaign to increase awareness of cyber threats to the DoD information infrastructure. Security: U//FOUO Type: Cyber COI Date: Format: Microsoft Word Geospatial: 35.8, -75.3

42 UNCLASSIFIED 42 Differentiating Types of Metadata Structural & Semantic Metadata –Rules governing a chunk - Name, description, data constraints, and relationships of tags used in information resources to delimit one chunk of data from another chunk –Artifacts where structural metadata is described: XML schemas, RDBMS structures, taxonomies –Register in DoD Metadata Registry, use submission pkg Resource Metadata –Advertisement - Terms to aid in the recall and retrieval of artifacts –Artifacts that we collect resource metadata on: PPT, DOC, GIF, JPG, MPG, RDBMS –Register in Data Catalog, use DoD Discovery Metadata Specification (DDMS)

Download ppt "UNCLASSIFIED DoD Metadata Registry Dr Glenda Hayes MITRE/DISA PEO-GES 9 Oct 2008 Presentation to Federal Data Architecture Subcommittee."

Similar presentations

Ads by Google