Presentation on theme: "MSc IT UFCE8K-15-M Data Management Prakash Chatterjee Room 3P16"— Presentation transcript:
MSc IT UFCE8K-15-M Data Management Prakash Chatterjee Room 3P16 Lecture 10 : XML & XML Databases
UFIE8K-15-M Data Management Definition Extensible Markup Language, abbreviated XML, describes a class of data objects called XML documents and partially describes the behavior of computer programs which process them. XML is an application profile or restricted form of SGML, the Standard Generalized Markup Language [ISO 8879]. By construction, XML documents are conforming SGML documents.XML documents [ISO 8879]. Extensible Markup Language (XML) 1.0 (Third Edition) W3C Recommendation 04 February 2004
UFIE8K-15-M Data Management So what is it really? A document syntax (markup) standard for text documents that is simple and open (non-proprietary) for electronic data exchange and storage. It is flexible and eXtendable (Xml) because it allows users to create their own vocabularies (new markup languages) - no fixed set of tags as in HTML or XHTML. XML documents contain only data delimited by tags – no formatting instructions or style.
UFIE8K-15-M Data Management A little history Developed by an XML Working Group formed under the auspices of the World Wide Web Consortium (W3C) in 1996.World Wide Web Consortium (W3C) A subset of SGML (Standard Generalized Markup Language) originally designed to meet the challenges of large-scale electronic publishing. XML now adopted in fields as diverse as law, healthcare, insurance, multimedia, web publishing, EDI, telecommunications, aeronautics, engineering, software, hospitality, tourism, retail, stock trading, etc. etc. etc. ………
UFIE8K-15-M Data Management Design goals The original design goals for XML were: - that it should be straightforwardly usable over the Internet. - that it should support a wide variety of applications. - that it be compatible with SGML. - that it should be easy to write programs which process XML documents. - that the number of optional features in XML were to be kept to the absolute minimum, ideally zero. - that XML documents should be human-legible and reasonably clear. - that the XML design would be prepared quickly. - that the design of XML would be formal and concise. - that XML documents would be easy to create. - that terseness in XML markup was to be of minimal importance.
UFIE8K-15-M Data Management Example XML document Joseph Michael Bloggs Joe Mr 2 Gloucester Road Bristol Avon BS2 4QS
UFIE8K-15-M Data Management pipe dilimited nhs-no|first|middle|last|previous|preferred|………………. | |fax Other formats relational table Patient nhs-no first Joseph middleMichael
UFIE8K-15-M Data Management Tree view of example XML document (all xml documents are hierarchical in structure) patient name title address fax tel first middle last previous preferred street1 street2 street3 city county postcode home mobile JosephMichaelBloggs Joe 2 Gloucester Rd BristolAvon BS2 4QS Mr nhs-no KEY element content attribute
UFIE8K-15-M Data Management Well-formed XML documents (1) Every XML document must be well-formed and must therefore adhere to the following rules (among others): 1.Every start-tag must have a matching end tag. 2.Elements may nest but must not overlap. Anna Coffey - √ Anna Coffey - × 3.There must be exactly one root element. 4.Attribute values must be quoted. 5.An element must not be quoted. 6.Comments and processing instructions may not appear inside tags. 7.No unescaped < or & signs may occur in the character data of an element. Note: A XML document may be well-formed but not valid. A valid document requires a declaration that identifies a Document Type Definition (DTD) or Schema that the document conforms to. This ensures that the document meets various grammar rules for each of its elements and attributes, their order and the values that are allowed. A validating parser can check the document to ensure these rules are met. We will look at XML Schemas in some detail in the next lecture.
UFIE8K-15-M Data Management Well-formed XML documents (2) Element names are case sensitive -,, & are four different element types. No white spaces in element name - not allowed; OK. Element names cannot start with the letters “XML” or “xml” – reserved terms. Element names must start with a letter or a underscore. Element names cannot start with a number but numbers may be embedded within an element name - not allowed; is OK. Attribute names are constrained by the above rules for element names. Entity references are used to substitute specific characters. There are five predefined entities built into XML: EntityCharNotes &&Do not use inside processing instructions <
UFIE8K-15-M Data Management XML Namespaces Namespaces serve two functions in the XML specification: 1.To distinguish between elements and attributes from two different vocabularies with different meanings that might share the same name and hence avoid naming collisions. 2.To group all the related attributes from a single XML application together so that software can easily recognise them. Consider the following fragments from two different documents: Bernadette Coffey and Hegel in a Nutshell The first element refers to the name of a person and the second to the name of a book. If we were to build a merged document (say Bernadette’s reading list) we will have a collision since there are two elements with different meanings. Namespaces can distinguish between the two by using prefixes. Bernadette Coffey and Hegel in a Nutshell Each element has a prefix corresponding to a uniform resource identifier (URI) that uniquely identifies the namespace e.g. and BUT – don’t confuse URI’s with URL’s. URL’s are a subset of URI’s that locate resources based on a network filename concept. A URL is a path to a file or resource on the Web. A URI used as a namespace is simply a unique name.
UFIE8K-15-M Data Management XML Applications (1) XSLTXSLT – Extensible Stylesheet Language Transformations is an application for specifying rules which transform one XML document into another document. It uses template rules in the stylesheet to match patterns in the input document and when a match is found it writes the template from the rule to the output tree.
UFIE8K-15-M Data Management XML Applications (2) XLinksXLinks - is the XML Linking Language. It defines how one document links to another. It is divided into two parts XLinks and XPointer (which identifies a particular part of the document (re: anchors in HTML)). XPathXPath – XPath is a non-XML language for identifying particular parts of an XML document. It is designed to be used in conjunction with the Extensible Stylesheet Language Transformations (XSLT) and XPointer. XFormsXForms – is the W3C’s name for a specification of Web forms that can be used with a wide variety of platforms including desktop computers, hand helds, information appliances and even paper. XQueryXQuery – an XML based query language to extract data from real or virtual documents providing the needed interaction between the Web and databases. SVGSVG – Scalable Vector Graphics. A XML application which describes vector graphics data for JPEG, GIF and PNG for distribution and display over the web. Other applications (and the list is growing rapidly) include – XML Signature, XML Encryption, Web Services (SOAP, WDSL & UDDI), XML Key Management, Synchronized Multimedia Integration Language (SMIL), etc. etc. etc.XML SignatureXML Encryption Web Services XML Key ManagementSynchronized Multimedia Integration Language
UFIE8K-15-M Data Management XML Vocabularies XHTMLXHTML – the Extensible HyperText Markup Language which reproduces and extends HTML. An XHTML document conforms to all rules required of a well formed XML document and drops many of the weak features of HTML e.g. the tag. WMLWML – the Wireless Markup Language is a strict HTML type vocabulary for use with wireless- enabled devices such as mobile phones, PDA’s & pagers. InkMLInkML – For representing digital ink data that is input with a pen. MathMLMathML – For the inclusion of mathematical formulas in web pages and machine to machine communications. CMLCML – Chemical Markup Language is a XML vocabulary for representing molecular and chemical information. A formula can be transformed into a graphic represenation for displaying on a web page. Others standardized vocabularies include the Banking Industry Technology Secretariat (BITS); Financial Exchange (IFX); Bank Internet Payment System (BIPS); Telecommunications Interchange Markup (TIM); Common Business Library (xCBL); Electronic Business XML Initiative (ebXML); Product Data Markup Language (PDML); Financial Information eXchange protocol (FIX); The Text Encoding Initiative (TEI) and hundreds of others.
UFIE8K-15-M Data Management Relational v. xml approach to data Relational modelXML model Tabular representation Hierarchical representation Strongly structured, static schema, same schema for every row of a table Semi-structured, flexible schema (may not even exist), easily changeable Sets (no implied order) Sequences (order matters) All relationships are defined by primary / foreign keys Document contains data and relationship Strongly typed, one type per column Optionally typed (using XSD or other schema languages)
UFIE8K-15-M Data Management Approaches to structuring xml (1) storing XML in VARCHAR or BLOBS offers xpath/xquery but not much else storing XML in shredded form XML document is decomposed according to specified rules into one or more relational tables and reconstructed back on retrieval Pros and when to use it: The XML schema is stable; XML is only used as transfer format and document structure is not relevant Incoming XML data must be integrated with existing relational data; the structure of XML documents is simple to allow for easy mapping; performance of query is more important then insert. Cons and when to avoid: Document structure is too complex to be mapped into tables; performance of insert is important; document structure needs to be preserved; full retrieval of documents is frequent; XML schema frequently changes or does not exist; data in XML document is sparse
UFIE8K-15-M Data Management Approaches to structuring xml (2) native xml db native XML database is a system which processes and stores XML data using XML data model. A true native XML database system uses trees of nodes as the fundamental storage and processing model Pros: No mapping between data models; document structure and order preserved; XQuery & XPath can be processed without translation to SQL; no parsing required at query or update time; documents with or without schemas can be stored in native store without the need to adjust for complex mappings; sub document update is fast When not: the document collection isn’t order centered; applications must run XQueries that can easily be expressed in SQL; where there is no need to construct XML documents that are different from the ones that were inserted into the database.