1. Internet Technologies XML Validation In making up the slides for this lecture, I borrowed material from several very nice sources: “Data on the Web” Abiteboul, Buneman and Suciu “XML in a Nutshell” Harold and Means “The XML Companion” Bradley The validation examples were originally tested with an older parser and so the specific outputs may differ from those shown.

2. Internet Technologies XML Validation A batch validating process involves comparing the DTD against a complete document instance and producing a report containing any errors or warnings. Software developers should consider batch validation to be analogous to program compilation, with similar errors detected. Interactive validation involves constant comparison of the DTD against a document as it is being created.

3. Internet Technologies XML Validation The benefits of validating documents against a DTD include: Programmers can write extraction and manipulation filters without fear of their software ever processing unexpected input. Using an XML-aware word processor, authors and editors can be guided and constrained to produce conforming documents.

4. Internet Technologies XML Validation Examples XML elements may contain further, embedded elements, and the entire document must be enclosed by a single document element. The degree to which an element’s content is organized into child elements is often termed its granularity. Some hierarchical structures are recursive. The Document Type Definition (DTD) contains rules for each element allowed within a specific class of documents.

5. Internet Technologies Things the DTD does not do: Tell us the document root. Specify the number of instances of each kind of element. Describe the character data inside an element (precise syntax and semantics). The XML schema language is new and may replace the use of DTD’s

6. Internet Technologies We’ll run this program against several xml files with DTD’s. We’ll study the code soon. // Validate.java using Xerces import java.io.*; import org.xml.sax.ErrorHandler; import org.xml.sax.SAXException; import org.xml.sax.SAXParseException; import org.xml.sax.XMLReader; import org.xml.sax.InputSource; import org.xml.sax.helpers.XMLReaderFactory; import org.xml.sax.helpers.DefaultHandler; This slide shows the imported classes.

7. Internet Technologies public class Validate { public static boolean valid = true; public static void main (String argv []) { if (argv.length != 1) { System.err.println ("Usage: java Validate filename.xml"); System.exit (1); } Here we check if the command line is correct.

8. Internet Technologies try { // get a parser XMLReader reader = XMLReaderFactory.createXMLReader( "org.apache.xerces.parsers.SAXParser"); // request validation reader.setFeature("http://xml.org/sax/features/validation", true); // associate an InputSource object with the file name InputSource inputSource = new InputSource(argv[0]); // go ahead and parse reader.parse(inputSource); }

9. Internet Technologies catch(org.xml.sax.SAXException e) { System.out.println("Error in parsing " + e); valid = false; } catch(java.io.IOException e) { System.out.println("Error in I/O " + e); System.exit(0); } System.out.println("Valid Document is " + valid); } // Catch any errors or fatal errors here. // The parser will handle simple warnings.

10. Internet Technologies 100 5 3 6 XML Document DTD Valid document is true

11. Internet Technologies 100 5 3 6 XML Document DTD on the Web? VERY NICE Valid document is true

12. Internet Technologies <!DOCTYPE FixedFloatSwap [ ]> 100 5 3 6 XML Document with an internal subset Valid document is true

13. Internet Technologies 100 5 3 6 XML Document DTD Valid document is false

14. Internet Technologies 100 5 3 6 100 5 3 6 XML Document

15. Internet Technologies DTD C:\McCarthy\www\examples\sax>java Validate FixedFloatSwap.xml Quantity Indicators ? 0 or 1 time + 1 or more times * 0 or more times Valid document is true

16. Internet Technologies Is this a valid document? <!DOCTYPE person [ ]> Alan Turing computer scientist cryptographer Sure!

17. Internet Technologies The locations where document text data is allowed are indicated by the keyword ‘PCDATA’ (Parsed Character Data). 100 5 2000 2002 6 XML Document

18. Internet Technologies C:\McCarthy\www\46-928\examples\sax>java Validate FixedFloatSwap.xml org.xml.sax.SAXParseException: Element "NumYears" does not allow "StartYear" -- (#PCDATA) org.xml.sax.SAXParseException: Element type "StartYear" is not declared. org.xml.sax.SAXParseException: Element "NumYears" does not allow "EndYear" -- (# PCDATA) org.xml.sax.SAXParseException: Element type "EndYear" is not declared. Valid document is false Output DTD

19. Internet Technologies There are strict rules which must be applied when an element is allowed to contain both text and child elements. The PCDATA keyword must be the first token in the group, and the group must be a choice group (using “|” not “,”). The group must be optional and repeatable. This is known as a mixed content model. Mixed Content

20. Internet Technologies DTD H 2 O is water. XML Document Valid document is true

21. Internet Technologies Is this a valid document? <!DOCTYPE page [ ]> Alan Turing broke codes during World War II. He very precisely defined the notion of "algorithm". And so he had several professions: computer scientist cryptographer And mathematician Sure!

22. Internet Technologies How about this one? java Validate mixed.xml org.xml.sax.SAXParseException: The content of element type "page" must match "(paragraph)+". Valid document is false <!DOCTYPE page [ ]> The following is a paragraph marked up in XML. Alan Turing broke codes during World War II. He very precisely defined the notion of "algorithm". And so he had several professions: computer scientist cryptographer And mathemetician

23. Internet Technologies 100 5 3 6 will not be parsed for markup]]> <!ELEMENT FixedFloatSwap ( Notional, Fixed_Rate, NumYears, NumPayments, Note ) > XML Document DTD CDATA Section

24. Internet Technologies Recursion <!DOCTYPE tree [ ]> A DTD is a context-free grammar java Validate recursive1.xml Valid document is true

25. Internet Technologies How about this one? <!DOCTYPE tree [ ]> Alan Turing would like this Alan Turing would like this java Validate recursive1.xml org.xml.sax.SAXParseException: The content of element type "tree" must match "(node)". Valid document is false

26. Internet Technologies Relational Databases and XML Consider the relational database r1(a,b,c), r2(c,d) r1: a b c r2: c d a1 b1 c1 c2 d2 a2 b2 c2 c3 d3 c4 d4 How can we represent this database with an XML DTD?

27. Internet Technologies Relations <!DOCTYPE db [ ]> a1 b1 c1 c2 d2 c3 d3 c4 d4 java Validate Db.xml Valid document is true There is a small problem….

28. Internet Technologies Relations <!DOCTYPE db [ ]> a1 b1 c1 c2 d2 c3 d3 c4 d4 The order of the relations should not count and neither should the order of columns within rows.

29. Internet Technologies Attributes An attribute is associated with a particular element by the DTD and is assigned an attribute type. The attribute type can restrict the range of values it can hold. Example attribute types include : CDATA indicates a simple string of characters NMTOKEN indicates a word or token A named token group such as (left | center | right) ID an element id that holds a unique value (among other element ID’s in the document) IDREF attributes refer to an ID

30. Internet Technologies DTD 100 5 3 6 XML Document C:\McCarthy\www\46-928\examples\sax>java Validate FixedFloatSwap.xml org.xml.sax.SAXParseException: Attribute value for "currency" is #REQUIRED. Valid document is false

31. Internet Technologies DTD 100 5 3 6 XML Document Valid document is true

32. Internet Technologies DTD 100 5 3 6 XML Document Valid document is true #IMPLIED means optional

33. Internet Technologies DTD 100 5 3 6 XML Document Valid document is true

34. Internet Technologies DTD 100 5 3 6 XML Document Valid document is true #IMPLIED means optional

35. Internet Technologies DTD 100 5 3 6 XML Document Valid document is true

36. Internet Technologies ID and IDREF Attributes We can represent complex relationships within an XML document using ID and IDREF attributes.

37. Internet Technologies An Undirected Graph u vw x y z edge vertex

38. Internet Technologies A Directed Graph u w v y x

39. Internet Technologies Math 100 Geom100 Calc100Calc200 Calc300 Philo45CS1 CS2 This is called a DAG (Directed Acyclic Graph)

40. Internet Technologies Algebra I Students in this course study introductory algebra. This course has an ID But no prerequisites

41. Internet Technologies Geometry I Students in this course study how to prove several theorems in geometry. The DTD will force this to be unique.

42. Internet Technologies Calculus I Students in this course study the derivative. These are references to ID’s. (IDREFS)

43. Internet Technologies Calculus II Students in this course study the integral. The DTD requires that this name be a unique id defined within this document. Otherwise, the document is invalid.

44. Internet Technologies Calculus II Students in this course study the derivative and the integral (in 3-space). Prerequisites is an EMPTY element. It’s used only for its attributes.

45. Internet Technologies Introduction to Computer Science I In this course we study Turing machines. IDREFID A One-to-one link

46. Internet Technologies Introduction to Computer Science II In this course we study basic data structures. IDREFS ID One-to-many links

47. Internet Technologies Ethical Implications of Information Technology TBA

48. Internet Technologies The Course_Descriptions.dtd

49. Internet Technologies General Entities & General entities are used to place text into the XML document. They may be declared in the DTD and referenced in the document. They may also be declared in the DTD as residing in a file. They may then be referenced in the document.

50. Internet Technologies <!DOCTYPE FixedFloatSwap SYSTEM "FixedFloatSwap.dtd" [ ] > &bankname; 100 5 3 6 <!ELEMENT FixedFloatSwap (Bank,Notional, Fixed_Rate, NumYears, NumPayments ) > DTD Document using a General Entity Validate is true

51. Internet Technologies <xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version="1.0"> XSLT Program The general entity is replaced before xslt sees it.

52. Internet Technologies C:\McCarthy\www\46-928\examples\sax>java -Dcom.jclark.xsl.sax.parser=com.jclark. xml.sax.CommentDriver com.jclark.xsl.sax.Driver FixedFloatSwap.xml FixedFloatSwa p.xsl FixedFloatSwap.wml C:\McCarthy\www\46-928\examples\sax>type FixedFloatSwap.wml Mellon National Bank and Trust XSLT OUTPUT

53. Internet Technologies <!DOCTYPE FixedFloatSwap SYSTEM "FixedFloatSwap.dtd" [ ] > &bankname; 100 5 3 6 An external text entity

54. Internet Technologies Mellon Bank And Trust Corporation Pittsburgh PA XSLT Output Mellon Bank And Trust Corporation Pittsburgh PA JustAFile.dat

55. Internet Technologies Parameter Entities % While general entities are used to place text into the XML document parameter entities are used to modify the DTD. We want to build modular DTD’s so that we can create new DTD’s using existing ones. We’ll look at slide from www.fpml.org and the see some examples.www.fpml.org

56. Internet Technologies FpML is a Complete Description of the Trade Pool of modular components grouped into separate namespaces Date Schedule Product Rate Adjustable Period Notional Party Trade Trade ID Product Rate Adjustable Period Notional Party Vanilla Swap Vanilla Fixed Float Swap Cancellable Swaption FX Spot FX Outright FX Swap Forward Rate Agreement... Money Date

57. Internet Technologies <!ELEMENT FixedFloatSwap (Notional, Fixed_Rate, NumYears, NumPayments ) > XML Document DTD Internal Parameter Entities 100 5 3 6

58. Internet Technologies External Parameter Entities and DTD Components Kevin Dick 123 Anywhere Lane Apt 1b Palo Alto CA 94303 USA Order.xml

59. Internet Technologies Kevin Dick 123 Not The Same Lane Work Place Palo Alto CA 94300 USA An order may have more than one address.

60. Internet Technologies 440BX Motherboard 1 200 128 MB PC-100 DIMM 2 175 40x CD-ROM 1 50 Several products may be purchased.

61. Internet Technologies Kevin S. Dick 11111-22222-33333 01/01 The payment is with a Visa card. We want this document to be validated.

62. Internet Technologies order.dtd <!ATTLIST ORDER SOURCE (web | phone | retail) #REQUIRED CUSTOMERTYPE (consumer | business) "consumer" CURRENCY CDATA "USD" > Define an order based on other elements.

63. Internet Technologies %anAddress; %aLineItem; %aPayment; External parameter entity declaration % External parameter entity reference %

64. Internet Technologies address.dtd <!ELEMENT address (firstname, middlename?, lastname, street+, city, state,postal,country)> <!ATTLIST address ADDTYPE (bill | ship | billship) "billship"> <!ATTLIST street ORDER CDATA #IMPLIED>

65. Internet Technologies lineitem.dtd <!ATTLIST lineitem ID ID #REQUIRED> <!ATTLIST product CAT (CDROM|MBoard|RAM) #REQUIRED>

66. Internet Technologies <!ATTLIST card CARDTYPE (VISA|MasterCard|Amex) #REQUIRED> payment.dtd

67. Internet Technologies XML Schemas are Coming “XML Schema” is the official name XSDL (XML Schema Definition Language) is the language used to create schema definitions Can be used to more tightly constrain a document instance Supports namespaces Permits type derivation

68. Internet Technologies A Simple Purchase Order <purchaseOrder orderDate="07.23.2001" xmlns="http://www.cds-r-us.com" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.cds-r-us.com po.xsd" >

69. Internet Technologies Dennis Scannel 175 Perry Lea Side Road Waterbury VT 15216

70. Internet Technologies Purchase Order XSDL <xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns="http://www.cds-r-us.com" targetNamespace="http://www.cds-r-us.com" >

71. Internet Technologies

72. Internet Technologies

73. Internet Technologies

74. Internet Technologies