1. Internet Technologies1 XML DTD Validation In making up the slides for this lecture, I borrowed material from several sources: “Data on the Web” Abiteboul, Buneman and Suciu “XML in a Nutshell” Harold and Means “The XML Companion” Bradley The validation examples were originally tested with an older parser and so the specific outputs may differ from those shown.

2. Internet Technologies2 XML Validation A batch validating process involves comparing the DTD against a complete document instance and producing a report containing any errors or warnings. Software developers should consider batch validation to be analogous to program compilation, with similar errors detected. Interactive validation involves constant comparison of the DTD against a document as it is being created.

3. Internet Technologies3 XML Validation The benefits of validating documents against a DTD include: Programmers can write extraction and manipulation filters without fear of their software ever processing unexpected input. Using an XML-aware word processor, authors and editors can be guided and constrained to produce conforming documents.

4. Internet Technologies4 XML Validation Examples XML elements may contain further, embedded elements, and the entire document must be enclosed by a single document element. The degree to which an element’s content is organized into child elements is often termed its granularity. Some hierarchical structures are recursive. The Document Type Definition (DTD) contains rules for each element allowed within a specific class of documents.

5. Internet Technologies5 Things the DTD does not do: Tell us the document root. Specify the number of instances of each kind of element. Describe the character data inside an element (precise syntax and semantics). The XML schema language is new and may replace the use of DTD’s

6. Internet Technologies6 We’ll run this program against several xml files with DTD’s. We’ll study the code soon. // Validate.java using Xerces import java.io.*; import org.xml.sax.ErrorHandler; import org.xml.sax.SAXException; import org.xml.sax.SAXParseException; import org.xml.sax.XMLReader; import org.xml.sax.InputSource; import org.xml.sax.helpers.XMLReaderFactory; import org.xml.sax.helpers.DefaultHandler; This slide shows the imported classes.

7. Internet Technologies7 public class Validate { public static boolean valid = true; public static void main (String argv []) { if (argv.length != 1) { System.err.println ("Usage: java Validate filename.xml"); System.exit (1); } Here we check if the command line is correct.

8. Internet Technologies8 try { // get a parser XMLReader reader = XMLReaderFactory.createXMLReader( "org.apache.xerces.parsers.SAXParser"); // request validation reader.setFeature("http://xml.org/sax/features/validation", true); // associate an InputSource object with the file name InputSource inputSource = new InputSource(argv[0]); // go ahead and parse reader.parse(inputSource); }

9. Internet Technologies9 catch(org.xml.sax.SAXException e) { System.out.println("Error in parsing " + e); valid = false; } catch(java.io.IOException e) { System.out.println("Error in I/O " + e); System.exit(0); } System.out.println("Valid Document is " + valid); } // Catch any errors or fatal errors here. // The parser will handle simple warnings.

10. Internet Technologies10 100 5 3 6 XML Document DTD Valid document is true

11. Internet Technologies11 100 5 3 6 XML Document DTD on the Web? VERY NICE Valid document is true

12. Internet Technologies12 <!DOCTYPE FixedFloatSwap [ ]> 100 5 3 6 XML Document with an internal subset Valid document is true

13. Internet Technologies13 100 5 3 6 XML Document DTD Valid document is false

14. Internet Technologies14 100 5 3 6 100 5 3 6 XML Document

15. Internet Technologies15 DTD C:\McCarthy\www\examples\sax>java Validate FixedFloatSwap.xml Quantity Indicators ? 0 or 1 time + 1 or more times * 0 or more times Valid document is true

16. Internet Technologies16 Is this a valid document? <!DOCTYPE person [ ]> Alan Turing computer scientist cryptographer Sure!

17. Internet Technologies17 The locations where document text data is allowed are indicated by the keyword ‘PCDATA’ (Parsed Character Data). 100 5 2000 2002 6 XML Document

18. Internet Technologies18 C:\McCarthy\www\46-928\examples\sax>java Validate FixedFloatSwap.xml org.xml.sax.SAXParseException: Element "NumYears" does not allow "StartYear" -- (#PCDATA) org.xml.sax.SAXParseException: Element type "StartYear" is not declared. org.xml.sax.SAXParseException: Element "NumYears" does not allow "EndYear" -- (# PCDATA) org.xml.sax.SAXParseException: Element type "EndYear" is not declared. Valid document is false Output DTD

19. Internet Technologies19 There are strict rules which must be applied when an element is allowed to contain both text and child elements. The PCDATA keyword must be the first token in the group, and the group must be a choice group (using “|” not “,”). The group must be optional and repeatable. This is known as a mixed content model. Mixed Content

20. Internet Technologies20 DTD H 2 O is water. XML Document Valid document is true

21. Internet Technologies21 Is this a valid document? <!DOCTYPE page [ ]> Alan Turing broke codes during World War II. He very precisely defined the notion of "algorithm". And so he had several professions: computer scientist cryptographer And mathematician Sure!

22. Internet Technologies22 How about this one? java Validate mixed.xml org.xml.sax.SAXParseException: The content of element type "page" must match "(paragraph)+". Valid document is false <!DOCTYPE page [ ]> The following is a paragraph marked up in XML. Alan Turing broke codes during World War II. He very precisely defined the notion of "algorithm". And so he had several professions: computer scientist cryptographer And mathemetician

23. Internet Technologies23 100 5 3 6 will not be parsed for markup]]> <!ELEMENT FixedFloatSwap ( Notional, Fixed_Rate, NumYears, NumPayments, Note ) > XML Document DTD CDATA Section

24. Internet Technologies24 Recursion <!DOCTYPE tree [ ]> A DTD is a context-free grammar java Validate recursive1.xml Valid document is true

25. Internet Technologies25 How about this one? <!DOCTYPE tree [ ]> Alan Turing would like this Alan Turing would like this java Validate recursive1.xml org.xml.sax.SAXParseException: The content of element type "tree" must match "(node)". Valid document is false

26. Internet Technologies26 Relational Databases and XML Consider the relational database r1(a,b,c), r2(c,d) r1: a b c r2: c d a1 b1 c1 c2 d2 a2 b2 c2 c3 d3 c4 d4 How can we represent this database with an XML DTD?

27. Internet Technologies27 Relations <!DOCTYPE db [ ]> a1 b1 c1 c2 d2 c3 d3 c4 d4 java Validate Db.xml Valid document is true There is a small problem….

28. Internet Technologies28 Relations <!DOCTYPE db [ ]> a1 b1 c1 c2 d2 c3 d3 c4 d4 The order of the relations should not count and neither should the order of columns within rows.

29. Internet Technologies29 Attributes An attribute is associated with a particular element by the DTD and is assigned an attribute type. The attribute type can restrict the range of values it can hold. Example attribute types include : CDATA indicates a simple string of characters NMTOKEN indicates a word or token A named token group such as (left | center | right) ID an element id that holds a unique value (among other element ID’s in the document) IDREF attributes refer to an ID

30. Internet Technologies30 DTD 100 5 3 6 XML Document C:\McCarthy\www\46-928\examples\sax>java Validate FixedFloatSwap.xml org.xml.sax.SAXParseException: Attribute value for "currency" is #REQUIRED. Valid document is false

31. Internet Technologies31 DTD 100 5 3 6 XML Document Valid document is true

32. Internet Technologies32 DTD 100 5 3 6 XML Document Valid document is true #IMPLIED means optional

33. Internet Technologies33 DTD 100 5 3 6 XML Document Valid document is true

34. Internet Technologies34 DTD 100 5 3 6 XML Document Valid document is true #IMPLIED means optional

35. Internet Technologies35 DTD 100 5 3 6 XML Document Valid document is true

36. Internet Technologies36 ID and IDREF Attributes We can represent complex relationships within an XML document using ID and IDREF attributes.

37. Internet Technologies37 An Undirected Graph u vw x y z edge vertex

38. Internet Technologies38 A Directed Graph u w v y x

39. Internet Technologies39 Math 100 Geom100 Calc100Calc200 Calc300 Philo45CS1 CS2 This is called a DAG (Directed Acyclic Graph)

40. Internet Technologies40 Algebra I Students in this course study introductory algebra. This course has an ID But no prerequisites

41. Internet Technologies41 Geometry I Students in this course study how to prove several theorems in geometry. The DTD will force this to be unique.

42. Internet Technologies42 Calculus I Students in this course study the derivative. These are references to ID’s. (IDREFS)

43. Internet Technologies43 Calculus II Students in this course study the integral. The DTD requires that this name be a unique id defined within this document. Otherwise, the document is invalid.

44. Internet Technologies44 Calculus II Students in this course study the derivative and the integral (in 3-space). Prerequisites is an EMPTY element. It’s used only for its attributes.

45. Internet Technologies45 Introduction to Computer Science I In this course we study Turing machines. IDREFID A One-to-one link

46. Internet Technologies46 Introduction to Computer Science II In this course we study basic data structures. IDREFS ID One-to-many links

47. Internet Technologies47 Ethical Implications of Information Technology TBA

48. Internet Technologies48 The Course_Descriptions.dtd

49. Internet Technologies49 General Entities & General entities are used to place text into the XML document. They may be declared in the DTD and referenced in the document. They may also be declared in the DTD as residing in a file. They may then be referenced in the document.

50. Internet Technologies50 <!DOCTYPE FixedFloatSwap SYSTEM "FixedFloatSwap.dtd" [ ] > &bankname; 100 5 3 6 <!ELEMENT FixedFloatSwap (Bank,Notional, Fixed_Rate, NumYears, NumPayments ) > DTD Document using a General Entity Validate is true

51. Internet Technologies51 <xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version="1.0"> XSLT Program The general entity is replaced before xslt sees it.

52. Internet Technologies52 C:\McCarthy\www\46-928\examples\sax>java -Dcom.jclark.xsl.sax.parser=com.jclark. xml.sax.CommentDriver com.jclark.xsl.sax.Driver FixedFloatSwap.xml FixedFloatSwa p.xsl FixedFloatSwap.wml C:\McCarthy\www\46-928\examples\sax>type FixedFloatSwap.wml Mellon National Bank and Trust XSLT OUTPUT

53. Internet Technologies53 <!DOCTYPE FixedFloatSwap SYSTEM "FixedFloatSwap.dtd" [ ] > &bankname; 100 5 3 6 An external text entity

54. Internet Technologies54 Mellon Bank And Trust Corporation Pittsburgh PA XSLT Output Mellon Bank And Trust Corporation Pittsburgh PA JustAFile.dat

55. Internet Technologies55 Parameter Entities % While general entities are used to place text into the XML document parameter entities are used to modify the DTD. We want to build modular DTD’s so that we can create new DTD’s using existing ones. We’ll look at slide from www.fpml.org and the see some examples.www.fpml.org

56. Internet Technologies56 FpML is a Complete Description of the Trade Pool of modular components grouped into separate namespaces Date Schedule Product Rate Adjustable Period Notional Party Trade Trade ID Product Rate Adjustable Period Notional Party Vanilla Swap Vanilla Fixed Float Swap Cancellable Swaption FX Spot FX Outright FX Swap Forward Rate Agreement... Money Date

57. Internet Technologies57 <!ELEMENT FixedFloatSwap (Notional, Fixed_Rate, NumYears, NumPayments ) > XML Document DTD Internal Parameter Entities 100 5 3 6

58. Internet Technologies58 External Parameter Entities and DTD Components Kevin Dick 123 Anywhere Lane Apt 1b Palo Alto CA 94303 USA Order.xml

59. Internet Technologies59 Kevin Dick 123 Not The Same Lane Work Place Palo Alto CA 94300 USA An order may have more than one address.

60. Internet Technologies60 440BX Motherboard 1 200 128 MB PC-100 DIMM 2 175 40x CD-ROM 1 50 Several products may be purchased.

61. Internet Technologies61 Kevin S. Dick 11111-22222-33333 01/01 The payment is with a Visa card. We want this document to be validated.

62. Internet Technologies62 order.dtd <!ATTLIST ORDER SOURCE (web | phone | retail) #REQUIRED CUSTOMERTYPE (consumer | business) "consumer" CURRENCY CDATA "USD" > Define an order based on other elements.

63. Internet Technologies63 %anAddress; %aLineItem; %aPayment; External parameter entity declaration % External parameter entity reference %

64. Internet Technologies64 address.dtd <!ELEMENT address (firstname, middlename?, lastname, street+, city, state,postal,country)> <!ATTLIST address ADDTYPE (bill | ship | billship) "billship"> <!ATTLIST street ORDER CDATA #IMPLIED>

65. Internet Technologies65 lineitem.dtd <!ATTLIST lineitem ID ID #REQUIRED> <!ATTLIST product CAT (CDROM|MBoard|RAM) #REQUIRED>

66. Internet Technologies66 <!ATTLIST card CARDTYPE (VISA|MasterCard|Amex) #REQUIRED> payment.dtd