1. Object Oriented Programming Generic Collections and LINQ Dr. Mike Spann m.spann@bham.ac.uk

2. Contents Introduction to collection objects and LINQ Introduction to collection objects and LINQ Querying an array Querying an array Generic collections Generic collections Querying a generic collection Querying a generic collection LINQ to XML LINQ to XML Summary Summary

3. Introduction to collection objects and LINQ.NET provides a set of pre-packaged data structures known as collections.NET provides a set of pre-packaged data structures known as collections  They have been carefully designed to ensure robust and efficient performance  Array  Efficient random access but inefficient to resize it  List  Enables dynamic resizing but not random access

4. Introduction to collection objects and LINQ In addition, C# provides a mechanism for querying collections known as LINQ In addition, C# provides a mechanism for querying collections known as LINQ  Language Integrated Query LINQ enables access to collections (and databases!) using query expressions which are similar to SQL queries LINQ enables access to collections (and databases!) using query expressions which are similar to SQL queries  This allows the retrieval of information from a wide variety of data sources

5. Introduction to collection objects and LINQ We will primarily look at LINQ to Objects We will primarily look at LINQ to Objects  Enables the querying on collection objects.NET also provides LINQ providers for :.NET also provides LINQ providers for :  LINQ to SQL  For querying databases  LINQ to XML  For querying xml documents

6. Querying an array We can design a simple LINQ query which filters the contents of an array We can design a simple LINQ query which filters the contents of an array  Applying the query to the array causes all the values of the array which meet a certain criteria to be extracted  But the query doesn’t say how the iteration through the array is performed  All the necessary code is generated by the compiler, the query just specifies the criteria

7. Querying an array A simple query object comprises from, where and select clauses A simple query object comprises from, where and select clauses  Also, we can make use of the keyword var which is an implicit type  Essentially a strongly typed local variable but the type is determined by the compiler  In this case the type of the array is determined by the data source type var filteredArray = from......// range variable and data source where.....// boolean expression select.....// which value appears in the results

8. using System; using System.Collections.Generic; using System.Linq; class LINQtoArray { static void Main(string[] args) { int[] array = { 2, 6, 4, 12, 7, 8, 9, 13, 2 }; var filteredArray =// LINQ query from element in array where element < 7 select element; PrintArray(filteredArray, "All values less than 7:"); } public static void PrintArray(IEnumerable arr, string message) { Console.Write("{0}",message); foreach (var element in arr) Console.Write(" {0}", element); Console.WriteLine(); }

9. Querying an array IEnumerable is an interface implemented by arrays and collections IEnumerable is an interface implemented by arrays and collections It is a generic type It is a generic type  We replace the T by a real type (such as an int)  More on this later

10. Querying an array We can add the orderby (descending) clause to our query to sort our filtered array into ascending (descending) order We can add the orderby (descending) clause to our query to sort our filtered array into ascending (descending) order var filteredArray = from......// range variable and data source where.....// boolean expression orderby..... (descending) // sort select.....// which value appears in the resul ts

11. using System; using System.Collections.Generic; using System.Linq; class LINQtoArray { static void Main(string[] args) { int[] array = { 2, 6, 4, 12, 7, 8, 9, 13, 2 }; var filteredArray =// LINQ query from element in array where element < 7 select element; PrintArray(filteredArray, "All values less than 7:"); var orderedFilteredArray = from element in filteredArray orderby element select element; PrintArray(orderedFilteredArray, "All values less than 7 and sorted:"); } public static void PrintArray(IEnumerable arr, string message) {……} }

12. Querying an array It's important to understand a feature of LINQ known as deferred execution It's important to understand a feature of LINQ known as deferred execution  The result of a LINQ query expression is not a sequence or collection of objects but a query object  It represents the commands needed to execute the query  The query does not execute until the program requests data from the query object  Deferred execution is a powerful feature of LINQ as it allows applications to pass queries around as data  In our simple example, the query is not run until it is passed to the PrintArray method

13. Querying an array We can use LINQ to query an array of user defined objects or strings We can use LINQ to query an array of user defined objects or strings We must be careful when using orderby We must be careful when using orderby  The objects must be comparable  Comparable types in.NET implement the IComparable interface  Built in primitive types automatically implement IComparable  Built in primitive types automatically implement IComparable  The ‘T’ is a parameterised type  We will look at these in more detail later For example we can query an array of StudentInfo objects For example we can query an array of StudentInfo objects

14. class StudentInfo { public StudentInfo(string ln, string fn, int id, string a) { lastName = ln; firstName = fn; idNumber = id; address = a; } public override string ToString() { return firstName+" "+lastName+" "+idNumber+" " +address; } public string FirstName { get { return firstName; } } public string LastName { get { return lastName; } } public string Address { get { return address; } } public int ID { get { return idNumber; } } private string firstName,lastName; private int idNumber; private string address; }

15. Querying an array We can filter the array by ID number We can filter the array by ID number  Simply get the ID property of the range variable Also we can sort the names into last name order and then first name order using orderby Also we can sort the names into last name order and then first name order using orderby  This uses the fact that the string type implements IComparable  This uses the fact that the string type implements IComparable

16. public class LINQtoObjectArray { static void Main(string[] args) { StudentInfo[] students ={ new StudentInfo("Smith", "John", 12345, "5 Bournbrook Rd"), new StudentInfo("Brown", "Alan", 23412, "Dawlish Rd"), new StudentInfo("Smith","Colin", 41253, "23 Bristol Rd"), new StudentInfo("Hughes", "Richard", 52314, "18 Prichatts Rd"), new StudentInfo("Murphy", "Paul", 16352, "37 College Rd") }; // Filter a range of ID numbers var idRange= from s in students where s.ID>19999 && s.ID<=49999 select s; PrintArray(idRange,"Students with ID in Range 2000 to 4999"); // Order by last name and then first name var nameSorted = from s in students orderby s.LastName, s.FirstName select s; PrintArray(nameSorted, "Students sorted in last name, first name order"); } public static void PrintArray (IEnumerable arr, string message) {…} }

17. Querying an array

18. We can use LINQ to sort the array of StudentInfo objects by implementing the IComparable interface We can use LINQ to sort the array of StudentInfo objects by implementing the IComparable interface  We simply need to implement the CompareTo() method  If this isn’t done when we try and sort an array of objects using LINQ, a runtime exception is generated

19. Querying an array class StudentInfo : IComparable { public StudentInfo(string ln, string fn, int id, string a) { lastName = ln; firstName = fn; idNumber = id; address = a; } public int CompareTo(object obj) { StudentInfo s = (StudentInfo)obj; if (s.ID < ID) return 1; else if (s.ID > ID) return -1; else return 0; }. private string firstName,lastName; private int idNumber; private string address; }

20. Querying an array public class LINQtoObjectArray { static void Main(string[] args) { StudentInfo[] students ={ new StudentInfo("Smith", "John", 12345, "5 Bournbrook Rd"), new StudentInfo("Brown", "Alan", 23412, "Dawlish Rd"), new StudentInfo("Smith","Colin", 41253, "23 Bristol Rd"), new StudentInfo("Hughes", "Richard", 52314, "18 Prichatts Rd"), new StudentInfo("Murphy", "Paul", 16352, "37 College Rd") }; // Order by ID var IDSorted = from s in students orderby s select s; PrintArray(IDSorted, "Students sorted in ID order"); public static void PrintArray (IEnumerable arr, string message) {…} }

21. Querying an array

22. LINQ defines a number of extension methods of IEnumerable LINQ defines a number of extension methods of IEnumerable  Extension methods extend the functionality of existing classes (including classes in the FCL)  Any() Checks to see if the container has any membersChecks to see if the container has any members  Count() Returns a count of the number of membersReturns a count of the number of members  First(), Last() Returns the first and last members of the containerReturns the first and last members of the container  Distinct() Removes duplicate membersRemoves duplicate members

23. public class LINQtoObjectArray { static void Main(string[] args) { StudentInfo[] students ={ new StudentInfo("Smith", "John", 12345, "5 Bournbrook Rd"), new StudentInfo("Brown", "Alan", 23412, "Dawlish Rd"), new StudentInfo("Smith","Colin", 41253, "23 Bristol Rd"), new StudentInfo("Hughes", "Richard", 52314, "18 Prichatts Rd"), new StudentInfo("Murphy", "Paul", 16352, "37 College Rd") }; // Order by last name and then first name var nameSorted = from s in students orderby s.LastName, s.FirstName select s; PrintArray(nameSorted, "Students sorted in last name, first name order"); Console.WriteLine("There are " + students.Count() + " students"); if (nameSorted.Any()) { Console.WriteLine("First in list " + nameSorted.First().ToString()); Console.WriteLine("Last in list " + nameSorted.Last().ToString()); }

24. Querying an array

25. Generic collections In our example programs so far we have already seen a generic method PrintArray In our example programs so far we have already seen a generic method PrintArray  This function outputs the string representation of the elements of an array  Its full declarations is :  PrintArray takes any type which implements the IEnumerable interface  Thus an IEnumerable object of any type can be passed to the method public static void PrintArray (IEnumerable arr,string message)

26. Generic collections The compiler infers the type T from the actual call to PrintArray The compiler infers the type T from the actual call to PrintArray public class LINQtoObjectArray { static void Main(string[] args) { StudentInfo[] students ={………}; // Order by last name and then first name var nameSorted = from s in students orderby s.LastName, s.FirstName select s; // PrintArray called here PrintArray(nameSorted, "Students sorted in last name, first name order");. }

27. Generic collections Also the compiler determines whether the operations in the method body can be performed on any type the T represents Also the compiler determines whether the operations in the method body can be performed on any type the T represents class MyClass { public static void PrintArray(IEnumerable arr, string message) { Console.Write("{0}",message); // Requires a ToString() override method for non built in types foreach (var element in arr) Console.Write(" {0}", element); Console.WriteLine(); }

28. Generic collections Collections store groups of objects Collections store groups of objects We are all familiar with arrays We are all familiar with arrays  Arrays don’t resize dynamically but do so when the Resize() method is called The collection class List dynamically resizes when objects are inserted The collection class List dynamically resizes when objects are inserted  It’s known as a generic class because real classes are instantiated by providing actual types in place of T  List, List, List etc

29. Generic collections Method or property Description Add Adds an element to the end of the List Capacity Property that gets or sets the number of elements a List can store Clear Removes all the elements from the List Contains Returns true if the List contains the specified element; otherwise, returns false Count Property that returns the number of elements stored in the List IndexOf Returns the index of the first occurrence of the specified value in the List Insert Inserts an element at the specified index Remove Removes the first occurrence of the specified value RemoveAt Removes the element at the specified index RemoveRange Removes a specified number of elements starting at a specified index Sort Sorts the List TrimExcess Sets the Capacity of the List to the number of elements the List currently contains (Count)

30. Generic collections We can create a list of StudentInfo objects and add items (to the end of the list) and insert items (anywhere in the list) We can create a list of StudentInfo objects and add items (to the end of the list) and insert items (anywhere in the list) We can display the list using exactly the same generic function as for displaying an array We can display the list using exactly the same generic function as for displaying an array We could manipulate the list using the methods shown in the table We could manipulate the list using the methods shown in the table

31. public class LINQtoList { static void Main(string[] args) { StudentInfo[] students ={ new StudentInfo("Smith", "John", 12345, "5 Bournbrook Rd"), new StudentInfo("Brown", "Alan", 23412, “Dawlish Rd"), new StudentInfo("Smith","Colin", 41253, "23 Bristol Rd"), new StudentInfo("Hughes", "Richard", 52314, "18 Prichatts Rd"), new StudentInfo("Murphy", "Paul", 16352, "37 College Rd") }; List studentList = new List (); studentList.Add(students[0]); studentList.Add(students[1]); studentList.Add(students[2]); studentList.Insert(2, students[3]); PrintList(studentList, "Student list:"); } public static void PrintList (IEnumerable arr, string message) { Console.WriteLine("{0}", message); foreach (T element in arr) Console.WriteLine(" {0}", element); Console.WriteLine(); }

32. Generic collections

33. Querying a generic collection LINQ to Objects can query lists (and any other collection) in much the same way as querying an array LINQ to Objects can query lists (and any other collection) in much the same way as querying an array For example, we could sort our list of students after first converting their surnames into upper case For example, we could sort our list of students after first converting their surnames into upper case  The query makes use of the let clause which creates a new range variable  Enables a temporary result to be stored for later use in the query

34. public class LINQtoList { static void Main(string[] args) { StudentInfo[] students ={ new StudentInfo("Smith", "John", 12345, "5 Bournbrook Rd"), new StudentInfo("Brown", "Alan", 23412, “Dawlish Rd"), new StudentInfo("Smith","Colin", 41253, "23 Bristol Rd"), new StudentInfo("Hughes", "Richard", 52314, "18 Prichatts Rd"), new StudentInfo("Murphy", "Paul", 16352, "37 College Rd") }; List studentList = new List (); studentList.Add(students[0]); studentList.Add(students[1]); studentList.Add(students[2]); studentList.Insert(2, students[3]); var orderedUpperCaseList = from student in studentList let upperCaseName = student.LastName.ToUpper() orderby upperCaseName select upperCaseName; PrintList(orderedUpperCaseList, "Ordered student list:"); } public static void PrintList (IEnumerable arr, string message) {…} }

35. Querying a generic collection

36. LINQ to XML XML (Extensible Markup Language) is a widely supported standard for describing virtually any kind of information data XML (Extensible Markup Language) is a widely supported standard for describing virtually any kind of information data It is a used primarily to describe data which is shared between applications across a network It is a used primarily to describe data which is shared between applications across a network It comprises elements delineated by a start and end tag and data It comprises elements delineated by a start and end tag and data XML files are simple text files with no formatting structure XML files are simple text files with no formatting structure LINQ contains a number of classes for parsing and manipulating XML files LINQ contains a number of classes for parsing and manipulating XML files

37. LINQ to XML A simple XML document can describe student information data A simple XML document can describe student information data John Smith February 21 1987 45235 Electrical Engineering MEng 21 Bristol Road

38. LINQ to XML XML documents can be stored as a tree structure in memory XML documents can be stored as a tree structure in memory  Known as a Document Object Model (DOM) tree  Each element in the XML document is represented by a tree node  XML parsers can create such a tree from the XML file  The tree can then be manipulated programmatically by high level languages

39. LINQ to XML studentInfo name birthday courseInfo address code courseTitle degree

40. LINQ to XML Namespace System.Xml.Linq contains classes used to manipulate a DOM Namespace System.Xml.Linq contains classes used to manipulate a DOM  XDocument represents an entire XML document  XElement represents a tree node  XElement.Name property allows the name of the node element to be get or set (including namespace)  XElement.Name.LocalName is the name without the namespace prefix

41. LINQ to XML We can write a simple program which uses these classes to read in our XML document and display individual elements We can write a simple program which uses these classes to read in our XML document and display individual elements  Uses the HasElements property to determine if an XElement object has children and Elements() method to obtain the children  Uses the Value property to return text associated with an XElement object (for XElement objects with no children)

42. using System; using System.Collections.Generic; using System.Linq; using System.Xml.Linq; public class LINQtoXML { public static void Main(string[] args) { XDocument doc = XDocument.Load(“StudentInfo.xml”); PrintElement(doc.Root, 0); } private static void PrintElement(XElement element, int indentLevel) { string name = element.Name.LocalName; Indent(indentLevel); Console.WriteLine(' '); if (element.HasElements) foreach (var child in element.Elements()) PrintElement(child,indentLevel+1); else { Indent(indentLevel+1); Console.WriteLine(element.Value.Trim()); } Indent(indentLevel); Console.WriteLine(" '); } private static void Indent(int level) { for (int i = 0; i < level; i++) Console.Write(" "); }

43. LINQ to XML

44. We can use LINQ to query an XML file in order to select specific elements or properties of elements We can use LINQ to query an XML file in order to select specific elements or properties of elements For example we can extract an element and all it’s descendants using the Descendants() method For example we can extract an element and all it’s descendants using the Descendants() method  We can then iterate through each of these using the Elements() method

45. LINQ to XML public class LINQtoXML { public static void Main(string[] args) { XDocument doc = XDocument.Load("StudentInfo.xml"); // Select a specific element var elements = from el in doc.Descendants("courseInfo") select el; foreach (var e in elements) PrintElement(e, 0); Console.WriteLine(); var elements1 = from e2 in doc.Descendants("courseInfo").Elements() where e2.Name.LocalName.StartsWith("c") select e2; foreach (var e in elements1) PrintElement(e, 0); } private static void PrintElement(XElement element, int indentLevel) {....} }

46. LINQ to XML

47. Summary We have looked at querying simple arrays using LINQ We have looked at querying simple arrays using LINQ We have looked at extension methods and how they are incorporated into LINQ We have looked at extension methods and how they are incorporated into LINQ We have looked at generic lists and how we query them using LINQ We have looked at generic lists and how we query them using LINQ We have looked at LINQ to XML and how we can query XML files using LINQ We have looked at LINQ to XML and how we can query XML files using LINQ