1.  Michael Rys Principal Lead Program Manager Microsoft Corporation mrys@microsoft.com BB16

2. Pain Points Reduce the cost of managing all types of data Simplify the development of applications which use relational and non-relational data Extend services currently available for relational data to non-relational data Provide non-relational services to relational data Goals

5. SQL Server 2005 SQL Server 2008 Large UDTs Sparse Columns Wide Tables Filtered Indices HierarchyID Relational BR Support User Defined Types Full Text Indexing Documents & Multimedia Remote BLOB Store API Filestream Integrated FTS Spatial Fully supported Geometry and Geography data types and Functions XML Data Type and Functions XML Upgrades XML

6. Low cost per GB Streaming Performance Complex application development and deployment Integration with structured data Advantages Challenges Integrated management Data-level consistency Poor data streaming support File size limitations Highest cost per GB Lower cost/GB at scale Scalability & Expandability Complex application development and deployment Separate management Enterprise-scales only Example Windows File Servers NetApp NetFiler EMC Centera Fujitsu Nearline SQL Server VARBINARY(MAX) Documents & Multimedia Use File Servers DB ApplicationApplication BLOBs Dedicated BLOB Store DB ApplicationApplication BLOBs Store BLOBs in Database DB ApplicationApplication BLOBs

7. Remote BLOB Storage FILESTREAM Storage SQL BLOB Documents & Multimedia Use File Servers DB ApplicationApplication BLOB Dedicated BLOB Store DB ApplicationApplication BLOB Store BLOBs in Database DB ApplicationApplication BLOB Store BLOBs in DB + File System ApplicationApplication BLOB DB

8. Documents & Multimedia Store BLOBs in DB + File System ApplicationApplication BLOB DB

9. Applications Provider Library Provider Library Provider Library Remote BLOB Store API Client BLOB Store 1 BLOB Store 2 BLOB Store 3 SQL Server Provider API Services Create Enumerate Fetch GC Delete Documents & Multimedia

11. Documents & Multimedia

12. Documents & Multimedia SELECT * FROM candidates WHERE CONTAINS(resume,’”SQL Server”’) AND ZipCode = ‘98052’

13. Doc_table iddoc_typedocument T-SQL Parser Algebrizer SQL Algeb. FTS Algeb. Algebrizer SQL Algeb. FTS Algeb. Bind Language Module FTS Algeb. Parse Ranking Func. Integration SQL SERVER processFDHOST process Shared Memory WB Stemmer iFilters STOPLIST THESAURUS WB client QO QE SQL/FTS integrated query tree FTLogicalOperator Cardinality FTExecutionOperator QUERY Execution Plan Full-Text Index Results CREATE FULLTEXT INDEX ft_idx ON Doc_table(document TYPE COLUMN doc_type) KEY INDEX doc_id_idx; Documents & Multimedia

14. Populating an index of 20million rows of 1k data on identical hardware (time in minutes) Documents & Multimedia 2 min1 min

15. Spatial See BB24 – SQL Server 2008: Deep Dive into Spatial Data

16. XML

18. Relational BR Support

19. Relational BR Support

20. Relational BR Support

21. Relational BR Support

22. Relational BR Support

24. / /1/ /1/1/ /1/1/1/ /1/1/2/ /1/2/ /2//3/ /3/1//3/2/ Relational BR Support

25. // Sparse as a storage attibute in Create/Alter table statements Create Table Products(Id int, Type nvarchar(16)…, Resolution int SPARSE, ZoomLength int SPARSE); // No Change in Query/DML Behavior Select Id, Type, Resolution, ZoomLength from Products; Update Products set Resolution=3, ZoomLength = 105 where Id = 101; // Sparse as a storage attibute in Create/Alter table statements Create Table Products(Id int, Type nvarchar(16)…, Resolution int SPARSE, ZoomLength int SPARSE); // No Change in Query/DML Behavior Select Id, Type, Resolution, ZoomLength from Products; Update Products set Resolution=3, ZoomLength = 105 where Id = 101; Relational BR Support

26. // Create a sparse column set Create Table Products(Id int, Type nvarchar(16)…, Resolution int SPARSE, ZoomLength int SPARSE, Properties XML COLUMN_SET FOR ALL_SPARSE_COLUMNS); // Generic relational access to sparse column set. // Returns an aggregated XML fragment for all non-null sparse columns Select Id, Type, Properties from Products; 4 70 // Generic updates through sparse column set. Similar to an XML update Update Products set Type = ‘Camera”, Properties = @xml // Create a sparse column set Create Table Products(Id int, Type nvarchar(16)…, Resolution int SPARSE, ZoomLength int SPARSE, Properties XML COLUMN_SET FOR ALL_SPARSE_COLUMNS); // Generic relational access to sparse column set. // Returns an aggregated XML fragment for all non-null sparse columns Select Id, Type, Properties from Products; 4 70 // Generic updates through sparse column set. Similar to an XML update Update Products set Type = ‘Camera”, Properties = @xml Relational BR Support

28. PKC1 1A(sc1,sc9)(1,9) 2B(sc2,sc4)(2,4) 3C(sc6,sc7)(6.7) 4D(sc1,sc5)(1,5) 5E(sc4,sc8)(4,8) 6F(sc3,sc9)(3,9) 7G(sc5,sc7)(5,7) 8H(sc2,sc8)(2,8) 9I(sc3,sc6)(3,6) sc 1 sc2sc3sc4sc5sc6sc7sc8sc9 PKc1sc1sc2sc3sc4sc5sc6sc7sc8sc9 1A19 2B24 3C67 4D15 5E48 6F39 7G57 8H28 9I36 Non-sparse storage Sparse storage Relational BR Support

29. Relational BR Support

33. 33 http://connect.microsoft.com/sqlserver/feedback

34. © 2008 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.