1. Architecting Search in 2013/2016 On-Prem Ajay Iyer

2. SharePoint Architect @shankarajay1 http://sharepointadminstuff.wordpress.com Solution Architecture, Capacity Planning, Search, Migrations, Enterprise Content Management, Document Imaging and….. InfoPath

3. Outline Review Search Components & Terminologies Gather Requirements for Search (What specifics should you ask?) Search Farm Architecture & Design Incremental Crawls or Continuous Crawls? What’s new in SP2016 Search?

4. Review of Search Components & Terminologies

5. Review of Search Components Search Roles Search Administration Crawl Content Processing Analytics Processing Index Query Processing Search Databases Search Administration DB Crawl DB Analytics Reporting DB Link DB

6. Other Search-related Terminologies No. of items in Index Search Topology Index Partitions Content Sources Incremental Crawls/Continuous Crawls Full Crawls Crawled Properties Managed Properties

7. Review of Search Components Crawl Content Processing Index Analytics Processing Query Processing Links DB WFEs Search Index Analytics DB Crawl DB

8. Gathering Requirements for Search

9. How many web applications & site collections in current environment? How many total documents? What are the different document file types? PDFs, TIFFs, DOCX, XLSX, etc. ? Are the PDF’s, image-only or searchable? What’s the frequency of content additions and changes? How quickly do the users expect their documents to be searchable, after uploading to SharePoint? Are there any Line-Of-Business external applications that interface with SharePoint? Questions

10. Gathering Requirements for Search QuestionsResponse No. of Web Apps2 No. of Site Collections25 Total No. of Documents3,980,272 Document File TypesPDFs (mostly), approx. 25,000 office documents, approx. 3000 TIFFs PDF TypesMostly Searchable PDFs, and approx. 2000 Image-Only PDFs Frequency of content changeApprox. 200 documents added per hour How soon should docs be retrievable from search 10 minutes or less Sample Response

11. Search Farm Architecture & Design

12. Sample Search Farm Design DB Server WFE 1 WFE 2 APP 1 APP 2 Office Web Apps WAWS

13. Search Farm Architecture & Design Sample Search Farm Design DB Server WFE 1 WFE 2 APP 1 APP 2 Office Web Apps WAWS CRWLR 1 Query component Crawl/Search Admin components

14. Search Farm Architecture & Design Crawl & Search Admin Servers: 8 vCPUs 32GB RAM 80GB - System Drive 120GB - Data Drive (SP Binaries, Data, Logs) 40GB – Drive for Search Index Search Servers Specifications

15. Search Farm Architecture & Design Analytics & Content Processing Servers: 4 vCPUs 16GB RAM 80GB - System Drive 120GB - Data Drive (SP Binaries, Data, Logs) Search Servers Specifications

16. Search Farm Architecture & Design Query Servers: 4 vCPUs 16GB RAM 80GB - System Drive 120GB - Data Drive (SP Binaries, Data, Logs) 40GB – Drive for Search Index Search Servers Specifications

17. Search Farm Architecture & Design Incremental Crawls or Continuous Crawls??

18. Don’t forget about your DB servers!

19. Search Farm Architecture & Design Incremental, Continuous and Full Crawls add a lot of disk I/O to the DB servers Possible Issues: Slow Crawl Rates (dps in the single digits) Documents getting skipped during indexing High query latency (takes too long for search results to come back)

20. Search Farm Architecture & Design Possible Resolutions: Check disk I/O on the SQL server data drive Move the Search Databases to a different LUN (if virtual) or DISK (if physical) Change the Search Performance level from the default “Maximum” to “Partly Reduced” or “Reduced” Here’s how you fix it using PowerShellhow Check memory utilization on the crawl & query servers Look for RAM utilization on the msssearch.exe and noderunner.exe services

21. What’s new in SP2016 Search

22. What’s New in SP2016 Search

23. Each Search Service Application now supports indexing up to 500 million items (SP2013 supported 250 million items) Searching for sensitive documents. E.g. documents with SSNs, credit cards, passport numbers etc. in them, using Data Loss Prevention (DLP) Hybrid Search is available in SharePoint 2016 and SharePoint 2013 + August September 2015 CU Can crawl Office 365 content as well as On-Prem content and get unified results across both.

24. Additional Questions?

25. Ajay Iyer SharePoint Architect @shankarajay1 http://sharepointadminstuff.wordpress.com Solution Architecture, Capacity Planning, Search, Migrations, Enterprise Content Management, Document Imaging and….. InfoPath