Presentation is loading. Please wait.

Presentation is loading. Please wait.

Index Index Node Index Content Engine Store DB Document Parser(s) Filter Word Break Content XForm Index Writer Content flow operators (simplified)

Similar presentations


Presentation on theme: "Index Index Node Index Content Engine Store DB Document Parser(s) Filter Word Break Content XForm Index Writer Content flow operators (simplified)"— Presentation transcript:

1

2

3

4 Index

5 Index Node Index Content Engine Store DB Document Parser(s) Filter Word Break Content XForm Index Writer Content flow operators (simplified) Search service

6 Content Engine Store DB Document Parser(s) Filter Word Break Content XForm Index Writer Content flow operators (simplified) Transport

7 Content Engine Store DB Document Parser(s) Filter Word Break Content XForm Index Writer Transport Annotation stream writer Annotation stream reader Index Node Index Metadata (aka annotation stream) Words to index only Word break boundaries Stored on message Usually much smaller than body Search service

8 Mailbox Database Document Index System Tokens Amount of data read from the mailbox item will be reduced if an “annotation stream” is already present Document ID enters here… Tokens (or an error record) are written out to the index at the end of the flow…

9 MasterL5L4L3L2L1 L2L1 L3 L4L3 L4L3

10 HKLM\Software\Microsoft\ExchangeServer\v15\Search\SystemParameters MaxAttachmentDepth (default value: 2) MaxAttachmentCount (default value: 10) ProcessImages (default value: 0) MarkSkippedImagesAsPartiallyProcessed (default value: 0)

11 GroupFormatHandled by Parsers Microsoft Office.xls, etc..one.msg.ppt, etc..pub.vsd,.vsdx, etc..doc,.rtf, etc. Other Microsoft XML Paper Specification.eml,.mhtml,.rss, etc..xps Adobe Acrobat.pdf OpenOffice.org OpenOffice.odp, etc. Image GIF JPEG TIFF.gif, etc..jpg, etc..tif, etc. Other HTML Plain Text XML ZIP.htm, etc..txt,.csv, etc..xml, etc..zip

12 HostControllerService.exe (Windows service) NodeRunner.exe (“Admin Node”) NodeRunner.exe (“Content Engine Node”) NodeRunner.exe (“Interaction Engine Node”) NodeRunner.exe (“Index Node”) XML config Host Controller Service is started by the Exchange Search service. Host Controller starts 4 worker processes, each named NodeRunner. These communicate with each other and with Exchange with Windows Communication Foundation. ParserServer.exe (Ifilter sandbox)

13

14 – Check search health per Server or per MDB with Test-ExchangeSearch – List unindexed documents per Server or per MDB or per MBX with Get- FailedContentIndexDocuments

15 Crawler: Items ProcessedNotifications: Delayed ItemsNotifications: Processed/sec Crawler: Items Sent for ProcessingNotifications: Deletes ProcessedRetry: Deleted Mailboxes Remaining Crawler: Mailboxes RemainingNotifications: Deletes Processed/secRetry: Items Deleted Crawler: Submission Delay TimeNotifications: Items ProcessedRetry: Items Processed Crawler: Submission DelaysNotifications: Items Sent for ProcessingRetry: Items Sent for Deletion Failed ItemsNotifications: Last Successful Poll TimestampRetry: Items Sent for Processing Feeding SessionsNotifications: Moves ProcessedRetry: Retriable Items Items ProcessedNotifications: Moves Processed/secRetry: Submission Delay Time Items Processed/secNotifications: ProcessedRetry: Submission Delays Notifications: Age of Last Notification ProcessedNotifications: Processed/sec Notifications: Awaiting ProcessingNotifications: Queue Length Notifications: Creates ProcessedNotifications: Stall Time Notifications: Creates Processed/secNotifications: Updates Processed Rate at which items are being processed into the index(es) Number of items that are scheduled for reprocessing (because of a previous timeout or failure)

16 MBX1 DBIndex MBX2 DBIndex MBX3 DBIndex Transport Role Transport Content Node Flow Before DL Expansion Local delivery Log shipping Retrieval/indexing

17

18 Index

19 Interaction Engine Store DB Word break Parse Content XForm Middle Tier (depends on protocol) Index Node Index Query Plan TWIR Filter Word break Parse

20

21

22

23

24 Let’s talk numbers BUSINESS S SENT DURING THIS TALK BEFORE AN O365 USER NEEDS TO DELETE ANY (20 75 KB) AVERAGE IW SPENDS SEARCHING FOR AND GATHERING INFORMATION

25 New search experiences raised user expectations Suggestions Instant results Relevant refiners

26 Users struggle to find what they are looking for, re-searching frequently Source: OXG Search Focus Groups PAIN POINTS

27 Introducing personalized search

28

29

30

31

32

33

34

35

36

37

38

39


Download ppt "Index Index Node Index Content Engine Store DB Document Parser(s) Filter Word Break Content XForm Index Writer Content flow operators (simplified)"

Similar presentations


Ads by Google