1. Tech·Ed North America 2009 12/8/2018 12:16 PM
© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

2. New NUMA Support with Windows Server 2008 R2 and Windows 7
Tech·Ed  North America 2009
12/8/ :16 PM
New NUMA Support with Windows Server 2008 R2 and Windows 7
Phil Pennington
Microsoft
WSV317
© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

3. What will you look for? Overall Solution Scalability

4. Agenda Windows Server 2008 R2
12/8/ :16 PM
Agenda Windows Server 2008 R2
New NUMA APIs
New User-Mode Scheduling APIs
New C++ Concurrency Runtime
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5. 32 dual-core hyper-threaded “Tulsa” 3.4 GHz Xeon
12/8/ :16 PM
Example NUMA Hardware Today A 256 Logical Processor System – HP SuperDome A 64 Logical Processor System - Unisys ES7000
64 dual-core hyper-threaded “Montvale” 1.6 GHz Itanium2
32 dual-core hyper-threaded “Tulsa” 3.4 GHz Xeon
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

6. Expect systems with 128-256 logical processors
NUMA Hardware Tommorrow 2, 4, 8 Cores-per-Socket "Commodity" CPU Architectures
PCI
Express*
Nehalem
I/O
Hub
Expect systems with logical processors 6

7. NUMA Node Groups New with Win7 and R2
Socket
Socket
Core
Core LP LP LP LP
Core
Core
NUMA NODE

8. NUMA Node Groups Example: 2 Groups, 4 Nodes, 8 Sockets, 32 Cores, 4 LPs/Core = 128 LPs

9. Sample SQL Server Scaling 64P To 128P
1.7X
1.3X
64P
128P
Windows Server Performance team sample test lab results

10. Bad Case Disk Write Software and Hardware Locality NOT Optimal
Locked out for I/O Initiation
(6)
(2)
Locked out for I/O Initiation
ISR
DPC
(7)
I/O Initiator P1 P2 P3 P4
(0)
Cache1
Cache2
Cache3
Cache4
(5)
Node Interconnect
(3)
DiskA
MemB
(1)
(4)
Cache(s)
I/O Buffer Home
MemA
DiskB

11. Windows Server 2008 R2 Optimization for NUMA Topology
I/O Initiator
ISR
DPC
(3)
ISR P1 P2 P3 P4
(2)
Cache1
Cache2
Cache3
Cache4
Node Interconnect
(3)
DiskA
MemB
(2)
Cache(s)
MemA
DiskB

12. NUMA Aware Applications Non-Uniform Memory Architecture
Minimize Contention, Maximize Locality
Apps scaling beyond even 8-16 logical processors should be NUMA aware
A process or thread can set a preferred NUMA node
Use the Node Group scheme for Task or Process partitioning
Performance-optimize within Node Groups

13. “Minimize Contention and Maximize Locality”
12/8/ :16 PM
demo
NUMA API's
“Minimize Contention and Maximize Locality”
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

14. Agenda Windows Server 2008 R2
12/8/ :16 PM
Agenda Windows Server 2008 R2
New NUMA APIs
New User-Mode Scheduling APIs
New C++ Concurrency Runtime
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

15. User Mode Scheduling (UMS) System Call Servicing
Primary Threads
UMS KT (Backing threads)
Core 1
Core 2
KT(P1)
KT(P2)
KT(1)
KT(2)
KT(3)
KT(4)
Wake primary to regain core
syscall
Migrate request to appropriate KT
Blocked
Running
Parked
Parked
Parked
Parked
Kernel
Kernel
UT(P1)
UT(P2)
User
User
UMS completion list
UT(1)
UT(2)
UT(3)
UT(4)
USched ready list

16. User Mode Context Switch
Benefit
Lower context switch time means scheduling finer-grained items
UMS-based yield: 370 cycles
Signal-and-wait: cycles
Direct impact
synchronization-heavy fine-grained work speeds up
Indirect impact
finer grains means more workloads are candidates for parallelization

17. Getting the Processor Back
Benefit
The scheduler keeps control of the processor when work blocks in the kernel
Direct impact
More deterministic scheduling and better use of a thread’s quantum
Indirect impact
Better cache locality when algorithmic libraries take advantage of the determinism to manage available resources

18. Agenda Windows Server 2008 R2
12/8/ :16 PM
Agenda Windows Server 2008 R2
New NUMA APIs
New User-Mode Scheduling
New C++ Concurrency Runtime
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

19. Visual Studio 2010 Tools, Programming Models, Runtimes
PLINQ
Parallel Pattern library
Agents
library
Parallel
Debugger
Task Parallel
library
Data structures
Data structures
Profiler and concurrency
analyzer
Concurrency runtime
Thread pool
Task scheduler
Task scheduler
Resource manager
Resource manager
Operating system
Threads/UMS
Key:
Managed library
Native library
Tools

20. Task Scheduling WT0 WT1 WT2 WT3 Without UMS (signal-and-wait) WT0 WT1
Tasks are run by worker threads, which the scheduler controls
Dead Zone
WT0
WT1
WT2
WT3
Without UMS (signal-and-wait)
With UMS (UMS yield)
WT0
WT1
WT2
WT3

21. User-Mode Scheduling API's and the C++ Concurrency Runtime
12/8/ :16 PM
demo
User-Mode Scheduling API's and the C++ Concurrency Runtime
“Cooperative Thread-Scheduling”
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

22. Summary Call-to-action
12/8/ :16 PM
Summary Call-to-action
Consider how your solution will scale on NUMA systems
Utilize the NUMA API’s to Maximize Node Locality
Leverage UMS for custom user-mode thread scheduling
Use the C++ Concurrency Runtime for most native Parallel Computing scenarios and gain benefits of NUMA/UMS implicitly
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

23. Resources MSDN Concurrency Dev-Center MSDN Channel9 MSDN Code Gallery
12/8/ :16 PM
Resources
MSDN Concurrency Dev-Center
MSDN Channel9
MSDN Code Gallery
MSDN Server Dev Center
64+ LP and NUMA API Support
Dev-Team Blogs

24. Resources Required Slide Speakers, www.microsoft.com/teched
TechEd 2009 is not producing
a DVD. Please announce that
attendees can access session
recordings at TechEd Online.
Resources
Sessions On-Demand & Community
Microsoft Certification & Training Resources
Resources for IT Professionals
Resources for Developers
Microsoft Certification and Training Resources

25. Related Content Required Slide Speakers,
please list the Breakout Sessions, TLC Interactive Theaters and Labs that are related to your session.
Related Content
DTL203 "The Manycore Shift: Making Parallel Computing Mainstream" Monday 5/11, 2:45-4:00, Room 404, Stephen Toub
DTL06-INT "Task-Based Parallel Programming with the Microsoft .NET Framework 4" Thursday 5/14, 1:00-2:15, Blue Thr 2, Stephen Toub
DTL403 "Microsoft Visual C++ Library, Language, and IDE : Now and Next" Thursday 5/14, 4:30-5:45, Room 408A, Kate Gregory
DTL310 Parallel Computing with Native C++ in Microsoft Visual Studio 2010 Friday 5/15, 2:45-4:00, Room 515A, Josh Phillips

26. Windows Server Resources
Required Slide
Track PMs will supply the content for this slide, which will be inserted during the final scrub.
Windows Server Resources
Make sure you pick up your copy of Windows Server 2008 R2 RC from the Materials Distribution Counter
Learn More about Windows Server 2008 R2:
Technical Learning Center (Orange Section):
Highlighting Windows Server 2008 and R2 technologies
Over 15 booths and experts from Microsoft and our partners

27. Complete an evaluation on CommNet and enter to win!
Required Slide
Complete an evaluation on CommNet and enter to win!

28. question & answer

29. Required Slide
12/8/ :16 PM
© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.