How to Evaluate An Investment Manager Jessica N. Portis, CFA Senior Vice President Summit Strategies Group 8182 Maryland Avenue, 6th Floor St. Louis, Missouri

Liquidity Inflation Risk Asset Allocation Market Volatility Risk Management Manager Selection Liability Management Funding Rate Volatility Government Regulation Rate of Return and Funding Issues * Greenwich Associates, Market Trends 2013, USII-13 1

PUBLIC FUND MANAGER HIRING ACTIVITY* * Greenwich Associates, Market Trends 2013, USII-13. “Have Hired” refers to mandates or assignments US institutions have hired for – additional or replacement – in the past 12 months. “Expect to Hire” refers to anticipated hiring for mandates or assignments in the next 12 months. 2

CLIENTS FIND IT EASY TO HIRE MANAGERS Intellectually Challenging Exercise “Doing” Something Attention from Managers It’s Fun to Go Shopping Thrill of the Chase Good Source of Information for Personal Accounts 3

CLIENTS FIND IT DIFFICULT TO TERMINATE MANAGERS ●Admitting a mistake. ●Personal relationships established. —Probably less today than 10 years ago. ●The crowd mentality. ●Politics —Local —Minority ●Timing —Don’t want to sell at the bottom. ●It’s costly to switch managers. ●Manager’s reason for poor performance or personnel changes appears reasonable. YOU’RE FIRED! 4

Fama’s Nobel Work Shows Active Managers Fated to Lose —10/15/2013 – Charles Stein Active Managers Stink? Blame These All-Too-Common Fund Flaws —10/22/2013 – Focus on Funds by Brendan Conway Why 'active' investment is a losing bet —3/23/2012 – Moneywatch by Larry Swedroe Medieval Medicine And Active Fund Management —7/25/2013 – Personal Finance by Rick Ferri The Problem for Active Managers —4/29/2014 – Opinion by Pauline Skypala ACTIVE MANAGEMENT MAKES FOR AN INTERESTING MEDIA TOPIC 5

ALPHA DOES EXIST; YOU JUST HAVE TO KNOW WHERE TO FIND IT Relatively consistent and high excess return Very consistent and positive excess return Closet index strategies Very consistent and high excess return 6

Detail Client Constraints Qualitative Review Defining Expectations for the Mandate Quantitative Review MULTI DIMENSIONAL APPROACH TO DUE DILIGENCE PROCESS 7

CLIENT CONSTRAINTS = SEARCH CRITERIA ●Desirable Manager Attributes: —Experience o Firm tenure o Investment team “pedigree” o Product history —Historical Performance o Relative to peers o Relative to benchmark —Level of Assets Under Management o Minimum size o Number of clients o Client diversity —Preference for local, emerging or minority manager Candidate Pool Detail Client Constraints Qualitative Review Defining Expectations for the Mandate Quantitative Review 8

DEFINE EXPECTATIONS FOR THE MANDATE AND MANAGER Alpha Expectations Macro Impact on Sub Strategies Evaluation Period Tracking Error Budget Integration with Existing Mandates Detail Client Constraints Qualitative Review Defining Expectations for the Mandate Quantitative Review 9

WHY SETTING EXPECTATIONS IS IMPORTANT ●Helps frame your goals and objectives. ●Focus your efforts on meaningful/impactful strategies. ●Improves your odds of being “satisfied” with the manager. ●Narrows down the list of managers you have to perform in-depth due diligence. —Makes your due diligence process more efficient. —Tedious process that involves the review of both quantitative and qualitative aspects of firm. Detail Client Constraints Qualitative Review Defining Expectations for the Mandate Quantitative Review 10

EFFICIENCY OF ASSET CLASS – ESTABLISHING REALISTIC ALPHA EXPECTATIONS Emerging Markets US Large Cap Value Median Annualized Excess Return: 0.18% Median Annualized Excess Return: 1.75% *Rolling 1-yr Quarterly Source Evestment Alliance, Large Value Strategies/ Emerging Markets Strategies (active & inactive) Detail Client Constraints Qualitative Review Defining Expectations for the Mandate Quantitative Review 11

UNDERSTANDING WHERE YOU ARE IN THE ECONOMIC CYCLE AND THE ALPHA POTENTIAL FOR SUB STRATEGIES Defining Expectations for the Mandate Large Cap Value Manager Sub Strategy Performance Detail Client Constraints Qualitative Review Defining Expectations for the Mandate Quantitative Review 12

IMPACT OF TRACKING ERROR ON RESULTS: WHAT ARE YOU COMFORTABLE WITH? ●Observation: Historically, strategies utilizing a high-conviction investment styles performed best within the US Large Cap Value market segment. ●Takeaway: Align your alpha expectations with your risk tolerance. Risk Tolerance: Relationship Between Excess Return and Tracking Error. Relationship between excess return and tracking error. 27,889 rolling 3-year periods for 723 US large cap value strategies Source: Evestment Alliance. Detail Client Constraints Qualitative Review Defining Expectations for the Mandate Quantitative Review 13

PERFORMANCE EVALUATION DILEMMA ●Good managers sometimes appear “bad”. ●The gut reaction is to terminate poor-performing managers. ●What makes a poor manager? ●How to evaluate track record? Detail Client Constraints Qualitative Review Defining Expectations for the Mandate Quantitative Review 14

HOW TO EVALUATE TRACK RECORDS ●Avoid simply relying on recent performance to evaluate a manager – it can be dangerous. ●Incorporate elements of risk and return. —Standard Deviation —Information Ratio —Tracking Error —Batting Average —Up/Down Market Capture ●Rolling period evaluation is much more telling than a single point in time. —Consistency of results. —Helps isolate luck versus skill. —Not constrained by point in time comparisons. —Assess the effect of macro economic conditions on results. Detail Client Constraints Qualitative Review Defining Expectations for the Mandate Quantitative Review 15

A CASE STUDY ●Question: Should this manager be terminated? ●Answer: It Depends! Performance only captures one dimension. Need to qualitatively understand the manager to better assess future prospects for success. Trailed 8 of last 12 quarters with no positive alpha Trailed 13 of last 20 quarters with no positive alpha Annualized Results Ending 9/30/2007 One-Year Rolling/Quarterly Percentile Ranking Detail Client Constraints Qualitative Review Defining Expectations for the Mandate Quantitative Review 16

MANAGER AVOIDANCE ≥ MANAGER SELECTION Due Diligence Is Focused on Risk Management. “I’d rather be roughly right than precisely wrong.” - John Meynard Keynes Detail Client Constraints Qualitative Review Defining Expectations for the Mandate Quantitative Review 17

QUALITATIVE ASSESSMENT: FIRM Ownership Leadership Compensation Litigation Product Integration Business Mgmt. Operational Infrastructure “I don’t think culture is something you can describe.” – Bill Gates Detail Client Constraints Qualitative Review Defining Expectations for the Mandate Quantitative Review 18

QUALITATIVE ASSESSMENT: PRODUCT AUM Strategy History Client Type Diversity Capacity Management Culture Star vs. Team PRODUCT ASSESSMENT “I don’t want a lot of good investments; I want a few outstanding ones.” – Philip Fisher Detail Client Constraints Qualitative Review Defining Expectations for the Mandate Quantitative Review 19

QUALITATIVE ASSESSMENT: PERSONNEL Team Pedigree Team Stability Add’ l Team Resources Team Experience Team Size & Depth PERSONNEL “Coming together is a beginning. Keeping together is progress. Working together is success.” – Henry Ford Detail Client Constraints Qualitative Review Defining Expectations for the Mandate Quantitative Review 20

QUALITATIVE ASSESSMENT: PHILOSOPHY AND PROCESS Philosophy Investment Process Performance Drivers Trading Portfolio Characteristics Decision Process Risk Culture “If you don’t have a competitive advantage, don’t compete.” -Jack Welch Detail Client Constraints Qualitative Review Defining Expectations for the Mandate Quantitative Review 21

TRIGGERS FOR A FORMAL REVIEW OF A MANAGER ●Firm – Material ownership change or regulatory concern. ●Product – Change in assets under management, style drift, or dilution/orphan of product. ●Personnel – Departure of key investment professional or change in team structure and decision process. ●Philosophy and Process – Change in investment philosophy, shift in market environment not conducive to style, or relaxation of risk controls. ●Performance – Three-year excess return outside of original investment thesis or deterioration in quantitative criteria – information ratio, tracking error, standard deviation, batting average, up-/down- capture ratio, etc. ●Strategic Fit in Client Portfolio – Does the strategy still make sense in terms of your needs? 22

REVISITING THE CASE STUDY 23

Five-Year Rolling/Quarterly Percentile Ranking Growth of $1.00 Universe: International Value Equity (Separate Accounts & Commingled Funds) CASE STUDY: THE COMPLETE PICTURE A high conviction manager underperforms badly: do you stay or go? —Was the firm sold? No. —Had the AUM changed dramatically? No. —Did the team experience turnover? No. —Did the investment process change? No. —Were the markets rewarding their approach? No! Quality and valuation were out of favor for several years. 24

CONCLUSION ●Clearly define the role the manager and strategy play in the overall portfolio. ●Understand both the opportunities and threats associated with a manager prior to investing. ●Define performance expectations for each manager. —What does the historical pattern of returns for a manager look like? —Understand which strategies work best in the asset class and when. ●When issues arise, investigate thoroughly and compare to documented expectations. ●Act quickly when determining that a termination needs to occur. QUANTITATIVE REVIEW + QUALITATIVE REVIEW + ONGOING MONITORING = SUCCESS 25

QUESTIONS AND ANSWERS Disclaimer: Summit Strategies Group (Summit) has prepared this report for the exclusive use by the client for which it was prepared. The information herein was obtained from various sources, such as the client’s custodian(s) accounting statements, commercially available databases, and other economic and financial market data sources. While Summit believes these sources to be reliable, Summit does not guarantee nor shall be liable for the market values, returns or other information contained in this report. The market commentary, portfolio holdings and characteristics are as of the date shown and are subject to change. Past performance is not an indication of future performance. No graph, chart, or formula can, in and of itself, be used to determine which securities or investments to buy or sell. Any forward-looking projection contained herein is based on assumptions that Summit believes may be reasonable, but are subject to a wide range of risks, uncertainties and the possibility of loss. Accordingly, there is no assurance that any estimated performance figures will occur in the amounts and during the periods indicated, or at all. Actual results and performance will differ from those expressed or implied by such forward-looking projections. Any information contained in this report is for information purposes only and should not be construed to be an offer to buy or sell any securities, investment consulting or investment management services. 26