Assessing Manager Skill – Shifting from Guessing To Knowing

Smart Thinking: A Skill Versus Luck Essay Series | Issue 5

Written by Michael A. Ervolini

Assessing Manager Skill - Shifting From Guessing To Knowing

INTRODUCTION

Sorting out which equity fund managers are skilled is arduous and expensive. Untold hours and huge budgets are expended each year in assessing manager skill across existing allocations as well as the vetting of potential new opportunities. Even more concerning, however, is that skill assessment is an extremely uncertain undertaking. Consequently, the risks inherent to fund assessment as it is currently conducted are likely underappreciated by the majority of decision-makers. Unwelcome results can include overconfidence and faulty allocation choices.

THE PROBLEM

Increasingly recognized as an industry shortcoming is that little is actually known about skill – what it looks like, how it should be measured, or who has it.1 Sure, there are mountains of academic and practitioner papers discussing skill. And every manager search or review includes some commentary about skill. These assessments rely upon well-established metrics such as relative return, style, active share, information ratio, batting average/slugging ratio, and multi-factor alpha. These and other conventional analytics deliver tremendous insights into a fund’s results and the risk/return tradeoffs used in generating those results. Unfortunately, conventional analytics offer scant information about skill itself. They hint at its presence or absence – pretty much stopping there. The underlying issue is that conventional analytics use as inputs either a fund’s return series or its history of daily holdings. These data are themselves fund outcomes. They do not contain the information necessary to identify and quantify specific skills. A frequently used simile is that attempting to identify manager skill using fund returns is like trying to gauge a tennis player’s ability to serve balls knowing only how many games the player won and lost. Intuition may nudge you toward formulating a judgment but it is based more on guessing and/or desire than analysis.

DECISION-BASED ANALYTICS

Today you can gain total control over assessing manager skill. It’s done by incorporating decision-based analytics into your review processes. Decision-based analytics relate the decisions made by the fund manager with the outcomes they generate. These analytics connect cause and effect. Using decision-based analytics in conjunction with conventional analytics you achieve a deeper understanding of precisely what’s driving fund results. You’ll observe:

  • How much incremental return results from buy, sell, and sizing decisions
  • The level of consistency for each skill year-by-year, rolling periods, and over time
  • The stability of skill levels across sectors, global regions, and factors
  • An orthogonal assessments of key fund risks such as (i) the tendency to hold losers far too long or (ii) selling winners well before their full alpha is captured.

These and other insights available from decision-based analytics elevate your ability to assess a fund’s desirability and to make more effective allocation decisions.

BRINGING IT HOME

You can learn precisely how to incorporate decision-based skill analytics into your processes today. It begins by reading my latest book: Skill Versus Luck – Taking The Guessing Out Of Equity Fund Selection (MIT Press). In just a few hours you’ll learn:

  • Why conventional analytics are insufficient for evaluating fund manager skill
  • How decision-based analytics are computed and provide rigorous measures of manager skill
  • What skill insights you are missing with conventional analytics and how easily they are obtained from decision-based analytics
  • Techniques currently used by the world’s most sophisticated asset owners in combining decision-based analytics with conventional analytics to achieve superior allocations.

To get started, order your copy on Amazon.com: Skill Versus Luck: Taking the Guessing Out of Equity Fund Selection, by Michael A. Ervolini.

ENDNOTES

  1. Based on scores of conversations involving sovereign wealth funds, pension funds, endowments, family offices, insurance companies, banks, and manager search consultancies.
Michael Ervolini headshot

MICHAEL A. ERVOLINI, AUTHOR

The ideas expressed on this website are developed and/or curated by Michael Ervolini. Mike has spent his entire 35 year + career leading efforts to improve and strengthen active management.

skill-versus-luck-logo-white

The multi-trillion dollar active management industry is predicated on the idea that managers have skill – yet little is known about it – Who has skill? How is it measured? This website is dedicated to finding answers to the questions surrounding skill.


SKILL VERSUS LUCK © COPYRIGHT 2026

Discover more from Skill Versus Luck

Subscribe now to keep reading and get access to the full archive.

Continue reading