What are the three types of uncertainty in CME analysis, and which one is the most dangerous?
CFA Level III discusses model uncertainty, parameter uncertainty, and input uncertainty. I can define each one, but I want to understand which matters most in practice and how to tell them apart when analyzing a real forecasting model.
The three types of uncertainty form a hierarchy โ and understanding that hierarchy is critical for CME development.
1. Model Uncertainty โ The Foundational Risk:
Model uncertainty asks: 'Is the chosen model structurally and conceptually correct?' This is the most serious type because if the model is wrong, no amount of data or careful estimation can rescue your conclusions.
Example โ Thornbridge Endowment, Late 1990s:
Many institutional investors used a simple model: 'The expected equity return is a constant ฮผ, and the best estimate is the historical mean over the longest available sample.' As the tech bubble inflated, this model became self-reinforcing:
- Rising prices โ higher historical mean โ higher expected return โ more allocation to equities โ rising prices
The model was structurally flawed because it assumed stationarity (constant ฮผ) when in reality, expected returns vary with valuations, the business cycle, and risk appetite. When the bubble burst, the model's predictions were not just slightly off โ they were catastrophically wrong.
2. Parameter Uncertainty โ Estimation Noise:
Even with the correct model, the parameters (coefficients, means, variances) must be estimated from finite samples. Every estimate comes with standard errors.
Example โ Irongate Capital:
Irongate uses the CAPM to estimate expected returns. Their equity beta estimate is 1.15 with a standard error of 0.20. The 95% confidence interval for beta is 0.75 to 1.55. Using the point estimate of 1.15 with a 6% market risk premium gives an expected excess return of 6.9%. But the true return could range from 4.5% to 9.3% just from parameter uncertainty in beta alone.
Mitigation: Use longer data series (if stationary), apply shrinkage estimators (pull extreme estimates toward the mean), and report sensitivity ranges rather than point estimates.
3. Input Uncertainty โ The Proxy Problem:
Input uncertainty arises when the model requires an unobservable variable and you must use a proxy. The classic example is the CAPM's 'market portfolio' โ theory says it includes ALL investable assets worldwide (stocks, bonds, real estate, human capital, etc.), but in practice we proxy with a stock index like the MSCI World.
When it matters: If you're testing whether the CAPM is theoretically valid (as Roll's critique argues), the proxy problem is devastating โ you can never truly test the model.
When it doesn't matter as much: If you're simply using the CAPM as a practical tool to generate reasonable expected return estimates, the proxy issue is less critical. A good equity benchmark may not be the theoretical market portfolio, but the resulting estimates may still be useful for allocation purposes.
The Hierarchy in Practice:
| Uncertainty Type | Severity | Can It Be Fixed? | Example of Failure |
|---|---|---|---|
| Model | ๐ด Highest | Only by choosing a better model | Tech bubble (constant-ฮผ model), GFC (diversification-eliminates-macro-risk model) |
| Parameter | ๐ก Medium | More data, better estimation | Using 5-year beta when 20-year beta is more appropriate |
| Input | ๐ Variable | Better proxies, awareness of limitations | Using S&P 500 as 'the market' when testing CAPM theory |
Key Exam Takeaway: Model uncertainty is the most dangerous because it can lead to fundamentally flawed conclusions. Parameter and input uncertainty degrade precision; model uncertainty destroys the entire analytical framework.
Explore model uncertainty scenarios in our CFA Level III question bank.
Master Level III with our CFA Course
107 lessons ยท 200+ hoursยท Expert instruction
Related Questions
How do I map a CFA Ethics vignette to the right standard?
When does a duty to clients override pressure from an employer?
Do conflicts have to be disclosed before making a recommendation?
Why do CFA Ethics answers focus so much on the action taken?
What does a high-water mark actually do in a hedge fund fee calculation?
Related Articles
Join the Discussion
Ask questions and get expert answers.