What are the three main sources of model risk in VaR, and how can each one cause VaR to be wrong?
My FRM material discusses 'model risk' as a major limitation of VaR. It mentions that VaR can be wrong for different reasons — not just bad data but also incorrect assumptions and implementation errors. Can someone categorize the three sources and give examples of each?
Model risk in VaR refers to the possibility that the VaR estimate is inaccurate because of flaws in how it is built, calibrated, or used. GARP's FRM curriculum identifies three primary sources:
Source 1: Incorrect Model Specification
The mathematical framework itself is wrong or inappropriate for the portfolio.
Examples:
- Using a normal distribution for returns that exhibit fat tails (underestimates tail risk)
- Using delta-normal VaR for a portfolio with large option positions (ignores gamma and convexity)
- Assuming constant correlations when correlations spike during crises
- Using a linear factor model for instruments with non-linear payoffs
Consequence: The VaR number is systematically biased. For a normal assumption on fat-tailed data, VaR at 99% might underestimate true risk by 30-50%.
Source 2: Incorrect Parameter Estimation
The model form is correct, but the parameters (volatilities, correlations, means) are estimated poorly.
Examples:
- Using a lookback window that's too short — captures recent regime but misses historical extremes
- Using a lookback window that's too long — includes irrelevant data (pre-crisis correlations dilute post-crisis reality)
- Stale data — using yesterday's prices for illiquid instruments that haven't traded in weeks
- Survivorship bias — excluding defaulted securities from the historical dataset
Consequence: VaR swings unpredictably as parameters change, or it consistently under/overestimates risk depending on the calibration window.
Source 3: Implementation / Coding Errors
The model is correctly specified and calibrated, but there are bugs or operational mistakes.
Examples:
- Mapping errors — a position is assigned the wrong risk factor
- Sign errors — a short position is treated as long
- Missing positions — newly traded instruments not yet in the risk system
- Day-count mismatches — using actual/365 when the instrument uses 30/360
- Data feed failures — prices not updating, causing VaR to appear artificially stable
Consequence: VaR can be wildly wrong in either direction, and the error may go undetected until a major P&L break.
Mitigants
- Backtesting — compare VaR predictions to actual P&L; too many exceptions signals model problems
- Stress testing — captures scenarios the VaR model might miss
- Model validation — independent review of model assumptions, code, and calibration
- Multiple VaR approaches — run parametric, historical sim, and Monte Carlo in parallel
For more on VaR methodology and model risk, explore our FRM course.
Master Part I with our FRM Course
64 lessons · 120+ hours· Expert instruction
Related Questions
Why is DV01 so much smaller than dollar duration if both are supposed to measure rate risk?
When should I stop using modified duration and switch to effective duration?
How should I think about the relationship between Macaulay duration and modified duration instead of memorizing two separate definitions?
Why do hedge calculations often use dollar duration or DV01 instead of just modified duration?
When should I prefer historical simulation VaR over delta-normal VaR?
Join the Discussion
Ask questions and get expert answers.