Skip to main content
← Back to R Definitions

Relevant index

What Is Standard Deviation?

Standard deviation is a statistical measure that quantifies the amount of dispersion or volatility within a set of data points relative to its mean. In the realm of quantitative finance, it serves as a widely recognized proxy for risk, reflecting how much an asset's or portfolio's returns deviate from their average over a specific period. A lower standard deviation indicates that data points tend to be close to the mean, suggesting less variability and, consequently, lower risk. Conversely, a higher standard deviation implies that the data points are spread out over a wider range, indicating greater volatility and higher risk. Standard deviation is a fundamental component in various financial models and analyses, enabling investors and analysts to assess the consistency of performance and potential for fluctuation.

History and Origin

The concept of standard deviation has roots in earlier statistical work on variability and errors. However, the term "standard deviation" as it is known today was formally introduced by the English mathematician and biostatistician Karl Pearson in 1893. Prior to Pearson's formalization, similar concepts were often referred to by more cumbersome phrases such as "root mean square error" or "mean error." Pearson sought a more concise and universally applicable term to describe this fundamental measure of dispersion. His work solidified standard deviation as a cornerstone of modern statistics and, subsequently, its application expanded into various fields, including finance10.

Key Takeaways

  • Standard deviation measures the dispersion of data points around their average, serving as a primary indicator of volatility in finance.
  • In investment analysis, a higher standard deviation generally signifies greater risk, while a lower value suggests more stable returns.
  • It is a critical input for calculating various risk-adjusted returns metrics, such as the Sharpe ratio.
  • Standard deviation assumes that data often follows a normal distribution, which can be a limitation in real-world financial markets that exhibit "fat tails" or extreme events.
  • Despite its limitations, standard deviation remains an accessible and widely used tool for preliminary risk assessment and comparing investment options.

Formula and Calculation

Standard deviation is derived from variance, which is the average of the squared differences from the mean. The standard deviation is simply the square root of the variance, bringing the measure back to the same units as the original data.

For a population:

σ=i=1N(xiμ)2N\sigma = \sqrt{\frac{\sum_{i=1}^{N} (x_i - \mu)^2}{N}}

For a sample:

s=i=1n(xixˉ)2n1s = \sqrt{\frac{\sum_{i=1}^{n} (x_i - \bar{x})^2}{n-1}}

Where:

  • $\sigma$ (sigma) = Population standard deviation
  • $s$ = Sample standard deviation
  • $x_i$ = Each individual data point (e.g., daily returns)
  • $\mu$ (mu) = Population mean
  • $\bar{x}$ = Sample mean
  • $N$ = Total number of data points in the population
  • $n$ = Total number of data points in the sample

The use of (n-1) in the sample formula, known as Bessel's correction, provides an unbiased estimate of the population standard deviation, particularly important when dealing with smaller datasets.

Interpreting the Standard Deviation

Interpreting standard deviation in a financial context involves understanding that it measures the historical dispersion of returns around the average expected return. A higher standard deviation suggests that an asset's historical returns have been more spread out from its average, implying greater unpredictability or volatility. For instance, a stock with an average annual return of 10% and a standard deviation of 20% indicates that its returns have historically fluctuated significantly, potentially ranging widely around that 10% average. In contrast, a bond with an average return of 5% and a standard deviation of 2% implies much more consistent and predictable returns.

Investors often use standard deviation to gauge the level of risk they are taking on. A risk-averse investor might prefer assets with lower standard deviation, indicating more stable performance, even if the average return is also lower. Conversely, an investor with a higher risk tolerance might consider assets with higher standard deviation for their potential for higher returns, acknowledging the increased volatility. It is often evaluated alongside other metrics for a comprehensive view of investment characteristics.

Hypothetical Example

Consider two hypothetical mutual funds, Fund A and Fund B, over the past five years. Both funds have achieved an average annual return of 8%.

Fund A's Annual Returns: 12%, 10%, 8%, 6%, 4%
Fund B's Annual Returns: 25%, -5%, 15%, 2%, 3%

To calculate the standard deviation for Fund A:

  1. Calculate the mean (average return):
    ((12 + 10 + 8 + 6 + 4) / 5 = 40 / 5 = 8%)
  2. Calculate deviations from the mean:
    ((12 - 8) = 4)
    ((10 - 8) = 2)
    ((8 - 8) = 0)
    ((6 - 8) = -2)
    ((4 - 8) = -4)
  3. Square the deviations:
    (4^2 = 16)
    (2^2 = 4)
    (0^2 = 0)
    ((-2)^2 = 4)
    ((-4)^2 = 16)
  4. Sum the squared deviations:
    (16 + 4 + 0 + 4 + 16 = 40)
  5. Calculate the variance (sample):
    (40 / (5 - 1) = 40 / 4 = 10)
  6. Calculate the standard deviation:
    (\sqrt{10} \approx 3.16%)

Now for Fund B:

  1. Calculate the mean (average return):
    ((25 - 5 + 15 + 2 + 3) / 5 = 40 / 5 = 8%)
  2. Calculate deviations from the mean:
    ((25 - 8) = 17)
    ((-5 - 8) = -13)
    ((15 - 8) = 7)
    ((2 - 8) = -6)
    ((3 - 8) = -5)
  3. Square the deviations:
    (17^2 = 289)
    ((-13)^2 = 169)
    (7^2 = 49)
    ((-6)^2 = 36)
    ((-5)^2 = 25)
  4. Sum the squared deviations:
    (289 + 169 + 49 + 36 + 25 = 568)
  5. Calculate the variance (sample):
    (568 / (5 - 1) = 568 / 4 = 142)
  6. Calculate the standard deviation:
    (\sqrt{142} \approx 11.92%)

Even though both funds generated the same average returns, Fund A has a standard deviation of approximately 3.16%, while Fund B has a standard deviation of approximately 11.92%. This example clearly illustrates that Fund B experienced significantly greater volatility and, therefore, higher risk in its returns compared to Fund A.

Practical Applications

Standard deviation is a versatile tool with numerous applications across various facets of finance and investing:

  • Risk Assessment: It is a primary metric for gauging the risk associated with individual securities, such as stocks or bonds, and entire portfolios. A higher standard deviation indicates a higher degree of price fluctuation, which correlates to higher perceived risk by investors9.
  • Portfolio Diversification: By understanding the standard deviation of individual assets and their correlations, investors can construct portfolios designed to achieve specific risk-return profiles. Combining assets with low or negative correlations can help reduce the overall portfolio standard deviation without necessarily sacrificing expected return.
  • Performance Evaluation: Standard deviation is integral to calculating risk-adjusted returns measures like the Sharpe ratio and the Sortino ratio. These metrics help investors compare the performance of different investments on a risk-adjusted basis, providing a more holistic view than just raw returns.
  • Quantitative Modeling: In sophisticated financial models, such as the Capital Asset Pricing Model (CAPM), standard deviation plays a role in determining the overall market risk component. It also forms the basis for estimating other risk measures like Beta8.
  • Regulatory Compliance and Disclosure: Regulatory bodies like the U.S. Securities and Exchange Commission (SEC) consider measures of total risk, including standard deviation, in their discussions regarding risk disclosure for mutual funds and other investment companies. These measures help quantify the total variability of a portfolio's returns7.

Limitations and Criticisms

While standard deviation is a widely used and valuable metric, it has several limitations, particularly when applied in the complex and often unpredictable financial markets.

One significant criticism is its assumption that data, especially returns, follows a normal distribution. In reality, financial market returns frequently exhibit "fat tails" and skewness, meaning extreme positive or negative events (also known as outliers) occur more frequently than a normal distribution would predict6. These deviations from normality can lead to an underestimation of potential downside risk, as standard deviation equally weights both positive and negative deviations from the mean. Some researchers argue that this squaring of values in the formula can distort the evaluation, particularly by treating positive and negative deviations identically, which may not align with an investor's perception of risk5.

Another limitation is that standard deviation is a historical measure; it reflects past volatility and does not guarantee future performance. Market conditions are dynamic, and historical standard deviation may not accurately predict future fluctuations or unforeseen "Black Swan" events—highly improbable and impactful occurrences that traditional statistical models often fail to capture. 4Furthermore, it does not distinguish between upward (desirable) and downward (undesirable) volatility, treating both as equal measures of risk. For many investors, true risk is primarily associated with negative deviations or losses. 3As such, standard deviation should be used as one tool among many in a comprehensive risk management framework.
2

Standard Deviation vs. Mean Absolute Deviation

Standard deviation and Mean Absolute Deviation (MAD) are both measures of dispersion, indicating how spread out a set of data points is around its central tendency. The key difference lies in their calculation and interpretation. Standard deviation calculates the square root of the average of the squared deviations from the mean, thereby giving greater weight to larger deviations. This mathematical property means that outliers have a more pronounced effect on the standard deviation. Conversely, Mean Absolute Deviation calculates the average of the absolute differences from the mean (or median), treating all deviations equally regardless of their magnitude.

In finance, standard deviation has become the dominant measure for volatility and risk due to its mathematical properties, particularly its relationship with variance and its role in various portfolio theories like the Capital Asset Pricing Model. However, some critics argue that MAD offers a more intuitive understanding of average dispersion because it aligns more closely with how people conceptually interpret "average deviation" in real-world scenarios. 1Despite this, the mathematical tractability and widespread adoption of standard deviation in academic and professional finance mean it remains the industry's preferred measure.

FAQs

What does a high standard deviation mean in investing?

A high standard deviation in investing indicates that an asset's returns have historically experienced significant fluctuations around their average. This suggests higher volatility and, consequently, higher perceived risk. Investors expecting stability might view high standard deviation negatively, while those seeking potentially higher returns might accept it.

Is standard deviation a good measure of risk?

Standard deviation is a widely accepted and useful measure of total risk because it quantifies volatility. However, it has limitations. It assumes normal distribution of returns, doesn't differentiate between positive and negative deviations, and is a historical measure that may not predict future market behavior, especially during extreme events. It should be used as part of a broader risk management analysis.

How is standard deviation used in portfolio management?

In portfolio management, standard deviation is used to assess the overall risk of a portfolio and to guide portfolio diversification strategies. By analyzing the standard deviation of individual assets and their correlations, managers can construct portfolios that aim to achieve a desired balance between risk and expected return, potentially reducing overall portfolio volatility.

What is the difference between standard deviation and variance?

Variance is the average of the squared differences from the mean of a dataset. Standard deviation is the square root of the variance. While both measure dispersion, standard deviation is expressed in the same units as the original data, making it more intuitive and easier to interpret than variance.

Can standard deviation predict future returns?

No, standard deviation cannot predict future returns or future volatility. It is a backward-looking, historical measure that quantifies past price movements and dispersion. While it provides insights into an asset's historical behavior and potential range of outcomes, it does not guarantee how the asset will perform in the future due to changing market conditions and unforeseen events.