Key Takeaways
- Underperformance compounds: a 1 percent annual gap costs you hundreds of thousands of dollars over a 30-year investment horizon.
- The most common reason for underperformance is paying fees higher than the index fund's expense ratio, which typically runs 0.03 to 0.20 percent per year.
- Trading frequently, holding cash, or trying to time the market all create drag that index funds avoid by staying fully invested and rarely buying or selling.
- Individual stock picking underperforms the index in most years because picking winners consistently is harder than the odds suggest.
- You can measure your own performance against a relevant index by comparing your annual return to a fund that tracks the same market segment.
How Fees Eat Into Your Returns
The single largest reason most active portfolios underperform is fees. An actively managed mutual fund might charge 0.75 to 1.5 percent per year in expense ratios, while an index fund tracking the same market charges 0.03 to 0.20 percent. That difference of 0.5 to 1.5 percent per year is money that never reaches your account — it goes to the fund company, the manager, and the administrative staff.
Over 30 years, a 1 percent annual fee difference turns a $100,000 investment into roughly $1.3 million instead of $1.7 million. You don't see this as a line item on your statement; it's simply subtracted before your return is calculated. If you own mutual funds through a financial advisor, you may also pay an advisory fee on top of the fund's expense ratio, which can push total costs to 1 to 2 percent per year. That's a permanent drag on every dollar you own.
Index funds keep costs low because they don't employ stock pickers or analysts. They simply hold the same stocks in the same proportions as the index they track. When you buy an index fund, you're paying for the computer systems that track the index and the administrative work to keep the fund running — not for research or active decision-making.
Trading Frequently and Market Timing
Every time you buy or sell an investment, you pay a transaction cost. That cost might be a commission to your broker, or it might be the bid-ask spread — the difference between what you pay to buy and what you receive when you sell. If you trade 20 times a year instead of holding and rebalancing once a year, you're paying that cost 20 times instead of once.
Market timing — selling when you think the market will drop and buying when you think it will rise — creates two problems. First, you pay transaction costs every time you move in and out. Second, you're almost certainly wrong about timing. Studies of investor behavior show that most people sell near market bottoms (when prices are lowest) and buy near peaks (when prices are highest), which is the opposite of what makes money. An index fund investor who stays invested through the entire cycle avoids both the costs and the emotional mistakes.
Holding cash while you wait for a better entry point also underperforms. If you're holding 10 percent of your portfolio in cash and the market rises 10 percent, your portfolio rises 9 percent because that cash earned nothing. Over time, being out of the market costs more than the transaction costs you save by not trading.
Individual Stock Picking and Concentration Risk
Picking individual stocks underperforms the index in most years because the odds are against you. The S&P 500 contains 500 companies; if you pick 20 stocks, you're betting that your 20 will outperform the other 480. Professional stock pickers with teams of analysts and decades of experience underperform the index in most years. The odds that an amateur investor beats them consistently are very low.
When you concentrate your portfolio in a few stocks, you also take on concentration risk — the risk that one bad decision or one company's failure will damage your portfolio significantly. An index fund spreads your money across hundreds or thousands of companies, so no single failure can hurt you much. If you own 20 stocks and one goes to zero, you lose 5 percent of your portfolio. If you own an S&P 500 index fund and one company goes to zero, you lose 0.2 percent.
Some individual stocks do outperform the index, but you can't know which ones in advance. If you could, you'd be a professional investor managing billions of dollars. The people who pick the winners are usually lucky, not skilled — and luck doesn't repeat.
The Cost of Holding the Wrong Mix of Investments
If you hold a mix of stocks and bonds that doesn't match your goals or risk tolerance, you may underperform because you're not taking enough risk or because you're taking the wrong kind of risk. A portfolio that's 30 percent stocks and 70 percent bonds will underperform a portfolio that's 80 percent stocks and 20 percent bonds during a rising market, because stocks rise faster than bonds. But it will outperform during a falling market, because bonds fall less than stocks.
The problem arises when your mix doesn't match your time horizon or your ability to tolerate losses. If you have 30 years until retirement and you hold 70 percent bonds, you're underperforming because you're not taking enough risk. You could afford to lose money in the short term because you have decades to recover. If you have 5 years until retirement and you hold 80 percent stocks, you're taking too much risk — a market crash near your retirement date could force you to sell stocks at the bottom.
Index funds come in many varieties: stock index funds, bond index funds, target-date funds that automatically adjust your mix as you age, and funds that track specific market segments like small-cap stocks or international stocks. Choosing the right mix matters more than choosing the right individual investment within that mix.
Measuring Your Performance Against the Right Benchmark
To know whether you're underperforming, you need to compare your returns to the right index. If you own a portfolio of U.S. large-cap stocks, you should compare your returns to the S&P 500 or the Wilshire 5000. If you own a mix of stocks and bonds, you should compare to a blended index that reflects your mix — for example, 80 percent S&P 500 and 20 percent Bloomberg Aggregate Bond Index.
Most brokerage accounts show you your annual return as a percentage. Calculate your benchmark's return for the same period using a financial website or your index fund's performance page. Subtract your return from the benchmark return. If the number is negative, you underperformed. If it's positive, you outperformed — though outperformance by less than your fees suggests you were lucky, not skilled.
Be honest about the comparison. If you own individual stocks and bonds, don't compare yourself to the S&P 500 alone; compare to a blended index that reflects your actual holdings. If you own international stocks, include them in your benchmark. The goal is to see whether your choices — your fees, your trading, your stock picks — are costing you money relative to a passive alternative.
What Underperformance Means for Your Retirement
The real cost of underperformance is the retirement lifestyle you can't afford. If you underperform by 1 percent per year for 30 years, you'll have roughly $400,000 less at retirement on a $100,000 initial investment. That $400,000 could have funded 10 to 15 years of retirement spending, depending on your withdrawal rate and your other income sources.
The gap widens if you underperform by more than 1 percent, or if you start with a larger portfolio. A professional investor managing $500,000 who underperforms by 1 percent per year loses $2 million over 30 years. That's not a small mistake; it's a life-changing amount of money.
The good news is that underperformance is largely preventable. You can't control market returns, but you can control your fees, your trading frequency, and your investment mix. Switching to low-cost index funds, staying invested through market cycles, and holding a mix appropriate to your time horizon will put you ahead of most investors — not because you're skilled, but because you're not paying for the illusion of skill.
Frequently Asked Questions
Can I beat the index if I'm a good stock picker?
Possibly, but the odds are against you. Professional stock pickers with teams of analysts underperform the index in most years. If you're right 55 percent of the time instead of 50 percent, you're doing better than random, but you're still likely underperforming after fees and taxes. The few investors who beat the index consistently may be skilled, or they may be lucky — and luck doesn't repeat reliably.
What if I use a robo-advisor instead of picking stocks myself?
Robo-advisors typically build portfolios of low-cost index funds and rebalance automatically, which keeps fees low and prevents emotional trading. They usually charge 0.25 to 0.50 percent per year, which is higher than owning index funds directly but much lower than active management. If the robo-advisor's fee is lower than your current fees and you're not trading frequently, switching will likely improve your returns.
Does underperformance matter if I'm investing for the long term?
Yes, even more so. Underperformance compounds over decades. A 1 percent annual gap costs you hundreds of thousands of dollars over 30 years. The longer your time horizon, the more important it is to minimize fees and avoid trading frequently, because small differences multiply over time.
How often should I check my performance against the index?
Once per year is enough. Checking monthly or quarterly creates the temptation to trade based on short-term noise. Over a year, you can see whether your strategy is working. Over five years, you can see whether your underperformance is due to bad luck or bad decisions. Over 10 years or more, luck mostly washes out and skill (or lack of it) becomes clear.