How Index Funds Work: Why Owning Everything Beats Picking Winners

There is a version of investing that sounds too lazy to work: don’t try to find the best companies, don’t hire a brilliant manager, don’t time the market. Just buy a tiny slice of everything and hold it for decades. It feels like giving up. It is, in fact, the strategy that beats almost everyone who tries to be clever — and the data on that is not close.

An index fund is the vehicle for that strategy. It makes no attempt to pick winners. It simply owns every company in a market index, in proportion, for almost no fee. Understanding why that quietly outperforms the professionals is one of the most useful things you can learn about markets. Let us take it apart in order — cause, mechanism, consequence.

It isn’t picking better. It’s paying less — and letting arithmetic do the rest.

Cause: an index fund buys the market, not a bet

A market index is just a list with a rule. The S&P 500 tracks 500 of the largest US public companies, selected by a committee and weighted by size. An index fund holds those same companies in those same proportions, and changes its holdings only when the index does. No analyst is deciding that this stock is undervalued or that sector is due. The fund is a mirror of the market, not a wager on it.

That design has one radical consequence: there is almost nothing to pay for. No research desk, no star manager, no frantic trading. So the fee — the expense ratio, the slice of your money the fund takes each year — can fall to almost nothing. For broad index equity funds it has dropped to about 0.05%asset-weighted expense ratio for US index equity funds · ICI · 2025 a year, according to the Investment Company Institute. Actively managed equity funds, by contrast, average around 0.64%asset-weighted expense ratio for US active equity funds · ICI · 2025 — more than ten times as much.

A tenth of a percent here, half a percent there. It sounds like nothing. That intuition is exactly the trap.

Mechanism: two forces, both pointing the same way

Index funds win for two reasons that have nothing to do with each other — which is exactly why they are so hard to beat.

First, the arithmetic of the average. In 1991 the Nobel laureate William Sharpe laid out a proof so simple it is almost annoying: before costs, the return on the average actively managed dollar must equal the return on the average passive dollar, because together they make up the whole market. It cannot be otherwise — the market’s return is just the average of everyone in it. So after costs, the average active dollar must underperform the market by exactly the extra fees it pays. This isn’t a claim about skill. It’s accounting. The higher fees of active management come straight out of returns.

Second, those fees compound. A fee is charged every year, on the whole balance, including the gains the fee itself prevented you from keeping. Over a few years the difference is trivial. Over an investing lifetime it is enormous — and almost no one feels it happening, because it is never an invoice. It is just a slightly lower line on a chart.

$10,000 · 30 YEARS · 7% GROSS illustrative

1. 01 · THE SAME MARKET

   Both funds hold almost the same stocks.

   Start two $10,000 investments. Both ride the same market — the same companies, the same roughly 7% long-run return. For years the two lines are indistinguishable.

2. 02 · THE FEE

   One charges 0.64%. The other, 0.05%.

   The active fund's fee is about thirteen times the index fund's. Less than a percentage point either way. It sounds like a rounding error — the kind of number you'd never bother to negotiate.

3. 03 · THE GAP

   That "rounding error" costs you $11,478.

   Compounded over 30 years, the fee gap alone quietly removes about $11,478 — more than your original investment. And that assumes the active fund even keeps up with the market. Most don't.

Run the same $10,000 at the same market return for 30 years, and the gap between a 0.05% fund and a 0.64% fund grows to about $11,478 — more than the original investment, lost to a fee you never noticed leaving. And that calculation is generous to active management: it assumes the active fund matches the market before fees. Most don’t even manage that.

Mechanism, part two: the scoreboard

If the arithmetic is right, the real-world record should show most active funds losing to the index over time. It does, overwhelmingly. The S&P Dow Jones Indices SPIVA scorecard — which corrects for the funds that quietly die and disappear from the averages — found that 89.5% of US large-cap active funds underperformed the S&P 500 over the 15 years to the end of 2024 (the figure in the masthead above). Over a single year a manager can get lucky; about a third beat the index. Stretch the window to 15 years and the luck washes out, leaving fees and arithmetic.

Time horizon	Large-cap active funds that underperformed the S&P 500
1 year	~65%
5 years	~76%
10 years	~84%
15 years	~89.5%

Source: S&P Dow Jones Indices, SPIVA U.S. Scorecard, Year-End 2024 (All Large-Cap Funds, absolute return). The longer you wait, the worse the odds of having picked a winner.

The hard part isn’t finding a fund that beats the market in a given year. It is identifying in advance the rare one that will keep doing it — and the persistence data says past winners are no more likely than chance to repeat. This is why even great investors so often route ordinary money into low-cost index funds — and why the wealthy quietly do the same.

Consequence: the strategy that won, and its fine print

The market noticed. Passive funds first overtook active funds in US equities back in 2019year passive US equity funds first overtook active funds by assets · Morningstar , and index strategies have kept gaining share since. Trillions of dollars have moved from trying to win to simply owning the market — one of the largest shifts in the history of investing, driven by nothing more exotic than fees and arithmetic.

For an ordinary investor, the practical takeaway is unglamorous and durable:

1. Buy broad and cheap. A total-market or S&P 500 index fund with a rock-bottom expense ratio captures the market’s return minus almost nothing.
2. Let time, not timing, do the work. Compounding rewards decades in the market far more than clever entries and exits — the same engine described in how money actually works.
3. Mind the fee, always. It is the one variable you fully control and the one that compounds hardest against you.

The fine print matters too, and honesty is the brand here. An index fund is not a guarantee. When the whole market falls, a broad index fund falls with it — diversification removes single-company risk, not market risk. A market-cap-weighted index also quietly concentrates as its biggest companies grow. And “the market returns ~7% a year” is a long-run average — already after inflation — and an average across decades, not a promise for any single one.

To feel the fee-and-time effect on your own numbers, run a balance through the calculator below and change only the fee. Move that one number and watch a third of your eventual balance appear and disappear — almost nothing else in investing is this controllable.

CAUSE

An index fund mirrors a whole market for almost nothing — about 0.05% a year — instead of paying a manager ~0.64% to pick stocks.

→

MECHANISM

Two forces compound: the arithmetic of the average means the typical active dollar must trail the market by its fees, and those fees compound into a large sum over decades — so ~89.5% of large-cap active funds lost to the S&P 500 over 15 years.

→

CONSEQUENCE

Indexing became the majority strategy in US equities; the durable playbook is buy broad and cheap, stay invested, and mind the fee — while accepting that index funds still fall when the whole market does.

The machine in one paragraph

Strip away the mystique and indexing is almost embarrassingly simple: own everything, pay nearly nothing, and let time compound what the fees would otherwise have taken. It wins not because it is clever but because it refuses to be — sidestepping the arithmetic that drags down the average active dollar and the fees that quietly compound against it. You still ride the market down as well as up; that is the price of admission. But over the decades that actually matter, buying the whole machine and holding on has beaten almost everyone who tried to outguess it. Owning everything is not giving up. It is the bet that the whole machine, on average, goes up.

---

This article explains how index funds work. It is educational and is not financial, tax, or legal advice. Figures are dated and, where noted, rounded, illustrative, or directional. Investing involves risk, including possible loss of principal. Consult a qualified professional for your own situation.