The really big money goes to financiers, like hedge fund managers that collect HUGE commissions. They produce nothing. They mostly prey on somewhat less wealthy rich people who think of themselves as "special", because not everyone can get into a hedge fund. There is a high minimum to invest, and you have to swear that you can afford to lose money. Bernie Madoff's clients were this sort of people. If there were no hedge funds, no one would be worse off.
No one except hedge fund managers, at least.
Then there are the heirs of family fortunes, the Johnson & Johnsons, the Waltons, the Murdochs and a whole bunch more that are more anonymous.