Apparently Eli Whitney underestimated the amount by which the demand for cotton would increase, when fabric production became more mechanized.
All farm labor has greatly declined in both percentage and actual number terms since the 1860's, at least in the US, Europe and Canada.