An American Airlines pilot told me that there were once some cell phone way back when that interfered with some of the navigation gizmos. Those phones are no longer in use, so there is no reason not to allow phones and other devices. MP3 players and laptops never caused any problems.
I agree that having a planeful of chattering people would be annoying.