The people at Nielsen would have the facts on this, but I would say that since Meet the Press airs on Sunday morning, that a majority of Black people who might otherwise watch it would be in church. Meet the Press, and the rest of the "Sunday Morning Gasbag" shows, as Calvin Trillin calls them, are not watched by a high percentage of viewers, White or Black. We used to have discussions about politics at my college, where most of the faculty was Black, and the only two people in the lunchroom discussion bunch that ever seemed to watch any of the Sunday morning interview shows were an Indian Biology professor, Dr Chaudhri, and myself.
So I would say that the President is right about this, and it is hardly any big deal. It would not be taken as any sort of insult by anyone I know. The favorite interview show we discussed was Tavis Smiley's, by the way.