I would imagine that carrying a "legalize marijuana" sign would provke the interest of the police, as well as opposing political factions. The Tea party is an amorphous bunch of people, many of whom only share a dislike of everything connected with the government (except any checks they may be receiving). I do not think that the Democrats or the Republicans would call the cops to investigate a TP'er carrying such a sign, whereas some clown like Tom DeLay would surely do the same should such a sign appear at a DNC meeting. The GOP and the Democrats have a reputation to uphold. The Tea Party has no such reputation, and it is disorganized.
If a large majority of the people favored decriminalization of pot, it would have happened already. I believe that more on the right oppose it than on the left. but there are some on both sides, and the religious factions are at the core of this opposition.