Unsurprisingly, men are generally more tolerant of controversial speech than women are, with homosexuality existing as a marginal exception. The subsequent graph shows the percentages of people, by sex, who do not believe representatives of the following groups should be allowed to speak in public. For contemporary relevance, all responses are from 2000 onward. To avoid racial confounding (see here for differences by race), only non-Hispanic whites are considered. Sample size is 7,699:
One thing to note as we look at differences in tolerance for free speech across major demographic sub-groups is how, across the board, the highest levels of intolerance are reserved for "racists". When it comes to ranking these five categories of controversial speech in terms of the amount of damage and destruction their representatives have wrought on humanity, communism comes out way on top, but among WEIRDOs there is no greater perceived societal scourge than racism.
GSS variables used: SEX, RACECEN1(1), SPKRAC, SPKHOMO, SPKCOM, SPKATH, SPKMIL, YEAR(2000-2014)