Foes of gay marriage say speaking out can make them a target