I am not quite sure how going to a temple would bring bad luck. By logic if we assume that somebody would get bad luck going to temple, then how easy it is for people to make their enemies fail (May be we should send all the politicians of the world to the temple). All I can say is that for some people, thinking in certain directions remain stunted.