Found this interesting quote by Steven Pinker on one reason why secularism/non-religion has been historically seen as a threat.
During the Enlightenment, the French philosopher Voltaire called superstition a “mad daughter” and likened it to astrology. The leading thinkers of the time espoused reason and sought to explain the world through the scientific method.
Today, we take a certain pride in approaching the world analytically. When faced with a confusing event, we search for its cause and effect. If we can determine why one action follows another, we can explain why it happened and when it might recur in the future. This makes the outcome reliable.
The fact is that any of us can become superstitious given the right circumstances. You included.