Is it normal i can't be in silence?

I hate when there's no noise because I can hear whispering all the time. Sometimes it's scary but mostly just annoying. Either way I always have to have white noise and I could never take tests because I needed something to be making noise. I always have headphones in at the expense of looking rude. Just wondering if someone else has a similar problem.