Is it normal i don’t really want to pitch in for my supervisors christmas gift?

If it feels that badly to you then don't participate, don't go to the golf thing, and make your statement. You are not a dick for being true to yourself. Take a sick day instead. Doing crap we don't want to do, especially when it feels that bad isn't worth it. Not to me anyway. I would personally take the consequences and let people think what they want. I don't do things I don't want to do and stick to instinct and principles. Not everyone will agree, but stuff like that is bad for your health if it really bothers you that much.

at a company that I worked for we had a force gift thing all the time but I just kept saying no and people would still try to force me to accept the gift. I even got paid a full day to go home a few hours early and get drunk

Well it still sounds unresolved, like you can't make a decision, like you are conflicted. So listen to your instinct, your nudges, and do what they tell you. I'm not a fan of lying or making an excuse. $20 sounds like an amount you can afford so don't lie, but if it goes against every grain of your soul, it will haunt you, make you feel ill, and if you do it anyway, it will cost you more than $20 worth. If on the other hand, just paying the $20, driving an hour to play golf, and sucking it up seems like it's the path of least damage and least resistance, then choose that one. I've been in this situation many times. I have chosen to succumb to many of them against my gut feeling. Now that I have a pretty clear idea about how it makes me feel afterwards, I won't do it anymore. It's up to you. Maybe you need to figure out what feels good to you and make the adjustments based on experience. Come back later and tell us what you did, how you felt, and how it went.

I guess it just depends on the person. What kinda work do you do?

Its normal for feeling resentful about forced gift giving.
However in the big picture its probably easier to just pitch in a small amount and say its " all you can afford" at the moment. I get the idea but nobody likes a perceived cheapskate.