My stepdad smelled my hair in my sleep

Last week I visited my mom and my stepdad late at night. They were watching a movie in bed. Since it had been a while since I've seen them, I joined them and relaxed, next to my stepdad who was in the middle, and in a matter of minutes my mom was snoring lightly. As I dozed off he stroked my hair. I'm not too used to being touched by a father figure in any way of affection so it was weird but I tolerated it because honestly it was pretty relaxing. I'm sure he thought I was asleep because he kissed my head. Again, weird but tolerated because its a form of fatherly affection. But a few minutes later he grabbed a handful of my hair and took in deep breaths of the scent. I pretended to still be asleep yet I felt very uneasy about it. There were internal red flags going off in my head but I didn't physically react to it. I wasn't sure if there was and fatherly affection behind his actions and if I was just overreacting, or if there truly was something wrong with what he did. He did it once more, then after a while I subtly stretched and acted like I just woke up and didn't notice a thing. I managed to remain fairly calm as I mentioned how late it was and that I should get going. So I woke my mom up to say goodbye and left...
I havent said anything to anyone and I'm a bit scared to. Am I overreacting? Making a big deal out of what was meant to be something completely different? Should I confront him? Or my mom, who I'm way more comfortable with?
I'd love some advice guys. Thank you