Is it normal for petite women to be scared of conflict?

I'm 42. 4'10 95 lbs. other day I'm at gym with my husband. He makes a comment to me about one of the women working out. She was big. I laughed. He could have said what he did a lot lower, but at the time, i didn't think that she heard what he said. We finish workout. I go to locker room to clean up. I feel a tap. I turn around and it's the woman my husband made fun. She was right at 6'0 and 170 of solid muscle. She was only about 20. She looked like she was an athlete. I immediately became terrified. Ice always been so confident and felt so invincible. Now I'm having a reality check. This woman could have picked me up and probably squeeze me to death very quickly. I told her I'm so sorry. It was my husband and I'm so sorry for laughing. I don't remember what she said next and walked away. I always was confident then during my first confrontation I was terrified. I walk around now knowing that I'm really helpless in defending myself because I'm so small and weak. I've never thought about this before until this. For a petite woman is it normal to feel scared around ppl knowing you can't defend yourself if you had to because you are so little?