It is normal for a toddler or very young child to do exactly what you describe since they know no better, abnormal for an adolescent or adult to do this.
Do not mind them. Whatever feels comfortable to you is normal. Yes it is different for each person from male to male. Some males pretty much drop their boxers and pants to their ankles. Some just leave them up, who has the right to tell you what is abnormal?