Is it normal i quit my job because my ex knows i work there?

I’ve been a waitress for a couple of years now, and I was with my ex for a year and a half. I just recently got this job at a mom and pops diner that’s in a popular location and figured why not, it’s been a little over a month in and the jobs been giving me hell anyway but I wasn’t planning to quit until I found a real career set up for myself since I had just got the job.

During the week, it’s seat yourself. So you can go anywhere you please and sit in whoever’s section and it just so happens that him, his mother and father and sister were sitting in my section. I didn’t really freak out about it, just quietly asked another waitress to swap me tables and I would explain later. Anyway. Of course. They noticed me because I had other tables right by them and I overheard his mom say shitty things about them coming here and I totally blew it off but now he’s been trying to get ahold of me again and I just freaked out and quit my job. is it normal I did this because I do not want him to know where I work?? It’s bad enough he knows where I live.