Weird memory loss?

So something weird I have noticed a lot during my life is that snippets of my memory disappear and then I regain them later on.
This could be conversations, things I've done or said or seen etc. So the thing is I can be talking to someone and have a conversation and then the next day that person will say I said / did something and I have no recollection of it at all. But then later on (sometimes hours days even years later) I will remember the conversation or whatever.

I do have anxiety so I don't know if this is a symptom of it or not. I was not on any medication at the time when I first noticed this occurring.

Is this normal? And if it's not can anyone relate or let me know what they think this may be? If you have any other questions please ask. I really would love to find an answer, thanks.