I think you just assume that your memory is just sort of a video playback of your experience but it's nothing like that at all. It's a complete refabrication of an event and a lot of it is made up because you're filling in spaces.
All my freakouts have been pretty private and directed at family pets and/or people I have been dating for too short a time to freak out at in that way.