The only thing that's simulated is your perception of reality.
If you suddenly go somewhere you've either never been or somewhere you're been just once, strange things might prevent you from getting there and if you do get there, you might notice a glitch.
This has to happen quickly without real planning.
This simulation is not a computer program but ignorance of the truth. Find the truth and the system can't control you anymore, and you'll wake up knowing that you are responsible for your own destiny.