Also not everybody who works in Buckingham palace sleeps there. Some are servants who might ride the tube in to work or have other contact with the hoi polloi. Then they touch the banister of a staircase inside the palace and Charles also happens to touch it.