For the senior leadership / political appointees that serve at the pleasure of the president, they can be fired for any or no reason. You're right that below that the employees do have some rights, but they also have responsibilities. Illegal activity is a pretty quick way to get rid of anyone.