Most drugs work by somehow interfering with cell metabolism. Their specific result depends on how they manage the interference and which cells. So perhaps a drug intereferes with a very specific chemical sequence that is vital to a pathogen reproducing, but doesn't have much effect on most of the cells in your body.