It's a reference to the pirate flag, which though it could be a skull and crossed boned or swords, often times was just a plain black flag. So more of a, "surrender or prepare to fight because we plan to conquer you". Interestingly, if a pirate ship raised a red flag it meant unless you surrender now, we won't be taking any prisoners.