Yep. Throughout the ice age there were periods of very unusually warm weather that could last decades. Neanderthals kind of had to suffer through that because it was hot and lasted a long time and they were not adapted to that. This is nothing new. There were times when the ice caps really melted off and ocean levels rose quite a bit to the point that it made life difficult. Neanderthal adapted and did not say, "gee this must really be fucking over those poor people of color".

And guess what, before the Ice Age the planet went through periods hotter than fuck, like lava flying everywhere hotter than fuck.