Don't misinterpret what he says. He says that just how you reject the belief of thousands of Gods that humanity has believed in at some point, he rejects one more.

That doesn't actually make you an atheist, but it explains to you how someone can reject the Jewish God you believe in.