Yes, some confusion might be expected with a completely unfamiliar idiom. But in this case he has confused a couple of well-known simple references, "One horse town" and "one trick pony" -- and perhaps even his favorite obscure insult, "you a dog-faced pony soldier" for good measure.