And ye shall overthrow their altars, and break their pillars, and burn their groves with fire; and ye shall hew down the graven images of their gods, and destroy the names of them out of that place.
Unless you can find me a verse that says "Well, as long as they aren't worshiping worshipping it then it's okay."
People worship and pray to an object made by men. That is an idol. It ceased to matter who or what Buddah was the day he died.
You can consider it not to be an idol, by not even understanding what an idol is, but that does not change it's nature.
If someone rubbed it's belly, offered it prayer, and built a shrine around it to do so daily, yes.
Moral relativism isn't a Biblical concept.
Unless you can find me a verse that says "Well, as long as they aren't worshiping worshipping it then it's okay."