Maybe in your own house where all the property is yours, and only if you have no children.

My other beef with this line of thinking is that libertarianism actually ends up helping leftism because it's easy for politicians to liberalise drugs but hard to cut welfare.