Rate limiting new users might not be that great of an idea, and rate limiting people with negative votes would just make real people leave and make shills rejoin under a different account.

However, what about reducing the voting power of new users or users with negative/low karma? That, and banning from the site should remove prior votes cast.