You'd still need some kind of rule system, though, otherwise what would stop someone negative repping a member over and over and over again?

If the current rules are done away with, then I'd propose more lax rules to be put in place - you can only rep a certain number of members a day, and you can only rep a member once per day.