Yes, you would move backwards in time.

I hate theoretical physics discussions though, since 99% of the people arguing think they're experts on the subject after watching a 30 minute documentary on the Science Channel.