Fuck yeah I'd be pissed. But what will beating him up do? Get you jail time.

Just rub it in his face that you have her and he doesn't.