Smith was not in Zion, he was the guy that was cutting his hand and getting ready to kill Neo, which is the same guy in Neo's dream that was taken over by Smith when he answered the phone and got out of the Matrix. I'm almost positive that was the same guy on the slab at the end of the movie.