Moved this to the correct area.
No, you dont have to take off power steering pump. There are holes in the power steering pump pulley. You have to rotate the pulley around until one of the holes lines up with the bolt in the water pump and then you can get a socket through there and remove that last bolt.
Its a little awkward but it works.