You need an entire new steering rack to fix this. It will eventually get worse and the assist will all together stop one day.
I agree. Most likely you have a bad steering rack. But check the fluid first and make sure it is up to the correct level. Other than that, start thinking about replacing the steering rack.