It was the driver's bearing side that was making the noise, but the passenger's side bearing was also loose so I went ahead and replaced it.