That's kinda normal. Thing with tensioners is the bolt loosens the opposite way that you push on it to tension/untension the belt. Otherwise the bolt would constantly back out and you couldn't be able to use that bolt.