Definitely get a new battery. As for the charging light, I've never seen it come on with a dead battery. Only when the alt is not doing it's job. I went through 3 alternators before I finally got a good one. It's worth the time to have it tested before you ruin a brand new battery.