The cavaliers have automatic belt tensioners. You just pull it back and the belt comes off. The only thing I can think of is taking that off and being killed by the spring under it. I would just leave it because the factory knows what the tension should be at. And ya you are pretty much right just get a new alternator. I have heard of getting a alt rebuild kit bit it almost costs as much as a new one.