Murray Riding Mower Will Not Keep a Charge?

I just replaced the battery. When I try to start it, it will not start. I have to hook the charger up to it and then it will start. Any solution?

By Rick H