Remove the battery from the system - run on AC power only. If that solves the overheating problem, then yes, replacing the battery should fix the problem.
IF the overheating continues without the battery, make sure the heatsink is free of dust - if it is, then replace the thermal pad that sits between the CPU and heatsink assembly.
