heater core

Sounds like you may have a thermostat that is opening too quickly. When you're driving, the air coming through the radiator is doing a great job of cooling the coolant down, and with the thermostat perhaps sticking open, the engine cannot maintain a good hot temperature.