Heater not working, is this a heater valve problem or a heater core problem?

Did you checked coolant level? It is unlikelly that heater core gets clogged from one day to the other.

Yes, unless the cable controling the flapper valve on the heater box is broken or binding, you could bypass the valve & that should tell you.