Sounds like a climate control system issue. Could be temperature sensor related. Could be control related. It's hard to say without connecting to the vehicle and referencing a shop manual to test the system.
RepairPal Certified shops can diagnose and repair your 2005 Lexus RX330. They provide transparent pricing with a minimum 12-month or 12,000-mile warranty on repairs and services.