This sounds like the ignition switch is in need of replacing. Off should be OFF, so something in the switch is making contact as though it is still ON. It's not likely something is shorted if you can still drive the car.
Take it to a shop and get a diagnosis.
RepairPal Certified shops can diagnose and repair your 1997 Buick LeSabre. They provide transparent pricing with a minimum 12-month or 12,000-mile warranty on repairs and services.