I cannot think of a correlation of the presence of an audio unit to the starting of the vehicle.
It is possible that during removal, some kind of other electrical issue was created inadvertently.
It will take some professional evaluation and double checking of the work performed to determine what has gone wrong.
www.repairpal.com/repair-shops
RepairPal Certified shops can diagnose and repair your 2001 Pontiac Grand Am. They provide transparent pricing with a minimum 12-month or 12,000-mile warranty on repairs and services.