how do I replace the window switch on drivers side. on 2006 Subaru Legacy

Do I have to remove the door panel to replace the door switch

Asked by for the 2006 Subaru Legacy
Is the switch broken as in busted up? Are you sure it needs to be replaced? What is the trouble?