What causes check engine light and batt light to stay on when switch is off

Found the problem with the check engine and batt light. Somebody had hooked the small batt leads on positive side of battery. Before the fuel pump wouldn't come on. Now the fuel pump comes on and stays on instead of 2 sec prime. Still a no start. Has fuel pressure but i need to hook up noid light to injectors