Can the emmisons system on a s10 zr5 cew cab 4x4 be replace. on 2004 Chevrolet S10

I am being told my truck was assembled in Cali or out west. IT supposedly has a different emissions system and well it is fouled up. Loses engine power and you can hear it rattle. The cost is about 1000. I want to know can I take it off and not replace it? If not is there a cheaper way. I am in South Carolina and have none of the laws to worry about.

Asked by for the 2004 Chevrolet S10
What is rattling brother reb? Had it scanned?