How difficult is it to change out the o2 sensors?

It's not terribly difficult, but it may not be the cause of your concern. Codes don't tell you what parts to replace, only what areas to test. You could have a vacuum leak, for example, causing "lean" codes if that's what they are.