I would replace the whole idler assembly, not just the pulley. That is how I fix this issue on 4.0 liter Jeeps. It sounds like your pulley bolt is stripped out.
RepairPal Certified shops can diagnose and repair your 1995 Jeep Cherokee. They provide transparent pricing with a minimum 12-month or 12,000-mile warranty on repairs and services.