I notice it more when it is cold. It even makes a grinding sound when turning.
Has anyone noticed a grinding noise when car is started esp when cold? on 2004 Honda Accord
Check power steering fluid. Check your mail for a recall notice from Honda regarding the high pressure(they call it 'feed' ) hose leaking. The recall only covers the hose , but get it done first (free), then see if the noise is better. You may end up needing a pump or reservoir (or both) to completely remedy the noise.The p/s hose recall has no mileage limit (just did one today on an '04 with 183K).It was very noisy when it came in , but after replacing the hose and purging the system for a while the noise went away.