What causes my air vent to only blow hot air even when i turn on my ac?

I've found that if its really hot out or if you've been running for a while and the engine is hot, you have to turn the fan on high to clear the heat out of the A/C system then it will blow cold air after that.