I just had a new fuel neck installed, but the fuel shoots back out when filling

I think you answered the question yourself, I would take it back to whoever installed it to give them a chance to rectify the problem. (we all make mistakes). Or was this the reason the filler neck was was changed in the first place ?.