What car you got?

I suggest you need a better or bigger turbo that can hold boost all the way up the rev range. Sounds like you've increased the flow so much with manifold and mods that your turbo can no longer keep up with the demand.

New turbo time matie peeps