would guess you have a slight seep from the oil seal on the turbo's impellar, the slight puff on boost will be whats on the shaft geeting blown out and then leak is too small to give a noticible smoke trail, then off boost it builds back up!

I would guess either warn turbo or seals going, should be ok to have it re-cond, wouldnt have a clue as to cost tho